Alexander Steffen
fa4ce38d77
Execute test commands always with shell
...
There is no need to handle tests on Windows and Unix differently here.
Always using a shell allows for more flexibility when writing tests.
(rebased by hassec)
2021-06-02 21:21:35 +02:00
LeoHsiao
0c7d231752
let make python_tests runs in verbose mode
2020-10-22 19:23:51 +08:00
LeoHsiao
3aedb60513
Support variables: DYLD_LIBRARY_PATH, LD_LIBRARY_PATH
2020-10-21 20:58:51 +08:00
LeoHsiao
ded2b3c9a3
Support to display the command to execute
2020-10-21 20:45:13 +08:00
LeoHsiao
5e11376609
Supports setting EXIV2_HTTP or EXIV2_PORT to '' to ignore HTTP test
2020-10-18 21:07:35 +08:00
Miloš Komarčević
92fbfc9f7f
Remove remaining vestiges of binary_extension
2020-09-10 12:05:46 +02:00
LeoHsiao
63b074d690
Deprecated Config.exiv2_ext
2020-09-06 13:11:20 +08:00
LeoHsiao
caa1acf197
Adjust the format of the command on Windows
2020-09-03 22:29:20 +08:00
LeoHsiao
c7bf5dd12a
Adjust line breaks, binary extension on Windows
2020-09-02 23:07:57 +08:00
LeoHsiao
7fc960c520
Add environment variables: EXIV2_HTTP, EXIV2_PORT
2020-09-01 23:19:11 +08:00
LeoHsiao
ca06206f50
Rename class 'Conf' to 'Config'
2020-08-27 20:40:34 +08:00
LeoHsiao
6f6699c043
Optimize Conf.init() in bash_tests.utils
2020-08-22 15:07:10 +08:00
LeoHsiao
f909fac802
Rename bash_tests.utils as BT
2020-08-22 10:00:14 +08:00
LeoHsiao
d916a60341
Optimize class 'Log' and add class 'Conf'
2020-08-21 21:38:40 +08:00
LeoHsiao
6773c6c74b
Rename bash_test to bash_tests
2020-08-12 20:24:39 +08:00
LeoHsiao
ce2cb73654
Let bash_test read the configuration parameters from suite.conf
2020-08-10 22:54:54 +08:00
LeoHsiao
15c0366087
Rename unit_test and import it in system_tests.py
2020-08-10 21:45:53 +08:00
clanmills
089b37a637
make python_tests is with python 3.8 (on several platforms) says "This function reads ..." on every test!
2020-05-06 09:04:23 +01:00
clanmills
fd76cdbdeb
Simplified CopyTmpFiles.setUp_file_action() by using _config_variables['tmp_path']
2020-04-26 11:42:40 +01:00
clanmills
00d89e6523
configure_suite() calls mkdir($tmp_path) if necessary
2020-04-26 09:53:20 +01:00
clanmills
92f2458229
fix_1180_date_separator
2020-04-25 14:31:26 +01:00
Robin Mills
2850c1e1e2
Fix typo.
2020-04-09 20:52:38 +01:00
Robin Mills
377395a2d6
fix_1146_0.27
2020-04-09 17:46:49 +01:00
Dan Čermák
03799c75e1
[testsuite] Add support for binary output to check_no_ASAN_UBSAN_errors
2018-09-13 11:18:29 +02:00
Dan Čermák
ed28e15152
[testsuite] Add option to run all commands under valgrind
2018-08-30 16:26:56 +02:00
Dan Čermák
992877bb39
[testsuite] Implement the supplying of stdin to commands
2018-08-30 16:26:56 +02:00
Dan Čermák
9cfcfb98a2
[testsuite] Add feature to set environment variables
2018-08-30 12:33:31 +02:00
Dan Čermák
4f8c150582
[testsuite] Added binary output checking to the test suite
2018-08-30 12:33:16 +02:00
Dan Čermák
bf50b582cb
[testsuite] Improve PEP8 compliance
2018-08-27 23:28:11 +02:00
Dan Čermák
deb9c23df8
[testsuite] Add option to run tests from a single file only
2018-08-27 23:28:03 +02:00
Dan Čermák
35e7037f86
[testsuite] Change the calling order of setUp & tearDown in decorator
...
The FileDecoratorBase injects a new setUp & tearDown function. These new
functions would call the old setUp & tearDown in an inconvenient order: e.g. the
child class CopyFiles would at first call the user provided setUp and then copy
the files. This makes it impossible to perform some action on the file copy in
setUp.
=> This commit changes the call order, so that setUp & tearDown always "see" the
finished environment after file copies are in place and before any cleanup took
place.
2018-06-06 13:59:45 +02:00
Dan Čermák
41ac25c4f4
[testsuite] Add hooks & documentation for hooks
2018-05-29 10:21:13 +02:00
Dan Čermák
53c265f8a7
[testsuite] Add path conversion function
2018-05-29 10:21:13 +02:00
Dan Čermák
300b1dc0ef
[testsuite] Testsuite injects config file values into its namespace
2018-05-29 10:21:13 +02:00
Dan Čermák
90c8d754b7
[testsuite] Call subprocess.Popen() with shell=True on Windows
2018-05-24 11:06:18 +02:00
Dan Čermák
939ded283f
[testsuite] check stderr before stdout
...
That way you get to see error messages about wrong filenames instead of an
empty stdout
2018-05-24 11:06:18 +02:00
Dan Čermák
b364e075c6
[testsuite] Implement DeleteFiles decorator
...
- Refactor FileDecoratorBase to use an arbitrary property in the decorated
class where the list of files is saved
- Add DeleteFiles decorator which deletes all files passed to it after the test
finished
2018-04-25 09:41:50 +02:00
Dan Čermák
d1714f6564
[testsuite] Fix typo and obsolete syntax
2018-04-25 09:35:42 +02:00
Dan Čermák
fe98936375
[testsuite] Fixed infinite iteration in CaseMeta.__new__
...
The loop condition in the variable expansion loop was faulty and caused an
infinite loop when no change occured (i.e. no variables were expanded)
2018-04-25 09:35:42 +02:00
Dan Čermák
740e4ecad1
[testsuite] Improve output in case of errors
...
use the msg= option of unittest.assertXyz() to improve the error
reporting
2018-04-23 10:47:52 +02:00
Dan Čermák
b6d93558ee
[testsuite] Added option to use different encodings for the output
2018-04-23 10:23:50 +02:00
Dan Čermák
dd3bcaf41f
[testsuite] Added check that test list have same length
...
commands, retval, stdout & stderr are lists
if they don't have the same length, they are truncated to the smallest list
thereby silently dropping test cases
=> now a ValueError is raised preventing that
2018-04-23 10:17:36 +02:00
Dan Čermák
c40c90141f
[testsuite] Add debug mode & search directory to runner
2018-04-23 10:17:36 +02:00
Dan Čermák
bd9d085141
[testsuite] Refactor test suite to use metaclasses & template module
...
The testsuite now uses python's template module for string substitutions which
allows for a more natural substitution syntax known from the shell. Also, it
allows to run the substitutions multiple times, which is not possible with
string.format().
The heavy-lifting is now performed via a metaclass, which expands all variables
on the class creation.
2018-04-21 00:59:59 +02:00
Dan Čermák
4533d60e74
[testsuite] Added helper function for system_tests.Case.compare_stderr
2018-03-28 10:07:41 +02:00
Dan Čermák
02f60f11ae
[testsuite] Reimplemented a part of system_tests.CopyFiles
...
- main file handling functionality is performed by a base class => can
be easier extended if required
2018-03-28 10:07:41 +02:00
Dan Čermák
a15f090f81
Modified test suite so that case sensitive keys are possible
2018-02-18 10:42:16 +01:00
Dan Čermák
2e745b0b26
Added replacement for the current regression test suite
2018-01-05 00:42:45 +01:00