fa4ce38d77
Execute test commands always with shell
...
There is no need to handle tests on Windows and Unix differently here.
Always using a shell allows for more flexibility when writing tests.
(rebased by hassec)
2021-06-02 21:21:35 +02:00
0c7d231752
let make python_tests runs in verbose mode
2020-10-22 19:23:51 +08:00
3aedb60513
Support variables: DYLD_LIBRARY_PATH, LD_LIBRARY_PATH
2020-10-21 20:58:51 +08:00
ded2b3c9a3
Support to display the command to execute
2020-10-21 20:45:13 +08:00
5e11376609
Supports setting EXIV2_HTTP or EXIV2_PORT to '' to ignore HTTP test
2020-10-18 21:07:35 +08:00
92fbfc9f7f
Remove remaining vestiges of binary_extension
2020-09-10 12:05:46 +02:00
63b074d690
Deprecated Config.exiv2_ext
2020-09-06 13:11:20 +08:00
caa1acf197
Adjust the format of the command on Windows
2020-09-03 22:29:20 +08:00
c7bf5dd12a
Adjust line breaks, binary extension on Windows
2020-09-02 23:07:57 +08:00
7fc960c520
Add environment variables: EXIV2_HTTP, EXIV2_PORT
2020-09-01 23:19:11 +08:00
ca06206f50
Rename class 'Conf' to 'Config'
2020-08-27 20:40:34 +08:00
6f6699c043
Optimize Conf.init() in bash_tests.utils
2020-08-22 15:07:10 +08:00
f909fac802
Rename bash_tests.utils as BT
2020-08-22 10:00:14 +08:00
d916a60341
Optimize class 'Log' and add class 'Conf'
2020-08-21 21:38:40 +08:00
6773c6c74b
Rename bash_test to bash_tests
2020-08-12 20:24:39 +08:00
ce2cb73654
Let bash_test read the configuration parameters from suite.conf
2020-08-10 22:54:54 +08:00
15c0366087
Rename unit_test and import it in system_tests.py
2020-08-10 21:45:53 +08:00
089b37a637
make python_tests is with python 3.8 (on several platforms) says "This function reads ..." on every test!
2020-05-06 09:04:23 +01:00
fd76cdbdeb
Simplified CopyTmpFiles.setUp_file_action() by using _config_variables['tmp_path']
2020-04-26 11:42:40 +01:00
00d89e6523
configure_suite() calls mkdir($tmp_path) if necessary
2020-04-26 09:53:20 +01:00
92f2458229
fix_1180_date_separator
2020-04-25 14:31:26 +01:00
2850c1e1e2
Fix typo.
2020-04-09 20:52:38 +01:00
377395a2d6
fix_1146_0.27
2020-04-09 17:46:49 +01:00
03799c75e1
[testsuite] Add support for binary output to check_no_ASAN_UBSAN_errors
2018-09-13 11:18:29 +02:00
ed28e15152
[testsuite] Add option to run all commands under valgrind
2018-08-30 16:26:56 +02:00
992877bb39
[testsuite] Implement the supplying of stdin to commands
2018-08-30 16:26:56 +02:00
9cfcfb98a2
[testsuite] Add feature to set environment variables
2018-08-30 12:33:31 +02:00
4f8c150582
[testsuite] Added binary output checking to the test suite
2018-08-30 12:33:16 +02:00
bf50b582cb
[testsuite] Improve PEP8 compliance
2018-08-27 23:28:11 +02:00
deb9c23df8
[testsuite] Add option to run tests from a single file only
2018-08-27 23:28:03 +02:00
35e7037f86
[testsuite] Change the calling order of setUp & tearDown in decorator
...
The FileDecoratorBase injects a new setUp & tearDown function. These new
functions would call the old setUp & tearDown in an inconvenient order: e.g. the
child class CopyFiles would at first call the user provided setUp and then copy
the files. This makes it impossible to perform some action on the file copy in
setUp.
=> This commit changes the call order, so that setUp & tearDown always "see" the
finished environment after file copies are in place and before any cleanup took
place.
2018-06-06 13:59:45 +02:00
41ac25c4f4
[testsuite] Add hooks & documentation for hooks
2018-05-29 10:21:13 +02:00
53c265f8a7
[testsuite] Add path conversion function
2018-05-29 10:21:13 +02:00
300b1dc0ef
[testsuite] Testsuite injects config file values into its namespace
2018-05-29 10:21:13 +02:00
90c8d754b7
[testsuite] Call subprocess.Popen() with shell=True on Windows
2018-05-24 11:06:18 +02:00
939ded283f
[testsuite] check stderr before stdout
...
That way you get to see error messages about wrong filenames instead of an
empty stdout
2018-05-24 11:06:18 +02:00
b364e075c6
[testsuite] Implement DeleteFiles decorator
...
- Refactor FileDecoratorBase to use an arbitrary property in the decorated
class where the list of files is saved
- Add DeleteFiles decorator which deletes all files passed to it after the test
finished
2018-04-25 09:41:50 +02:00
d1714f6564
[testsuite] Fix typo and obsolete syntax
2018-04-25 09:35:42 +02:00
fe98936375
[testsuite] Fixed infinite iteration in CaseMeta.__new__
...
The loop condition in the variable expansion loop was faulty and caused an
infinite loop when no change occured (i.e. no variables were expanded)
2018-04-25 09:35:42 +02:00
740e4ecad1
[testsuite] Improve output in case of errors
...
use the msg= option of unittest.assertXyz() to improve the error
reporting
2018-04-23 10:47:52 +02:00
b6d93558ee
[testsuite] Added option to use different encodings for the output
2018-04-23 10:23:50 +02:00
dd3bcaf41f
[testsuite] Added check that test list have same length
...
commands, retval, stdout & stderr are lists
if they don't have the same length, they are truncated to the smallest list
thereby silently dropping test cases
=> now a ValueError is raised preventing that
2018-04-23 10:17:36 +02:00
c40c90141f
[testsuite] Add debug mode & search directory to runner
2018-04-23 10:17:36 +02:00
bd9d085141
[testsuite] Refactor test suite to use metaclasses & template module
...
The testsuite now uses python's template module for string substitutions which
allows for a more natural substitution syntax known from the shell. Also, it
allows to run the substitutions multiple times, which is not possible with
string.format().
The heavy-lifting is now performed via a metaclass, which expands all variables
on the class creation.
2018-04-21 00:59:59 +02:00
4533d60e74
[testsuite] Added helper function for system_tests.Case.compare_stderr
2018-03-28 10:07:41 +02:00
02f60f11ae
[testsuite] Reimplemented a part of system_tests.CopyFiles
...
- main file handling functionality is performed by a base class => can
be easier extended if required
2018-03-28 10:07:41 +02:00
a15f090f81
Modified test suite so that case sensitive keys are possible
2018-02-18 10:42:16 +01:00
2e745b0b26
Added replacement for the current regression test suite
2018-01-05 00:42:45 +01:00
Alexander Steffen