Commit Graph

28 Commits

Author SHA1 Message Date
clanmills
92f2458229 fix_1180_date_separator 2020-04-25 14:31:26 +01:00
Robin Mills
2850c1e1e2 Fix typo. 2020-04-09 20:52:38 +01:00
Robin Mills
377395a2d6 fix_1146_0.27 2020-04-09 17:46:49 +01:00
Dan Čermák
03799c75e1 [testsuite] Add support for binary output to check_no_ASAN_UBSAN_errors 2018-09-13 11:18:29 +02:00
Dan Čermák
ed28e15152 [testsuite] Add option to run all commands under valgrind 2018-08-30 16:26:56 +02:00
Dan Čermák
992877bb39 [testsuite] Implement the supplying of stdin to commands 2018-08-30 16:26:56 +02:00
Dan Čermák
9cfcfb98a2 [testsuite] Add feature to set environment variables 2018-08-30 12:33:31 +02:00
Dan Čermák
4f8c150582 [testsuite] Added binary output checking to the test suite 2018-08-30 12:33:16 +02:00
Dan Čermák
bf50b582cb [testsuite] Improve PEP8 compliance 2018-08-27 23:28:11 +02:00
Dan Čermák
deb9c23df8 [testsuite] Add option to run tests from a single file only 2018-08-27 23:28:03 +02:00
Dan Čermák
35e7037f86 [testsuite] Change the calling order of setUp & tearDown in decorator
The FileDecoratorBase injects a new setUp & tearDown function. These new
functions would call the old setUp & tearDown in an inconvenient order: e.g. the
child class CopyFiles would at first call the user provided setUp and then copy
the files. This makes it impossible to perform some action on the file copy in
setUp.
=> This commit changes the call order, so that setUp & tearDown always "see" the
finished environment after file copies are in place and before any cleanup took
place.
2018-06-06 13:59:45 +02:00
Dan Čermák
41ac25c4f4 [testsuite] Add hooks & documentation for hooks 2018-05-29 10:21:13 +02:00
Dan Čermák
53c265f8a7 [testsuite] Add path conversion function 2018-05-29 10:21:13 +02:00
Dan Čermák
300b1dc0ef [testsuite] Testsuite injects config file values into its namespace 2018-05-29 10:21:13 +02:00
Dan Čermák
90c8d754b7 [testsuite] Call subprocess.Popen() with shell=True on Windows 2018-05-24 11:06:18 +02:00
Dan Čermák
939ded283f [testsuite] check stderr before stdout
That way you get to see error messages about wrong filenames instead of an
empty stdout
2018-05-24 11:06:18 +02:00
Dan Čermák
b364e075c6 [testsuite] Implement DeleteFiles decorator
- Refactor FileDecoratorBase to use an arbitrary property in the decorated
  class where the list of files is saved
- Add DeleteFiles decorator which deletes all files passed to it after the test
  finished
2018-04-25 09:41:50 +02:00
Dan Čermák
d1714f6564 [testsuite] Fix typo and obsolete syntax 2018-04-25 09:35:42 +02:00
Dan Čermák
fe98936375 [testsuite] Fixed infinite iteration in CaseMeta.__new__
The loop condition in the variable expansion loop was faulty and caused an
infinite loop when no change occured (i.e. no variables were expanded)
2018-04-25 09:35:42 +02:00
Dan Čermák
740e4ecad1 [testsuite] Improve output in case of errors
use the msg= option of unittest.assertXyz() to improve the error
reporting
2018-04-23 10:47:52 +02:00
Dan Čermák
b6d93558ee [testsuite] Added option to use different encodings for the output 2018-04-23 10:23:50 +02:00
Dan Čermák
dd3bcaf41f [testsuite] Added check that test list have same length
commands, retval, stdout & stderr are lists
if they don't have the same length, they are truncated to the smallest list
thereby silently dropping test cases
=> now a ValueError is raised preventing that
2018-04-23 10:17:36 +02:00
Dan Čermák
c40c90141f [testsuite] Add debug mode & search directory to runner 2018-04-23 10:17:36 +02:00
Dan Čermák
bd9d085141 [testsuite] Refactor test suite to use metaclasses & template module
The testsuite now uses python's template module for string substitutions which
allows for a more natural substitution syntax known from the shell. Also, it
allows to run the substitutions multiple times, which is not possible with
string.format().
The heavy-lifting is now performed via a metaclass, which expands all variables
on the class creation.
2018-04-21 00:59:59 +02:00
Dan Čermák
4533d60e74 [testsuite] Added helper function for system_tests.Case.compare_stderr 2018-03-28 10:07:41 +02:00
Dan Čermák
02f60f11ae [testsuite] Reimplemented a part of system_tests.CopyFiles
- main file handling functionality is performed by a base class => can
  be easier extended if required
2018-03-28 10:07:41 +02:00
Dan Čermák
a15f090f81 Modified test suite so that case sensitive keys are possible 2018-02-18 10:42:16 +01:00
Dan Čermák
2e745b0b26 Added replacement for the current regression test suite 2018-01-05 00:42:45 +01:00