- May 31, 2021
-
-
Vincent Stehle authored
Try to semi-automate the writing of yaml configuration files by generating a template yaml configuration from tests data, which can be further edited manually. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- Mar 15, 2021
-
-
Vincent Stehle authored
Add a --config option to Parser.py, to use a configuration file. This configuration file can contain a list of transformations to apply to the test results. This will allow to mark tests as false positives or to waive failures. We describe the YAML configuration file format in details in the README.md. We also add a sample configuration, to demonstrate usage of configuration files with the already provided sample log and sequence files. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehle authored
A skip test set is a test set, which was considered but had zero of its tests run. This is not the same as a dropped test set, which we do not find in the log at all. Generate artificial test entries with the result set to SKIPPED to keep track of the former. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- Mar 11, 2021
-
-
Vincent Stehle authored
Currently we read db1 and db2 from the log and sequence files respectively. Then we compute a cross_check database with all the tests, which have run, as well as a would_not_run database with all the tests sets, which have not run. Combine those databases into a unified cross_check database and get rid of would_not_run. We create artificial test entries for the dropped tests sets. While at it, we keep the spurious run tests, if any, and mark them as such. The benefits are that we do not need special handling for dropped tests sets down the pipe anymore, and that our future configuration file filtering rules will also apply to spurious and dropped tests. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehle authored
Add a --sort command line option to Parser.py, to allow sorting the tests data in a configurable manner before producing the outputs. Also, document usage in the README.md and fix parser.py case. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- Mar 03, 2021
-
-
Vincent Stehle authored
Use argparse for command line arguments. This gives us the online help and will give use more flexibility to add command line options. We preserve the current behaviour with up to two positional arguments for the ekl and seq input files, and up to two arguments for the key:value search. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- Mar 01, 2021
-
-
Vincent Stehle authored
Specify language of the python bloc. This enables syntax coloring with pandoc. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehle authored
Remove spurious whitespaces at end of line in Parser.py and README.md. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehle authored
We add a Makefile and a configuration file to automate the generation of README.pdf with pandoc. Also, update the .gitignore accordingly. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- Feb 19, 2021
-
-
Vincent Stehle authored
The title is already after an ATX-style #, which makes the following setext-style underline superfluous. Remove the underline to fix the rendering with pandoc. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehle authored
Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- Oct 01, 2020
-
-
Jeff Booher-Kaeding authored
-
- Sep 16, 2020
-
-
Jeff Booher-Kaeding authored
Need to address the ekl parser ASAP, unfortunately the logs are not as parsable as original thought. Generated MD is very rudimentary, needs more attetion, list bandid also restrics CSV output.
-
- Sep 01, 2020
-
-
Jeff Booher-Kaeding authored
Now outputting CSV, re-factored Command line arguments, bug fixes, spelling fixes, and more.
-
- Aug 18, 2020
-
-
Jeffrey Booher-Kaeding authored
not first time I made this issue, MacDown recognizes `###text` and `### text` as both H3...
-
Jeff Booher-Kaeding authored
-
- Aug 12, 2020
-
-
Jeff Booher-Kaeding authored
-