Add a --json command line option to dump our data in json format.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Grant Likely authored Mar 10, 2021 and Vincent Stehle committed Mar 11, 2021

Mostly an aesthetic change, but having the filename in lowercase is more
friendly when running from case sensitive filesystems, like on Linux.

Signed-off-by: Grant Likely <grant.likely@secretlab.ca>

Usability upgrades

Rework command line using argparse
Add logging and debug
Add csv output
Use iconv to cat logs

Currently we `cat' all the discrete .ekl log files into a big, single file
directly as binaries. This adds UTF-16 two bytes BOM everywhere in the
middle of the resulting cat_summary.ekl.

Fix that with iconv: we convert all the log files to UTF-8 on the fly and
back to UTF-16 while concatenating.

While at it, handle an optional command line argument to specify the
folder to search for logs.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Use logging to output debug messages and add a --debug command line option
to change the log level.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Add the --csv command line option to generate a .csv file. This is handy to
manually triage issues in a spreadsheet.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Use argparse for command line arguments. This gives us the online help and
will give use more flexibility to add command line options.

We preserve the current behaviour with up to two positional arguments for
the ekl and seq input files, and up to two arguments for the key:value
search.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

We capture the group iteration, start date and time, revision, description
and device path.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

This is easier for argument passing and more flexible for adding fields in
the future.

We take care to preserve current fields ordering in output result.md.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Added License

We generate a table for the summary rather than sections, as this is
arguably more readable.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Avoid duplicating the GUID, result and name in the log.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Currently the parser tries to record the test service as 'group' and the
test protocol as 'test set'.

However, some tests have only a protocol and no service (e.g.
LoadedImageProtocolTest). In this case, the parser will record the protocol
as 'group' and the full line dictionary as 'test set'.

Fix this case by recording an empty 'group' and the protocol as 'test set',
more in line with the generic case.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Strip .ekl input lines, to avoid capturing "\n" in the log field. Adapt
the empty lines skip test accordingly.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

This allows to execute Parser.py directly with:

    $ ./Parser.py <arguments...>

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

The json module is unused: remove it.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Specify language of the python bloc. This enables syntax coloring with
pandoc.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Remove spurious whitespaces at end of line in Parser.py and README.md.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

We add a Makefile and a configuration file to automate the generation of
README.pdf with pandoc.

Also, update the .gitignore accordingly.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

For the moment we ignore result.md, the output of Parser.py.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Fixes

The title is already after an ATX-style #, which makes the following
setext-style underline superfluous. Remove the underline to fix the
rendering with pandoc.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

This repairs the run with default sample filenames on Linux.

Signed-off-by: Vincent Stehlé <vincent.stehle@arm.com>

I like this one better, not Necessarily better, but easier to read.

devloped a generic dict in list writier.

other small bugfixes

Need to address the ekl parser ASAP, unfortunately the logs are not as parsable as original thought.
Generated MD is very rudimentary, needs more attetion, list bandid also restrics CSV output.

Now outputting CSV, re-factored Command line arguments, bug fixes, spelling fixes, and more.

not first time I made this issue, MacDown recognizes `###text` and `### text` as both H3...

main is now sample find command, with sample if run with no arguments, command line argumet 1: file, 2:key, 3:value