Jeremy Johnson authored Jun 13, 2022 and Eric Kunze committed Aug 11, 2022

* Add common screen aspect ratios with borders to random pool of tests
* Add up/downscaling to random pool

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Iee8e3f5ed6bd5c941816474df20a7fd433646d6b
Signed-off-by: James Ward <james.ward@arm.com>

TatWai Chong authored Jun 08, 2022 and Eric Kunze committed Aug 10, 2022

Attribute stride and shift are removed, and has new scale and border.

Also add tests in the generator to test tf.resize with all option
combinations.

Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If0f330d04395762d2d907863235eda1532f5e1ff

Jerry-Ge authored Jul 22, 2022 and Eric Kunze committed Aug 02, 2022

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I36ea46e79a0ce42c2dbe47c816b5b5572058c0f2

Fix for tosa_verif_conformance_generator as it needs JSON files
to build the conformance tests.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3509efee671d34d99eee98141400542374dc4f24

Add supported profiles for each test in convert2conformance and
tosa_verif_conformance_generator.
Enable filtering of profile tests on running in tosa_verif_run_tests.
Reorganize arguments in conformance_generator to have more important
ones first.

Change-Id: Ie6e5b68727adb3c39b04aa482dd6433788f7bcc9
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Change-Id: I5cb16ea1f47ee454f03a1d5182827e3fd9f49128
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Jeremy Johnson authored May 17, 2022 and Eric Kunze committed Jul 11, 2022

Change-Id: Ia00a9fa0d260c68ce8532dec9925467558fe7dea
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Aligns with change in specification, as the limit to value being between
(-1 << shift-2) and (1 << shift-2) was overly constraining.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I72cc5743344d4036920c3df366e0a3930701a0cb

Include new submodule for serialization library.

Change-Id: I38cdea3ed8ea3968d1dc06c689dab248d21b14fd
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

In the case of an int16xint8 test, the zero point was not being
subtracted from the weights.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Ic77119b200b952715870abc11d09d1a646da86b1

Preparation for v0.30 release

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I65f6ee429a840d562c104c48335f8dcb51f79667

Any needed information moves into the attributes for each operator.
New serialization library version removes teh quantization information
attributes from the schema

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Icf6165687ab1fd34a01f64c01b0b92b2820e72fa

TatWai Chong authored Jun 08, 2022 and Eric Kunze committed Jun 13, 2022

Rename outpad to out_pad, and also fix the dilation in the generator.

Change-Id: I4c1599871f0d0b41856e819d8c644a85ca6d8267
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

It is not in the spec and is being removed from serialization

Change-Id: I82a102de37d8eb75210088dfda2df9b2fadb9c74
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Ibd12e3cbf327dc72bc0ba0f66ab4294ce2bbcb0f

Now corresponds with the ERROR_IF in the specification

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I1f4e303c330d18661ca2e6ef65d0119baabedec6

The operators are pool, conv, reshape, slice, transpose, and table.

Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: I13f8d626df59be14361068222746347ba69d2fb5

Jeremy Johnson authored May 30, 2022 and Eric Kunze committed May 31, 2022

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I098daf49c92da12c07143cdd23ac9bb58acebbb9

Update ref-model RESCALE op to support UINT16 conversions
Add testing for RESCALE UINT16 and ERROR_IFs

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic6e6e53de1f0b054bedb9e6ba3856e7475498aba

Jeremy Johnson authored May 05, 2022 and Eric Kunze committed May 19, 2022

Update to tosa_verif_framework_generator to produce valid test
ranges for pooling and convolution tests

Fix up test filtering to only filter on test name not output
directory

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ifff7e7604a37e8680d7237dc2d85cd806b20e384

Bias was mistakenly unused previously.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: If776e923f7b3cd442c7f147fcbd22a214c37fd36

Fixes issue where pad_left < stride would cause padding
values to be missed

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I2ba0d0969ce1f00e2cb3ca1ab293c5e15a0c7749

Jeremy Johnson authored May 03, 2022 and Eric Kunze committed May 04, 2022

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ie5d119dc317303a0d2a71d018ac94ce6800ecbf5

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I464871b412b3dfc9a84bd3d8fffe4c1de3072b69

Update to ref model to check ERROR_IF criteria for pooling
and convolution ops to match specification

Update to tosa_verif_build_tests to produce valid test ranges and
new ERROR_IF tests
Plus update pooling ops big kernel to 9 (from 6) for better testing
coverage and set dilation to 1 and add out_pad bottom & right for
transpose_conv2d to match specification

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic5759872d40ae8d3f3d07043d9a0f2fa0244d72e

Move all error & validation into tosa_error_if.py
Move all argument and tensor generation into tosa_arg_gen.py
Move utility functions into tosa_utils.py
Create new TosaTensorValuesGen class for specialising tensor
value generation.

Change-Id: Ib9ac65e2308b14471a567c6f11d775c76585bc5b
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ied54f5064dfb44029136b0f0297ef35e6eb0be6e

And limit REDUCE_SUM test values to within int32

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I4d902b245d17eb343cfb2bbc23d9db28c1d1f4c3

* black needed updating for ImportError of new click version

Change-Id: If8e2d13a09996e331d676af31bf3d3aee9403b4e
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

And update test generation to create values in predictable range

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I4ba1ff445bf6caeec9f8782902fc45929fe0ee77

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If785fdaab3026eca5a31888115fba8a6750e0460

- Fixed input shape/expected input shape mismatches
  when due to a missing batch dimension.
- Return from run_test() immediately after running compiler
  when --no-ref-model is set.  This avoids doing result
  comparisons on results that were never generated.
- Exit gracefully when no tests are specified instead of
  throwing TypeError on iterating NoneType

Signed-off-by: Jared Smolens <jared.smolens@arm.com>
Change-Id: I91d2c24fd60aa1cf8b3755894030ff14f1371ed0

- Error check on missing test description file instead of throwing
  json exception
- Removed outdated help option

Signed-off-by: Jared Smolens <jared.smolens@arm.com>
Change-Id: Ia8780a88f4306af19ce63eaa679c84669f5c2ad9

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I41c364905ca364d3446962b737735b9068a29a77

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ifa34021413cd6543c987a7b7c9c664144a4dd95d

And fixes in tosa_verif_run_tests:
* support for no-color printing
* stop double printing of error messages on verbose
* differentiate result code pass from results check

Change-Id: I26e957013a8d18f7d3d3691067dfb778008a1eea
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I65a7fac6e65d2b979139adaf6c5a42139b5493c2

Fix up generated values for rescale tests

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I28fc3b8f189d25a7ad8e5172d4d8a43b86820fcf

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Iff6eb54734e7a78eb22d1a64803b937063b7f65a

Previous code assumed symmetric padding when calculating the divisor for
the average pool, and had issues with extra padding.
The padding now follows the definition from the specification. Extra
padding to the right/bottom is ignored when calculating the average pool
divisor.

Change-Id: Ib05e2346c6e9d55b6fef5294322e58ee18ef4928