In the case of an int16xint8 test, the zero point was not being
subtracted from the weights.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Ic77119b200b952715870abc11d09d1a646da86b1

Preparation for v0.30 release

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I65f6ee429a840d562c104c48335f8dcb51f79667

Any needed information moves into the attributes for each operator.
New serialization library version removes teh quantization information
attributes from the schema

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Icf6165687ab1fd34a01f64c01b0b92b2820e72fa

TatWai Chong authored Jun 08, 2022 and Eric Kunze committed Jun 13, 2022

Rename outpad to out_pad, and also fix the dilation in the generator.

Change-Id: I4c1599871f0d0b41856e819d8c644a85ca6d8267
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

It is not in the spec and is being removed from serialization

Change-Id: I82a102de37d8eb75210088dfda2df9b2fadb9c74
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Ibd12e3cbf327dc72bc0ba0f66ab4294ce2bbcb0f

Now corresponds with the ERROR_IF in the specification

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I1f4e303c330d18661ca2e6ef65d0119baabedec6

The operators are pool, conv, reshape, slice, transpose, and table.

Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: I13f8d626df59be14361068222746347ba69d2fb5

Jeremy Johnson authored May 30, 2022 and Eric Kunze committed May 31, 2022

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I098daf49c92da12c07143cdd23ac9bb58acebbb9

Update ref-model RESCALE op to support UINT16 conversions
Add testing for RESCALE UINT16 and ERROR_IFs

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic6e6e53de1f0b054bedb9e6ba3856e7475498aba

Jeremy Johnson authored May 05, 2022 and Eric Kunze committed May 19, 2022

Update to tosa_verif_framework_generator to produce valid test
ranges for pooling and convolution tests

Fix up test filtering to only filter on test name not output
directory

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ifff7e7604a37e8680d7237dc2d85cd806b20e384

Bias was mistakenly unused previously.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: If776e923f7b3cd442c7f147fcbd22a214c37fd36

Fixes issue where pad_left < stride would cause padding
values to be missed

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I2ba0d0969ce1f00e2cb3ca1ab293c5e15a0c7749

Jeremy Johnson authored May 03, 2022 and Eric Kunze committed May 04, 2022

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ie5d119dc317303a0d2a71d018ac94ce6800ecbf5

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I464871b412b3dfc9a84bd3d8fffe4c1de3072b69

Update to ref model to check ERROR_IF criteria for pooling
and convolution ops to match specification

Update to tosa_verif_build_tests to produce valid test ranges and
new ERROR_IF tests
Plus update pooling ops big kernel to 9 (from 6) for better testing
coverage and set dilation to 1 and add out_pad bottom & right for
transpose_conv2d to match specification

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic5759872d40ae8d3f3d07043d9a0f2fa0244d72e

Move all error & validation into tosa_error_if.py
Move all argument and tensor generation into tosa_arg_gen.py
Move utility functions into tosa_utils.py
Create new TosaTensorValuesGen class for specialising tensor
value generation.

Change-Id: Ib9ac65e2308b14471a567c6f11d775c76585bc5b
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ied54f5064dfb44029136b0f0297ef35e6eb0be6e

And limit REDUCE_SUM test values to within int32

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I4d902b245d17eb343cfb2bbc23d9db28c1d1f4c3

* black needed updating for ImportError of new click version

Change-Id: If8e2d13a09996e331d676af31bf3d3aee9403b4e
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

And update test generation to create values in predictable range

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I4ba1ff445bf6caeec9f8782902fc45929fe0ee77

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If785fdaab3026eca5a31888115fba8a6750e0460

- Fixed input shape/expected input shape mismatches
  when due to a missing batch dimension.
- Return from run_test() immediately after running compiler
  when --no-ref-model is set.  This avoids doing result
  comparisons on results that were never generated.
- Exit gracefully when no tests are specified instead of
  throwing TypeError on iterating NoneType

Signed-off-by: Jared Smolens <jared.smolens@arm.com>
Change-Id: I91d2c24fd60aa1cf8b3755894030ff14f1371ed0

- Error check on missing test description file instead of throwing
  json exception
- Removed outdated help option

Signed-off-by: Jared Smolens <jared.smolens@arm.com>
Change-Id: Ia8780a88f4306af19ce63eaa679c84669f5c2ad9

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I41c364905ca364d3446962b737735b9068a29a77

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ifa34021413cd6543c987a7b7c9c664144a4dd95d

And fixes in tosa_verif_run_tests:
* support for no-color printing
* stop double printing of error messages on verbose
* differentiate result code pass from results check

Change-Id: I26e957013a8d18f7d3d3691067dfb778008a1eea
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I65a7fac6e65d2b979139adaf6c5a42139b5493c2

Fix up generated values for rescale tests

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I28fc3b8f189d25a7ad8e5172d4d8a43b86820fcf

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Iff6eb54734e7a78eb22d1a64803b937063b7f65a

Previous code assumed symmetric padding when calculating the divisor for
the average pool, and had issues with extra padding.
The padding now follows the definition from the specification. Extra
padding to the right/bottom is ignored when calculating the average pool
divisor.

Change-Id: Ib05e2346c6e9d55b6fef5294322e58ee18ef4928

The conformance oversize tests are not produced by default.

Change-Id: I9f7d4a60b9d8991889a077b61613e13e288bb65d
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Limit input values to allowed for logical shift operations.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I78110c449274ab96a3f824890c3f03a0eeb345eb

Jeremy Johnson authored Jan 18, 2022 and Eric Kunze committed Jan 20, 2022

Added missing reference model REQUIRE check for shift value (0-31)
Make sure result of LOGICAL_SHIFT_LEFT is masked to input size
Fixed test generation to produce shift values in that range

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Id511de0d989ea954fc1afd18dc2051341bce2cd0

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I0c1edba930b846ff63785c17116cc8d465ecfbf3

Script converts framework and reference model unit tests into a
suitable format for including into a conformance suite.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ida1ec8a0a7ea31fd3a3f62c4cb52d7cc2bf0b439

Fix up issues in existing python scripts.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Id4adab404560c3129c66f31c21ff0ce148283c73

Rename to tosa_verif_run_tests to match build_tests
Improve output and system under test support
Improve xunit support
Add results checker
Add utilities json2numpy and json2fbbin
Add set of python tests
Update README.md

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ia09f8e6fd126579b3ba1c1cda95c1326802417ca

Split generator and runner scripts
Add package setup
Add py-dev-env.sh/.bash to allow editing source files during dev
Update README.md with installation info

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I172fe426d99e2e9aeeacedc8b8f3b6a79c8bd39d

When testing rank mismatch tests, could be accessing beyond the end
a tensor's shape.

Change-Id: I304463e50579d574d629abd13098017a26a1406b
Signed-off-by: Eric Kunze <eric.kunze@arm.com>