Commits · 286f834ce60e4ebcaaf131cb7da97ebf79098fa0 · TOSA / tosa-reference-model

This project is mirrored from https://review.mlplatform.org/tosa/reference_model. Pull mirroring updated Aug 05, 2025.

Aug 22, 2022

Simplify the argument parsing and debug code · 286f834c

Eric Kunze authored Jun 22, 2022



Change-Id: Ia681aa0eb1d42fa31a4658badb376f7b32b2e338
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

286f834c

Aug 15, 2022

Check that the shape calculation for PAD is correct · 3c59d5d2

Eric Kunze authored Aug 15, 2022



Matches a corresponding change to the specification

Change-Id: If70356e0c78c1c88530e5d2f58bc50de864f249a
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

3c59d5d2

Aug 12, 2022

Fix CMAKE_BUILD_TYPE instruction in README · c36636ef

Eric Kunze authored Aug 12, 2022



Describes the proper way to build debug.

Change-Id: Ie2f888fc71f84af5382e7e8107eb2d3d93a3b056
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

c36636ef

Aug 11, 2022

Update RESIZE operator in test generator for spec updates · a0e03f3f

Jeremy Johnson authored Jun 13, 2022 and

Eric Kunze committed Aug 11, 2022



* Add common screen aspect ratios with borders to random pool of tests
* Add up/downscaling to random pool

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Iee8e3f5ed6bd5c941816474df20a7fd433646d6b
Signed-off-by: James Ward <james.ward@arm.com>

a0e03f3f

Aug 10, 2022

Update TOSA resize to match specification · f732609a

TatWai Chong authored Jun 08, 2022 and

Eric Kunze committed Aug 10, 2022



Attribute stride and shift are removed, and has new scale and border.

Also add tests in the generator to test tf.resize with all option
combinations.

Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If0f330d04395762d2d907863235eda1532f5e1ff

f732609a

Aug 02, 2022
- Added framework tests for Relu1 Operator legalization · 9391243d
  Jerry-Ge authored Jul 22, 2022 and Eric Kunze committed Aug 02, 2022
```
Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I36ea46e79a0ce42c2dbe47c816b5b5572058c0f2
```
  9391243d
Jul 18, 2022

Include JSON conformance files in python package. · 5a30f9b1

Jeremy Johnson authored Jul 18, 2022



Fix for tosa_verif_conformance_generator as it needs JSON files
to build the conformance tests.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3509efee671d34d99eee98141400542374dc4f24

5a30f9b1

Jul 14, 2022

Add profile to all created conformance tests. · 88588624

Jeremy Johnson authored Jul 12, 2022



Add supported profiles for each test in convert2conformance and
tosa_verif_conformance_generator.
Enable filtering of profile tests on running in tosa_verif_run_tests.
Reorganize arguments in conformance_generator to have more important
ones first.

Change-Id: Ie6e5b68727adb3c39b04aa482dd6433788f7bcc9
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

88588624

Jul 12, 2022

Add conformance generator scripts · 0ecfa377

Jeremy Johnson authored Jun 30, 2022



Change-Id: I5cb16ea1f47ee454f03a1d5182827e3fd9f49128
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

0ecfa377

Jul 11, 2022

Enable pytest pre-commit · 6c6467f3

Jeremy Johnson authored May 17, 2022 and

Eric Kunze committed Jul 11, 2022



Change-Id: Ia00a9fa0d260c68ce8532dec9925467558fe7dea
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

6c6467f3

Modify input limits for apply_scale_32 · 750d27da

Eric Kunze authored Jun 30, 2022



Aligns with change in specification, as the limit to value being between
(-1 << shift-2) and (1 << shift-2) was overly constraining.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I72cc5743344d4036920c3df366e0a3930701a0cb

750d27da

Jul 08, 2022

Update reference model version to 0.31 draft · 4b85a0b0

Eric Kunze authored Jul 06, 2022



Include new submodule for serialization library.

Change-Id: I38cdea3ed8ea3968d1dc06c689dab248d21b14fd
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

4b85a0b0

Jun 17, 2022

Fix reference model use of weight zero point · f733783d

Eric Kunze authored Jun 17, 2022



In the case of an int16xint8 test, the zero point was not being
subtracted from the weights.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Ic77119b200b952715870abc11d09d1a646da86b1

f733783d

Jun 16, 2022

Remove draft status from reference model · 95dfcb8a

Eric Kunze authored Jun 16, 2022



Preparation for v0.30 release

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I65f6ee429a840d562c104c48335f8dcb51f79667

95dfcb8a

Jun 15, 2022

Remove quantization info from serialization attributes · b5fabec3

Eric Kunze authored Jun 07, 2022



Any needed information moves into the attributes for each operator.
New serialization library version removes teh quantization information
attributes from the schema

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Icf6165687ab1fd34a01f64c01b0b92b2820e72fa

b5fabec3

Jun 14, 2022

Update transpose_conv2d to align with TOSA spec · 24594f55

TatWai Chong authored Jun 08, 2022 and

Eric Kunze committed Jun 13, 2022



Rename outpad to out_pad, and also fix the dilation in the generator.

Change-Id: I4c1599871f0d0b41856e819d8c644a85ca6d8267
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

24594f55

Jun 08, 2022

Remove dilation from transpose_conv2d op · 61f66229

Eric Kunze authored Jun 01, 2022



It is not in the spec and is being removed from serialization

Change-Id: I82a102de37d8eb75210088dfda2df9b2fadb9c74
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

61f66229

Jun 07, 2022

Switch reference model to flatbuffers 1.12 · 39ad9397

Eric Kunze authored Jun 06, 2022



Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Ibd12e3cbf327dc72bc0ba0f66ab4294ce2bbcb0f

39ad9397

Change size check in TILE to ERROR_IF · ec0327d2

Eric Kunze authored May 24, 2022



Now corresponds with the ERROR_IF in the specification

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I1f4e303c330d18661ca2e6ef65d0119baabedec6

ec0327d2

Align the serialization schema with TOSA 0.24.0 specification · 86c403b6

TatWai Chong authored Jun 06, 2022



The operators are pool, conv, reshape, slice, transpose, and table.

Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: I13f8d626df59be14361068222746347ba69d2fb5

86c403b6

May 31, 2022
- Remove RESHAPE -1 dimensions support · c23fc3b0
  Jeremy Johnson authored May 30, 2022 and Eric Kunze committed May 31, 2022
```
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I098daf49c92da12c07143cdd23ac9bb58acebbb9
```
  c23fc3b0
May 26, 2022

Add support for uint16_t to RESCALE · f7f78ae2

Jeremy Johnson authored May 25, 2022



Update ref-model RESCALE op to support UINT16 conversions
Add testing for RESCALE UINT16 and ERROR_IFs

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic6e6e53de1f0b054bedb9e6ba3856e7475498aba

f7f78ae2

May 19, 2022

Update framework test generation for ERROR_IF criteria · 0e6218e2

Jeremy Johnson authored May 05, 2022 and

Eric Kunze committed May 19, 2022



Update to tosa_verif_framework_generator to produce valid test
ranges for pooling and convolution tests

Fix up test filtering to only filter on test name not output
directory

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ifff7e7604a37e8680d7237dc2d85cd806b20e384

0e6218e2

May 17, 2022

Initialize accumulator with bias value for CONV3D · 7edb34c0

Eric Kunze authored May 16, 2022



Bias was mistakenly unused previously.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: If776e923f7b3cd442c7f147fcbd22a214c37fd36

7edb34c0

May 16, 2022

Adjust divisor calculation · 67a91550

Eric Kunze authored Feb 02, 2022



Fixes issue where pad_left < stride would cause padding
values to be missed

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I2ba0d0969ce1f00e2cb3ca1ab293c5e15a0c7749

67a91550

May 04, 2022

Fix for NEGATE using 32-bit accumulator · 0e46364d
Jeremy Johnson authored May 03, 2022 and Eric Kunze committed May 04, 2022
```
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ie5d119dc317303a0d2a71d018ac94ce6800ecbf5
```
0e46364d

Control oversized tests for TRANSPOSE_CONV2D · 5860df6f

Jeremy Johnson authored May 04, 2022



Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I464871b412b3dfc9a84bd3d8fffe4c1de3072b69

5860df6f

Apr 28, 2022

Update tensor ops ERROR_IF criteria · 4a6fb9bd

Jeremy Johnson authored Apr 26, 2022



Update to ref model to check ERROR_IF criteria for pooling
and convolution ops to match specification

Update to tosa_verif_build_tests to produce valid test ranges and
new ERROR_IF tests
Plus update pooling ops big kernel to 9 (from 6) for better testing
coverage and set dilation to 1 and add out_pad bottom & right for
transpose_conv2d to match specification

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic5759872d40ae8d3f3d07043d9a0f2fa0244d72e

4a6fb9bd

Apr 11, 2022

Refactor verif/generator/tosa_test_gen.py into different files · 9a66abbd

Jeremy Johnson authored Apr 07, 2022



Move all error & validation into tosa_error_if.py
Move all argument and tensor generation into tosa_arg_gen.py
Move utility functions into tosa_utils.py
Create new TosaTensorValuesGen class for specialising tensor
value generation.

Change-Id: Ib9ac65e2308b14471a567c6f11d775c76585bc5b
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

9a66abbd

Apr 06, 2022

Fix NEGATE int8 test value ranges · 7bebea8c

Jeremy Johnson authored Apr 06, 2022



Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ied54f5064dfb44029136b0f0297ef35e6eb0be6e

7bebea8c

Apr 05, 2022

Add missing REQUIREs check to REDUCE_SUM in refmodel · 7de9b456

Jeremy Johnson authored Apr 05, 2022



And limit REDUCE_SUM test values to within int32

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I4d902b245d17eb343cfb2bbc23d9db28c1d1f4c3

7de9b456

Mar 31, 2022

Update pre-commit tool versions · 5d1a347f

Jeremy Johnson authored Mar 31, 2022



* black needed updating for ImportError of new click version

Change-Id: If8e2d13a09996e331d676af31bf3d3aee9403b4e
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

5d1a347f

Mar 24, 2022

Add missing REQUIRE to NEGATE op · 81ee53d6

Jeremy Johnson authored Mar 23, 2022



And update test generation to create values in predictable range

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I4ba1ff445bf6caeec9f8782902fc45929fe0ee77

81ee53d6

Mar 23, 2022

Improve EQUAL tests to have matching numbers · 25669b31

Jeremy Johnson authored Mar 23, 2022



Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If785fdaab3026eca5a31888115fba8a6750e0460

25669b31

Mar 22, 2022

Fix input rank-match comparison, --no-ref-model flag, no test list · b7af461f

Jared Smolens authored Mar 21, 2022



- Fixed input shape/expected input shape mismatches
  when due to a missing batch dimension.
- Return from run_test() immediately after running compiler
  when --no-ref-model is set.  This avoids doing result
  comparisons on results that were never generated.
- Exit gracefully when no tests are specified instead of
  throwing TypeError on iterating NoneType

Signed-off-by: Jared Smolens <jared.smolens@arm.com>
Change-Id: I91d2c24fd60aa1cf8b3755894030ff14f1371ed0

b7af461f

Mar 19, 2022

Usability cleanup · 62a7b7fe

Jared Smolens authored Mar 19, 2022



- Error check on missing test description file instead of throwing
  json exception
- Removed outdated help option

Signed-off-by: Jared Smolens <jared.smolens@arm.com>
Change-Id: Ia8780a88f4306af19ce63eaa679c84669f5c2ad9

62a7b7fe

Mar 14, 2022

Generate REDUCE_MIN tests (instead of REDUCE_MAX) · 8a8cca9d

Jeremy Johnson authored Mar 14, 2022



Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I41c364905ca364d3446962b737735b9068a29a77

8a8cca9d

Mar 10, 2022

Fix refmodel LOGICAL_XOR (was incorrectly LOGICAL_OR) · 615feee5

Jeremy Johnson authored Mar 10, 2022



Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ifa34021413cd6543c987a7b7c9c664144a4dd95d

615feee5

Mar 02, 2022

Add framework unit test generation scripts · 015c3550

Jeremy Johnson authored Feb 23, 2022



And fixes in tosa_verif_run_tests:
* support for no-color printing
* stop double printing of error messages on verbose
* differentiate result code pass from results check

Change-Id: I26e957013a8d18f7d3d3691067dfb778008a1eea
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

015c3550

Feb 17, 2022

Fix rescale test gen for scale32 & dtype · c0fe04d4

Jeremy Johnson authored Feb 17, 2022



Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I65a7fac6e65d2b979139adaf6c5a42139b5493c2

c0fe04d4