Jeremy Johnson authored Mar 27, 2024 and Eric Kunze committed Mar 28, 2024

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ia3e0d871525840f26948b45658bba71e75d767ea

Jeremy Johnson authored Mar 14, 2024 and Eric Kunze committed Mar 28, 2024

Enable testing of broadcastable bias channel.
Change convolution arguments function to calculate workable
convolutions by adjusting PAD size as needed for FP and errors.
Add --conv-kernel build_tests option to allow different sized
convolution kernels
Improve coverage with batch size, specific shapes and kernels
of 7x7 and 9x9

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I59bb737f398f4363cc606b24fea7812b2059bc01

TatWai Chong authored Mar 21, 2024 and Eric Kunze committed Mar 28, 2024

Set QMin and QMax based on the value of attribute `output_unsigned`.

Change-Id: I7f21f3edd7311295285fb3988b3c800de114777a
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

- Add variable_name and variable_file to the desc.json file
  for writing variable tensors to numpy
- Add the key of num_variables in the unit test declaration to
  specify the number of variable tensors in the graph

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I1109f66ffed52e49dbb14f4a8aca64baa2bea622

Jeremy Johnson authored Mar 21, 2024 and Eric Kunze committed Mar 26, 2024

Make sure the magnitude bias check is not positively biased
Update unit tests

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I00a9470b5e3233ad65360400ed312b0a354130f1

Jeremy Johnson authored Mar 25, 2024 and Eric Kunze committed Mar 25, 2024

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I749b1b9fbfa32954d8748a860280c86087c08e7f

Jerry-Ge authored Mar 21, 2024 and Eric Kunze committed Mar 25, 2024

- The framework test generation script is broken for some tests
  because TF2.16 has an issue with Keras 3.0
- Enforce the script to use Keras 2.0 and we also need to run
  pip install -U tf_keras together with this change

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I519aa89c5d5bacf659a809d9eda456bd83b33527

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Iaeed119ff81c8d1363dd26be7468bb53f9d70eae

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ideeb67ec4b33b9c6922d6765f4b0eb5ca69bdf89

- The desc.json file for variable examples are missing
  the variable_name and variable_file fields
- Add those missing fields to silence the error

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ia391d308849efd4111aff98500775ad0f3e741ac

Fix CONV2D WrongOutputType FP32 & Pad/Stride/DilationSmallerZero issues.
Fix PAD WrongInputType.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I57fc57c43e63685e05bf5e3d562c3167411fd57b

Tai Ly authored Mar 14, 2024 and Eric Kunze committed Mar 20, 2024

This patch implements changes required by the new acc_type field in
ConvAttribute and TransposeConvAttribute

Signed-off-by: Tai Ly <tai.ly@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ib13dbeec4d8920e0ddbcca02b727e7277f2c8d62

Jeremy Johnson authored Sep 27, 2023 and Eric Kunze committed Mar 19, 2024

All generator functions now take RNG argument to allow different
random number generators, rather than relying on global RNG
Default behaviour is the same as before using global RNG
Added stable random generation mode
* shape rng based on operator, rank and datatype
* arguments rng based on operator, shape and datatype
* build operands and data rng based on op, shape, datatype and args
Add optional stable RNG test generation to conformance_generator

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I5ee4ff85575a81177fd74ed1617e946bfa3a0769

This implements changes due to ClampAttribute and PadAttribute
field changes.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Ide01e2a27fe3c1ea7794e7a4b6780b7eae436caf

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I7efc03f16136b2b74f8dfef79a6e7e147c93f4ed

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I5c240eec4385aaa3a6b4bf9533669b91c74c76cf

Jeremy Johnson authored Mar 13, 2024 and Eric Kunze committed Mar 13, 2024

Don't sort test lists for original operation to keep original data
generation ordering.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3194b7d50505b422557ef12b72a9699483640c31

Jeremy Johnson authored Mar 11, 2024 and Eric Kunze committed Mar 13, 2024

Make sure output shape is big enough to perform statistical
compliance error checking.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ia7ed7dd19a6c9cb888363f6cbdf0c6943235e0be

Jeremy Johnson authored Feb 13, 2024 and Eric Kunze committed Mar 12, 2024

Add test list output to tosa_verif_build_tests and test list
capture to file for tosa_verif_conformance_generator

Improve PAD & CONV2D test coverage for tosa-mi conformance

Change to use logging for output to hide info from test lists
Tweak verbosity levels of tosa_verif_conformance_generator

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic29da5776b02e9ac610db6ee89d0ebfb4994e055

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I663a92001bf902cdc5327f386b2e896052a816ff

Added support to ref model and testing

Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: Iece53d07c8986332fdd8f1ce5ed6265349df1b6a

Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: I81bb322132daf25328a40342edc62d8e1db9edd6

Tai Ly authored Mar 01, 2024 and Eric Kunze committed Mar 06, 2024

This patch implements changes required for RescaleOp's
multiplier and shift changing from attributes to inputs

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I178919727e3220c749dad0ebce141e695868fee0

Fix problems from ensuring matching op tests.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ib2395110e47c56fea3cf3784a6b872fea7717db7

Jerry-Ge authored Feb 27, 2024 and Eric Kunze committed Mar 05, 2024

- Users have to specify the --test_desc filename argument for using
  reference_model
- Update the initTestDesc function to allow users to use pure
  command line arguments to specify all test descriptions

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ia23d4ba550aace6c3cd202e21bc8fbe6e0be1cf0

Jerry-Ge authored Feb 20, 2024 and Eric Kunze committed Mar 05, 2024

- Add Tosa Sin/Cos operators to reference_model
- Add conformances tests

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I3f597ddf5dac2c64d6dd6aa15781b40b8468eaa6

Jeremy Johnson authored Feb 29, 2024 and Eric Kunze committed Mar 05, 2024

By always using an exact build_tests filter, to stop
extra operator tests such as add_shape being created

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I0fc4dd04276f9cd24c333e6a5c6b40d27d00e6ea

Jeremy Johnson authored Feb 26, 2024 and Eric Kunze committed Mar 05, 2024

Improve internal config naming and remove old config info.
Make sure all configs are properly initialized.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I674e23eddc9694237ea4e66a689481c13965eb90

Jeremy Johnson authored Feb 27, 2024 and Eric Kunze committed Mar 05, 2024

Requirement to pin has been removed

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I058a8152815238691160bd139fa885877858d55a

Jeremy Johnson authored Feb 28, 2024 and TatWai Chong committed Mar 01, 2024

Always create the shift as a tensor for all types in testing.
In the reference model, set the shift operand to be available for
all types, but only read in the shift tensor for i32.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: Ia267cbf8b63ca0a9c97b38e8fb4db83eeb8c0538

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I55f663c19a1d2579d24b25c7f0d476e56e7e6dd2

- With the update of ConvertU8toF16 to store F16 data in
- F16 containers instead of F32, need to update the
- function caller to have updated signatures

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I8568120c5e67e837eaf6ec70f8db791c4e33d48b

This patch adjusts reference model for attribute name changes in
tosa.fb schema, and for obsoleted slice/tile/reshape attributes
also updated examples due to the breaking tosa flatbuffers changes

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I105eb99a4c35f289c5078aed0a7f9cbb6dfe9123

Jeremy Johnson authored Feb 19, 2024 and Eric Kunze committed Feb 26, 2024

Add general validateData function used by ABS_ERROR, ULP,
RELATIVE and REDUCE_PRODUCT to find and output largest deviance
from the error bounds.
Clean up naming inconsistencies bewteen verify modes.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ib903faf36f784cacae91edab61d8e489461a727c

Jeremy Johnson authored Feb 22, 2024 and Eric Kunze committed Feb 26, 2024

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I1fb734285c60f71a74a5815e76ace51ace719400

Tai Ly authored Feb 22, 2024 and Eric Kunze committed Feb 26, 2024

This patch implements changes needed for resize op's
scale/offset/border changing from attributes to inputs

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I20db0687fad40711f3ded644af51096292dd05b3

TatWai Chong authored Feb 05, 2024 and Eric Kunze committed Feb 23, 2024

also check if tensors of start and size are allocated.

Change-Id: I6a72d11ebcb8d0725fe267058dfd792102459427
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

* Int16/UInt16 reference outputs were previously saved to INT32
* Save those in their native dtypes and updated other affected code

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I0c3b7fba096a8cb1ddabef20ad13498b8f46d36f

TatWai Chong authored Feb 12, 2024 and Eric Kunze committed Feb 22, 2024

Right shift result on i32_t data type only, i.e. other data types
don't carry the shift operand.

In the spec, the shift type is a tensor in MT profile and is an
attribute in BI/MI profiles. Currently we treat the shift as tensor
throughout.

In implementation, since `ternaryExpr` is not implemented in Eigen,
decompose the original calculation into multiply and shift operation
seperately, and execute them via `binaryExpr`.

Change-Id: I349f4969545134ac5f13bc83032cd75cca3e7ba0
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I99b70f94aff2ccd4af64875697e124eb60bc5b08