Change FP_SPECIAL testing to be used for DOT_PRODUCT cases only.
Use default EXACT matching - where zeroes of different signs will
be ignored when testing for equality

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I0461c42258611cae597f693507075b3ef15fbe19

also fixed traceback.format_exception calls to fix hang of framework
testing due to failing tests.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Ic943aec7981a71dc8f9c898a16ac3f408f07a370

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I8c4439189756a4d20cf5395fbbbe4aa6af7873ce

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I6b6a303a475525840a281c7e4e6ecc326c6a1aac

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I75840f6b4ff11a63c4c874f8ded23afb5a71ad55

Signed-off-by: Suraj Sudhir <suraj.sudhir@arm.com>
Change-Id: Ib2b95e73b226d64c4db5ad1ed22c123e04d7e6f9

Won Jong Jeon authored Apr 17, 2024 and Eric Kunze committed Apr 18, 2024

This is a temporary change and waiting for compliance testing code
for BF16/FP8.

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I61a548cffedb5f16947cd1029999ccd4ff25a535

Support existing conformance profiles to ease transition
New combined config tosa_ext_profile_ops_info.json that supports
extension selection

Signed-off-by: Won Jeon <won.jeon@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic04696a01d619d191b9c8abc4ef7f4e8b86c52ca

Evan Chandler authored Apr 18, 2024 and Eric Kunze committed Apr 18, 2024

Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: I21e305dbe4f406e85c6ed3d5b30b5b85dd208825

Jeremy Johnson authored Apr 11, 2024 and Eric Kunze committed Apr 18, 2024

Cope with large error bounds with small reference values.
Change how error bounds of NaN are avoided for ABS_ERRORs.
Update SIN/COS compliance to latest spec and use input value as
magnitude.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I55aca59e0255e1cfd255b08edb845c3e33ca7eff

 Add Rank 0 tests.
 Random usage of CONST verus INPUTs for tests.
 Use new stable random and generator select modes.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I2ab131f6ab80e3061a56cd5b8076225011af652e

Add Rank 0 tests.
Random usage of CONST verus INPUTs for tests.
Use new stable random and generator select modes.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I9f5b982fdabc5a5b20f04d797d5f3452902c041e

Add Rank 0 tests.
Random usage of CONST verus INPUTs for tests.
Use new stable random and generator select modes.

Add "random_const_inputs" supports_for to conformance config.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I5a76c1019514ed8426518b3ea7df5093990c9fbd

When width or height are one then H/2 or W/2
are not integral.

Signed-off-by: Dmitriy Smirnov <dmitriy.smirnov@arm.com>
Change-Id: I1a849bec7cbb1d55fd5f085ebe58be45ea0b508e

TatWai Chong authored Apr 16, 2024 and Eric Kunze committed Apr 17, 2024

This warning is raised in the integer comparison of `applyClip`.

Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: If427cb08b8456480898375d8b77302ca7162f737

Fixes input tensors for int16 and int8 tests for MUL,
LOGICAL_LEFT/RIGHT_SHIFT, COND_IF, WHILE_LOOP

Change tensor generator functions to use type aware
randTensor() function.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If81a783929c29e1fd5e91477dbcdaf79c738f6b0

Jeremy Johnson authored Apr 15, 2024 and Eric Kunze committed Apr 16, 2024

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I91f7bc956c3b141e1518098781bbf29577c3fbbc

Evan Chandler authored Mar 08, 2024 and Eric Kunze committed Apr 16, 2024

Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: I5a9a1c63345bd83ca04bc6c2a99b0ef3612971ee

This changes to use native type serialization and deserialization
for pad_const, clamp min_val/max_val and const data attribute values
whereby fp16 values are stored as 2 bytes each, fp8 values are stored
in 1 byte each, etc.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Ia95d320fe8c546ce1d1ccc035d6e9bcaadcc9ca3

Remove assert statements on bad tensor types and returns
nullptr so caller can properly generate return errors.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I8687ba0c7bc1000e3e7f8a0651a949c3c61c5128

Default test range is now rank 0 to 3 instead of 1 to 4

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ibde66b60b58de9f4a3852a3807c01f8dae61206f

Only generate valid arguments for slice, improving test generation.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Id2db7bd42773e8d182ad814c4295ea4927a035a8

Override the default input/consts used for each op with biased
random combos.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I7a5eb2b01a47248bc0db5a2f930ad2ac52cc0a67

TatWai Chong authored Apr 02, 2024 and Eric Kunze committed Apr 08, 2024

Signed integer type is used to retain QMax and QMin no matter what
the value of `output_unsigned` is, but the value of QMax and QMin
are unsigned integer when output_unsigned is true.

Also add a handful of arithmetic helpers to align the pseudo code.

Change-Id: Ie3cd444a290ddae08884186cd4b349a88acad032
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

Jeremy Johnson authored Apr 04, 2024 and Eric Kunze committed Apr 08, 2024

Now supports shorter "--target-rank 0 1" and the original method of
"--target-rank 0 --target-rank 1"

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ia45a168588c6fca4dcd4cbbf526ac49cb0bdf621

Also simplify the check to align the pesudo code structure.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>
Change-Id: I6023046026d2784dedd963b2b4d34a1117d45c23

Signed-off-by: evacha01 <evan.chandler@arm.com>
Change-Id: I8c59ecb5a1fb53d0e9bf64333709f9e3cc908b49

* Enable showing actual runtime shapeType tensor value when the
  --dump_intermediates=1 flag is on

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ibd5aa8aa27505364fbbf9d1addd0bdef0deda885

Jeremy Johnson authored Mar 27, 2024 and Eric Kunze committed Mar 28, 2024

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I8cd95ed0ae3260eea785e4e0275961534cd1f0c5

Jeremy Johnson authored Mar 27, 2024 and Eric Kunze committed Mar 28, 2024

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ia3e0d871525840f26948b45658bba71e75d767ea

Jeremy Johnson authored Mar 14, 2024 and Eric Kunze committed Mar 28, 2024

Enable testing of broadcastable bias channel.
Change convolution arguments function to calculate workable
convolutions by adjusting PAD size as needed for FP and errors.
Add --conv-kernel build_tests option to allow different sized
convolution kernels
Improve coverage with batch size, specific shapes and kernels
of 7x7 and 9x9

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I59bb737f398f4363cc606b24fea7812b2059bc01

TatWai Chong authored Mar 21, 2024 and Eric Kunze committed Mar 28, 2024

Set QMin and QMax based on the value of attribute `output_unsigned`.

Change-Id: I7f21f3edd7311295285fb3988b3c800de114777a
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

- Add variable_name and variable_file to the desc.json file
  for writing variable tensors to numpy
- Add the key of num_variables in the unit test declaration to
  specify the number of variable tensors in the graph

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I1109f66ffed52e49dbb14f4a8aca64baa2bea622

Jeremy Johnson authored Mar 21, 2024 and Eric Kunze committed Mar 26, 2024

Make sure the magnitude bias check is not positively biased
Update unit tests

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I00a9470b5e3233ad65360400ed312b0a354130f1

Jeremy Johnson authored Mar 25, 2024 and Eric Kunze committed Mar 25, 2024

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I749b1b9fbfa32954d8748a860280c86087c08e7f

Jerry-Ge authored Mar 21, 2024 and Eric Kunze committed Mar 25, 2024

- The framework test generation script is broken for some tests
  because TF2.16 has an issue with Keras 3.0
- Enforce the script to use Keras 2.0 and we also need to run
  pip install -U tf_keras together with this change

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I519aa89c5d5bacf659a809d9eda456bd83b33527

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Iaeed119ff81c8d1363dd26be7468bb53f9d70eae

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ideeb67ec4b33b9c6922d6765f4b0eb5ca69bdf89

- The desc.json file for variable examples are missing
  the variable_name and variable_file fields
- Add those missing fields to silence the error

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ia391d308849efd4111aff98500775ad0f3e741ac

Fix CONV2D WrongOutputType FP32 & Pad/Stride/DilationSmallerZero issues.
Fix PAD WrongInputType.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I57fc57c43e63685e05bf5e3d562c3167411fd57b