Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I8645382983c257e5102982d487283560088e2d2a

Reuse the name deduced from the test run in results.
Also move most string formatting to f strings.
Move path handling to pathlib from os.path

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I44c7786d4b7af44306e218ff49608df35d4521a7

Jeremy Johnson authored Jul 25, 2023 and Eric Kunze committed Jul 31, 2023

* Update Flatbuffers version
* Allows consts to be saved as inputs

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ibb9e38d381f8229bfca65b559e35c9ded889c384

Jiacheng Liang authored Jul 27, 2023 and Eric Kunze committed Jul 31, 2023

Signed-off-by: Jiacheng Liang <jiacheng.liang@arm.com>
Change-Id: I473adc1525319b5574ee0e36d10a530277d9215d

- The previous ref_model was allocating the memory for all tensors in
the graph upfront which is unnecessary and wasteful.
- This patch changes to only allocate initial input tensors on the entry
point using the allocateInputTensor() function.
- The output tensors are ensured to have been allocated before executing
a node. The output tenosrs are the inputs for the next node.
- When a node's evaluation is finished, its input tensors will be freed
if they will no longer be used by anyone else.

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ibb3e8c9e6344f6cd9eb20532a03b2097b93247f9

Name of the test can now come from the json description
rather than inferred from the directory. Old method remains to
keep functionality with older tests

Change-Id: I79f872103ae6a101b5cc799af91c933839f28dfb

Jeremy Johnson authored Jun 07, 2023 and Eric Kunze committed Jul 26, 2023

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: If30b329905aad9e520e4a9a3ac1dffccd37bb0e9

- Also added run clang-format to pre-commit runs

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I4e59ac0afbaa30dce0773aa63d92a1a3b119e2f3

Temporarily disable the json to numpy pytest

Otherwise will load as the wrong dtype
Also update the flatbuffer module version to match
tosa_mlir_translator

Change-Id: I40999f631adb1b230bc8a8b891e0955dd67371f0
Signed-off-by: Eric Kunze <eric.kunze@arm.com>

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I7015de6989940a535a12b737432e5efa8304d9a3

Also move a large amount of redundant code to a macro

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Ib1dcb2ce15e56076e444a4739c4d1292389c4a78

Signed-off-by: Jiacheng Liang <jiacheng.liang@arm.com>
Change-Id: Ie31041cbcd01f6290be06eabfe5c619123ae989f

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Ib954db4f8f2fd5008e95d5651a6e84a8f5b7161d

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I1f2cfbc90ecb81eb072d3d28bebd13e69f47e939

Won Jong Jeon authored Jun 29, 2023 and Eric Kunze committed Jul 06, 2023

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I6fba6907cef0616c18dc461dbb92d2aceb582f6c

Jerry-Ge authored Jul 05, 2023 and Eric Kunze committed Jul 06, 2023

With the following patch merged, the tosa serialization_lib is
able to read u/int8, u/int16 in their native dtypes:
https://review.mlplatform.org/c/tosa/serialization_lib/+/9871



Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I5e63fb70b055cc5ee33e7dc26237eef9bedeac30

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Iff31b33b818a181371904915d5477a169513aa2e

Would cause unresolved symbols to appear when building in
release mode.
There are a couple of minor compiler warning fixes as well.

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I0f7e9a8771442a6e3c848edfe034ef534d0d8ca7

Won Jong Jeon authored Jun 10, 2023 and Eric Kunze committed Jun 29, 2023

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Ib42b867287b83a183a0d0fb1f1eb29974f58fae4

Grant Watson authored Jun 23, 2023 and Eric Kunze committed Jun 26, 2023

Signed-off-by: Grant Watson <grant.watson@arm.com>
Change-Id: I1296f968baca335ea88691bc973e2d01b2aa2c5b

This patch adds BoradcastTo Op to the tf tests.
Did not add tflite testing because the tf.lite.TFLiteConverter converts
tf.broadcast-to to tfl.mul by 1.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Icd372e619c318121c19eca87d5716bcd5fbbbb23

Signed-off-by: Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: I45287af6b33cf07383250dc962a97728e65697a7

shape_list is global while the custom_shape is only applicable for a
single operator, need to make a copy for the whole shape_list when
dealing with custom_shapes

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I2c5b87cb6fcaa153b0ccfe5827bae814b9cfe2b9

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I7460ad9eed3ed5c7cec6e855a0303753ed28eb1c

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ie45cc27433f5dbce3fadc90014dc5cc8e36a9950

Adds utility functions that enable compliance verification of TOSA MI
operators; as per section 1.8.2 in the TOSA specification.

Signed-off-by: Georgios Pinitas <georgios.pinitas@arm.com>
Change-Id: I0cced0ff8875ac8d78b1943211438713d1c51b88

- Allows axis attributes to be treated differently to other arguments in attribute.def

Signed-off-by: Grant Watson <grant.watson@arm.com>
Change-Id: I1be2595c24bf22e5391a2911a5283391d310df37

Jerry-Ge authored May 23, 2023 and Eric Kunze committed Jun 02, 2023

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ia29c73cb5d0a7f91914e2a94ca52d06f375722e9

Jiacheng Liang authored May 17, 2023 and Eric Kunze committed Jun 02, 2023

Comparison operators produce boolean outputs, which need to be written into client data

Allow subgraph traverser to use main block to look for tensors when serialization handler is missing

Signed-off-by: Jiacheng Liang <jiacheng.liang@arm.com>
Change-Id: I6f9af470185541fa6466b3f7786c48f1555fa6f6

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I175ef0acc6a6633c3e351b935a04db16de1bfbd5

Update serialization library submodule

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I1d6e2700ac55f429de742931627b07c9a4a46f14

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I82c356681e66bf08e2c106358deb4acbc64a67c8

Tai Ly authored May 12, 2023 and Eric Kunze committed May 18, 2023

This adds a second run of reference model under precise_mode
when test_desc.json contains a "compliance" dictionary which
contains a "mode" entry with value "dot product".

In this second run, abs_mode will be set to true, which causes:

1. evaluation will take absolute values of inputs for these operators:
	conv2d, conv3d, depthwise_conv2d, fully_connected,
	matmul, transpose_conv2d, fft2d, rfft2d
	reduce_sum, avg_pool2d
2. output files will have prefix "bounds_" prepended to them

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I7070ecc7ead2d2ea3375c44663d653c6772b88e0

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Change-Id: I0ef7607f4266296a1204c5cccdb5be36f345b5ba

Change-Id: I81097ae263a64ee8e35b8bd798598671ac089c3f
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Iad035b31d5e5e83040068e6311501490765bfff7

This adds --precise_mode=1 option to tosa_referece_model,
which will cause reference model to convert all floating point tensors
to FP64 tensors and compute all operators accordingly.

Also adds optional -p arguments to test runners tosa_verif_run_tests.py
and tosa_verif_framework_compiler_runner.py to run tests in precise mode

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I156055216ad61710096497a8fa1a653be2a602a3

Operators updated: AVG_POOL2D, MAX_POOL2D, CONV2D, CONV3D,
 DEPTHWISE_CONV2D & TRANSPOSE_CONV2D
tosa_verif_build_tests argument --level-8k-sizes used to
allow kernel/stride maximum boundary testing

Fixed bugs in height/width validator function meaning some
esixting avg_pool2d float tests need regening.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I7aeab82d3bd3c49d02d54708f2c9d995cd3cf2df

Add support for producing scaling 64 tests in RESIZE and make sure
default tests are not generated with scaling greater than 64.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3e99cde7e6bec6ea7854a139c6fc2ed151af5b1e

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I6deb355998ce88714b41eedc8170acbd7875f519