Change-Id: Ia2c8507bc2559738e8011056b7526f7b3f2e16a6
Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>

To support BF16 on Windows correctly, add support for floating
point fixed data as well as integer.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Iad8f16ccff2df56df3f0f67e41e2fba5ecd149e9

Enable long path name support by including manifest file
when building dlls and exes on Windows.

Update tosa_verif_run_tests:
* Use replace instead of rename when moving results files, to mimic
behaviour of Linux "mv" on Windows.
* Also rework the verify results loop to rename the result files first
and then verify them.
* Remove expected_result_file support as not allowed in desc.json.

Change-Id: I9973f22a62371dafc6de030d886349faf18f276b
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

This now correctly computes the ULP bound relative to the maximum
absolute input, while previously we were computing it relative to the
reference output.

Extend the unit test coverage for max resize verification to catch
regressions and other bugs in bfloat16 and float16

Refactor a calcAbsErrorBound function matching the spec to use across
verification code.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I04b08d5d160258c560dbfde3b70247d76bf3f225

RELATIVE allows error relative to some fixed 'max' value, i.e. fixed
error for all outputs in an operation.

Renaming it to MAX_RELATIVE allows us to add a second mode,
OUTPUT_RELATIVE, which will allow error relative to each output in an
operator.

The OUTPUT_RELATIVE mode will be coming as a separate patch.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: Ia70549c19ec781b1172cb1a2a7fd0da581489ca5

Philip742 authored Jun 25, 2025 and Jeremy Johnson committed Jun 26, 2025

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: I57cba4cdcf31e923cf5ef33277a6fb0776920597

Fix for reading and correctly checking the test requirements
versus the chosen profiles/extensions.
Add tests for checking all combinations.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I8991cdacb34701c156a69c58aa549d3cfec73802

Philip742 authored Jun 19, 2025 and Jeremy Johnson committed Jun 23, 2025

Note does not cover test commands

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: Ib1cb340290cf5c663e00185aaaaad68388bb4477

Ian Tayler Lessa authored Jun 13, 2025 and Peng Sun committed Jun 19, 2025

Previously we were causing an internal error in allocation instead of
signlaling an ERROR in the graph.
Also fixes the shape given to the Eigen tensor used to represent shape_t
values of rank 0.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Signed-off-by: Peng Sun <peng.sun@arm.com>
Change-Id: I682fe0360b002b04af7b08e590d4f1acb4850d5c

Peng Sun authored Jun 12, 2025 and Jeremy Johnson committed Jun 19, 2025

- Introduced a new typedef: registration_callback_v2_t, which uses const char*
  instead of std::string for domain and operator names.
- Updated MasterRegistry::register_function to include a deprecated overload that forwards
  std::string parameters to the new const char* version.
- Updated loadSharedLibs() to support both v2 and legacy v1 custom operator libraries.
  It attempts to resolve the v2 interface first, and falls back to v1 if necessary.

Change-Id: I9c0d7b768c1b9be5daeaf9617c6fd46000a32758
Signed-off-by: Peng Sun <peng.sun@arm.com>

Use distrubution classes to make random number generation behave
the same on Windows and Linux
Added generate unit test to check if values match on a given platform

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ibf5a452e12326cf4ca5194c7ab83a9e1bdb1ee66

Philip742 authored Apr 09, 2025 and Jeremy Johnson committed Jun 18, 2025

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: Ia29ed6c2f0cc41061c58997de1f5487c900196e4

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: I3d54dfa61186a00aaee4d548041dbdac1d509788

Jerry Zhao authored Jun 09, 2025 and Jeremy Johnson committed Jun 16, 2025

- Implement ewise unary operator tests covering floating-point edge cases
- Covers ABS, FLOOR and CEIL
- Adjust ABS operator implementation to correctly handle sign of zero
  inputs.
- Register new elementwise unary op test file (ewise_unary_tests.cpp) in CMakeLists.

Signed-off-by: Jerry Zhao <Jerry.Zhao@arm.com>
Signed-off-by: Ian Tayler Lessa <Ian.TaylerLessa@arm.com>
Change-Id: I03a74877afd195125dcca03dce6cd0903c8a142e

- Apply element-wise `max(abs(x), normal_min)` to handle subnormal
values and ensure numerical stability in bounds mode.

- Updated ops: CONV2D, CONV3D, DEPTHWISE_CONV2D, MATMUL,
TRANSPOSE_CONV2D, FFT2D, RFFT2D, AVG_POOL2D

Co-authored-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Signed-off-by: Peng Sun <peng.sun@arm.com>
Change-Id: I5a2c3a44be647c5acb08d67e045af8250f9380bc

* Paths unsupported in load library for python 3.9
* RESCALE min/max calculations not promoted to int64
* Utils product() calculation also not promoted to large enough storage
* Fixed color printing output
* Made conformance generator build ops in sorted order for consistence
* Updated default model file locations and tool help messages
* Fixed TransposePermsOutputShapeMismatch ERROR_IF

Change-Id: I18cfa49e7016ee5a5453b5669c39e587175a15f5
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Yuvaraj Venkatesh authored Jun 09, 2025 and Jeremy Johnson committed Jun 11, 2025

- Previously, SYSTEM was incorrectly applied to normal includes as well
- Adjusted CMake to restrict SYSTEM usage to external dependencies (e.g., FlatBuffers)

Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>
Change-Id: If484b7fb8a708d571b47fb1f17c456d3e6e9849f

Only produce any CPP files in lazy data gen mode.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I32e25eb078722e16e2d2d3c2b5f7eb84290f695d

Eirene Vlassi Pandi authored Apr 29, 2025 and Jeremy Johnson committed Jun 09, 2025

- Replace all instances of half_float::half with ct::float16
- Remove some special code in fpTrunc for handling bfloat16 as cfloat.h
  can do that special handling now
- Update serialization_lib submodule
- Update unit tests to match new serialization_lib version

Signed-off-by: Eirene Vlassi Pandi <eirene.vlassipandi@arm.com>
Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I6374f2712e943a756322940eea753b7c2f57f943

Due to incorrect tag generation for dynamic tests causing
tags to be corrupted on other tests.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I00188d7a06f62c41e7fedba24d151dec6479522d

udaya-ranga authored May 21, 2025 and udaya-ranga committed Jun 04, 2025

Updated serialization_lib to support OpLocation

Signed-off-by: Udaya Ranga <udaya.ranga@arm.com>
Change-Id: I0f958b57e279e7fbd2684f932ddb67185fb989ad

Use a base bound value of 2 instead of 1 for SIN operations.

Refactor compliance meta data function in test generator to be
less operator specific for ABS_ERROR compliance

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I90182ce20387d5dda1d0e148f05a2edf830648fa

Adds a lower bound of 0.5 ulp relative to 1.0 to allow
implementations a larger error for input values close to 1.

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Id97f5c9802d7896bf10db6fef475b182ffed5c21

Deeptanshu Sekhri authored Apr 22, 2025 and Jeremy Johnson committed Jun 02, 2025

- Use find_package to link Python headers and libs for MSVC
- Replace VLA with std::vector and copy buffer to py::array_t for safe memory handling
- Update setup.py to detect and copy .so or .pyd extensions based on platform

Signed-off-by: Deeptanshu Sekhri <deeptanshu.sekhri@arm.com>
Change-Id: I64e8e85eb3664201cd59b277cc605983bc5adf1c

Deeptanshu Sekhri authored Apr 15, 2025 and Jeremy Johnson committed Jun 02, 2025

Improved clarity and structure for the ModelRunner
Python bindings section. Added build instructions with usage example.

Signed-off-by: Deeptanshu Sekhri <deeptanshu.sekhri@arm.com>
Change-Id: I8176f83cc8a92260dea9b4cab1b5d5c6fa7ec0f0

Yuvaraj Venkatesh authored May 27, 2025 and udaya-ranga committed May 30, 2025

CID: 3055367, Resource leak

Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>
Change-Id: Ibfcd4146aadc930e3593bcace119543af70a1e43

This patch changes to use TosaSerializationShape in
serialization_lib.
Lazy Data Generation mode for tests now embeds CONST_SHAPES
in the graph.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I754a6085b83bff04f0468e81c3d72f1221dcbde2

Allow error bounds ranges, to support CAST ULP range of 1.0 to 0.5
Add unit tests for normal ULP with/without lower setting

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I5a8eefa39999911b61c8e04f2cde64921c53c69e

Justin Ngo authored May 16, 2025 and Eric Kunze committed May 19, 2025

Unit test test suite for PyTorch utilizing FxImporter to lower PyTorch
graphs to Torch-MLIR then to TOSA IR. Current infrastructure is mostly
based on the existing TF/TFL frameworks test suite.

This is the initial work for the Torch unit test suite. The end goal
is to add more Torch unit tests for a more robust test suite.

Signed-off-by: Justin Ngo <justin.ngo@arm.com>
Change-Id: I829ddf708556488166bc2bfdd4b52a1cfb4fc34d

These warnings were not flagged by Clang but triggered by the GCC compiler.

GCC 9.4 throws relocation errors when linking with -pie unless all objects are compiled with -fpie.
To resolve this, replaced -pie with -fpie to ensure consistent position-independent code generation
during both compilation and linking.

Change-Id: Iba7ce1d0e84d8040dafe65c41fd553c342507cbc
Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>

- update the version of tools and packages
- add high-level featue description
- create verif/README.md to introduce detailed CTS information

Change-Id: Id80810a700ddf8040954857813cce7464700f45b
Signed-off-by: TatWai Chong <tatwai.chong@arm.com>

Enable build tests to run in multi-processing mode
Refactor main loop of tosa_verify_conformance_generator
Improve logging for multiprocessing jobs
Change to use concurrent.futures from multiprocessing

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I3b556a2d240acce4ff0e9faa8e815eba95489953

- Updated dumpTensor to use std::ostringstream instead of dynamic format strings
  with fprintf.
- Parsed g_func_config.fp_format (e.g., "0.5") into width and precision using istringstream.
- Applied std::fixed, std::setw, and std::setprecision to format the floating-point
  value safely and consistently.
- Fixed few other openssf warnings.
- Refactor dumpTensor function call.

Change-Id: I8ccbab5ae4afa38803fc053ba5f423840aba50ce
Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>

To include:
* Allow adding placeholders without data
* Set warnings as errors
* Generate strict json by default when serializing
* Avoid supplying unsupported linker flags
* Use portable type with random engine

Change-Id: I5c04f85dc6608fb955bd84f5f7c5a1a3a7ef57b6
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: I135a43eb81592ac57f9f137117d003776b256775

Luke Hutton authored May 06, 2025 and udaya-ranga committed May 08, 2025

This target was incorrectly using the `-z nodlopen`
linker option.

Change-Id: Ie111c7ac968b707eb1d23aa81117ac1895209314
Signed-off-by: Luke Hutton <luke.hutton@arm.com>

Luke Hutton authored May 02, 2025 and udaya-ranga committed May 08, 2025

This commit aims to fix the MacOS build of the
reference model by, more generally, ensuring
unsupported linker flags are not supplied to the
selected linker.

Note: The "check_linker_flag" utility is used by
this change which requires cmake >= 3.18,
therefore, the minimum supported cmake version in
this project has been bumped from 3.16 to 3.18.

Change-Id: I17b1c176d328088554c231539ddfe3b057914547
Signed-off-by: Luke Hutton <luke.hutton@arm.com>

This commit aims to reduce duplication by moving
constants that are commonly defined across the
code-base into a conventient 'config.h' header,
that can be included wherever needed.

Change-Id: Ibcf6979c37e0e664c9d9604116fa41d7619e5e43
Signed-off-by: Luke Hutton <luke.hutton@arm.com>

Previously we were drifting between LP64’s default (long) and a
hand-exported int64_t, which led to ABI/template mismatches
(“Eigen::Index == long” vs “int64_t”). This commit changes eigen's
default index type to int64_t to align with the reference models's
usage of eigen.

Change-Id: If88a6b137011c942044b6516e5a030e2db4bb92f
Signed-off-by: Luke Hutton <luke.hutton@arm.com>

Signed-off-by: Eirene Vlassi Pandi <eirene.vlassipandi@arm.com>
Change-Id: I6b5f1003f657326a33a0ee743c1bdc2e7cf4b89a