Iliyan Georgiev authored Jun 10, 2025 and Iliyan Georgiev committed Jun 24, 2025

- Update README with description on semantics
- Update Usage section with new additions and semantics

Change-Id: I44907b00270643326cb92ea140d41a40b72bb86e
Signed-off-by: Iliyan Georgiev <iliyan.georgiev@arm.com>

Philip Wilkinson authored Jun 19, 2025 and Philip742 committed Jun 23, 2025

Fixes test build on macOS

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: I7a2d818c708f4d2d21f6d977a45eb5e08a62d4e0

Allow unsigned numpy arrays for the RESCALE op.
Also replace hard-coded conversion from
float8_e5m2 to uint8.

Signed-off-by: Madeleine Dunn <madeleine.dunn@arm.com>
Change-Id: I20f7a096c86372959ec54d194acaf765f9931821

Add instructions for building with MSVC
Also update to match changes for all platforms:
Remove reference to git submodules
Remove separate flatbuffers build step

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: I7dba94a14c64290ee5f03ce3cf58e7887adc2766

Change-Id: I3bdef8390b5080dbfe94a84026cd1902408eb524
Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>

- Previously, SYSTEM was incorrectly applied to normal includes as well
- Adjusted CMake to restrict SYSTEM usage to external dependencies (e.g., FlatBuffers)
- Ensures project headers remain subject to warning checks and fixed all
  the warnings

Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>
Change-Id: I16a5c0e6b9ab4db5e623516210dbf9bddaea7be0

We were adding an include target from a deprecated directory which can
cause some systems that still have old files there to compile
incorrectly.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I5122720c651033ecc4628769d8e68507c2a10604

Signed-off-by: Udaya Ranga <udaya.ranga@arm.com>
Change-Id: Iba33ee9443283483a36a8b665dd714a803366bc9
(cherry picked from commit 20ad301d)

float16, bfloat16, fp8_e4m3 and fp8_e5m2 are now covered by the
serialize -> deserialize unit tests.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I0a84490586a7e6e4b8190e76164f9d2ff23fd5d0

FetchContent in CMakeLists.txt downloads v23.5.26 of flatbuffers,
but the README was referring to a different version.

Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: I595bdd061a08715a73b44f41553f9246826a2e80

Eirene Vlassi Pandi authored May 25, 2025 and Ian Tayler Lessa committed Jun 02, 2025

Signed-off-by: Eirene Vlassi Pandi <eirene.vlassipandi@arm.com>
Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I70b007a51ebf437e0b73f232567641fd13635476

This fixes addConst for shapes for lazy-data-gen mode where they
must always be embedded in the graph.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ic6b94e487b3ee5e2de88587fb2f49ebc66a54f01

This adds TosaShape to tosa flatbuffer schema, to serialize
values of tosa.shape type
and add "shapes" to the TosaBasicBlock to hold an array of
these tosa shapes.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Ia84c7f90428d6cfe45b271ea380ee14f4a8a677a

GCC 9.4 throws relocation errors when linking with -pie unless all objects are compiled with -fpie.
To resolve this, replaced -pie with -fpie to ensure consistent position-independent code generation
during both compilation and linking.

Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>
Change-Id: Idc4402b904e9c66f2b43771eb0140ed049b1c0f5

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I84422b180325d587f55273cbf74b3f06cbc8ad98

Previously our generated json files were the more flexible
human-readable format that flatbuffers generates by default.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: Id6184fbc4294f82a34be4c07daafadc3b61d8544

Adds properties "is_unranked", "is_variable" and "variable_name" to
TosaSerializerTensor in tosa_serializer.py. these properties have
been missing from the python api.

Also added tests in tosa_single_tensor.py for (1) unranked and (2)
variable intermediate tensors

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Ie9d5da0e26eb401e7663a8fa91d563e1d5786855

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Ied65eaaa3ccbe929afdce0263c5ba6112ca30761

Philip742 authored May 09, 2025 and Philip742 committed May 13, 2025

Optional using cmake -DWARNINGS_AS_ERRORS=ON

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: Ibd94c90e15bbd1b362e489aff51c6243fb8f1578

This adds TosaSerializationOpInfo<Op_name> that specify, for each tosa operator Op_name,
the serialization attribute type to use, and the input types (tensor/shape/tensor_list)
for the operator

unpdated unit tests to construct unit tests that use the appropriate
attribute and number of inputs for each operator

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Ic1707f60f9f25248d361b02ea142bc13699c5781

This commit aims to fix the MacOS build of the
serialization library by, more generally, ensuring
unsupported linker flags are not supplied to the
selected linker.

Note: The "check_linker_flag" utility is used by
this change which requires cmake >= 3.18,
therefore, the minimum supported cmake version in
this project has been bumped from 3.13.4 to 3.18.

Signed-off-by: Luke Hutton <luke.hutton@arm.com>
Change-Id: I8434c1fb7237e011fa3df720de79e2053b8c9fbb

Eliminate type conversion warning
Implementation type is not guaranteed by C++ standard

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: Iaa6e9097f9d414baf8aa880ad0d15c7379314ce8

Change-Id: Idc02d2c422cefc122a57a2344fc8468ae13375a8
Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>

- Updated save_npy to ensure that the array's dtype matches
the expected storage type.
- Revised load_npy to verify and convert the loaded arrays
dtype to the expected internal type based on the provided TOSA DType.
- Added a new STORAGE_MAP mapping TOSA DType values to their
corresponding internal mldtypes and NumPy storage types.
- Introduced get_tosa_dtype_mapping() to expose a user-friendly
mapping of TOSA dtypes to internal and storage types.

Signed-off-by: Eirene Vlassi Pandi <eirene.vlassipandi@arm.com>
Change-Id: I6be1446a01e2a9f0861766d1c0488627042eadce

-fcf-protection=full is not compatible with aarch64 targets and
-D_FORTIFY_SOURCE=3 was introduced in GCC 12, while we need to support
older versions too.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I050c5d5d924b655c818a358f043c6a9679a95d6b

* Refactored std::memcpy to std::copy_n
* snprintf to ostringstream

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I1a1250bb067668ab757356654e9535f9c9823dad

Without it, make fails to redownload flatbuffers when changing between
branches during development. It can only be set if the version of cmake
is sufficiently high.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: I686d9995ca0b387867a48d871a2f6eca62422952

v1.0 backport conflicts:
      python/serializer/tosa_serializer.py

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: I610b641192c0119fd58286d5b0a01e8618b9b59c

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Idcb833e261d7507db96b6009a7a863aeca9431e2

Use CMake's FetchContent feature instead, the same as is already done
for GoogleTest.

This change necessitates copying flatc and reflection.fbs as part of the build process to a known
location in the source directory, since the flatbuffer sources are no longer directly in the source
tree. CMake targets have been added to do this. regenerate_headers.sh is updated accordingly.

Signed-off-by: Michael Platings <michael.platings@arm.com>
Change-Id: Idc08297a3e8dac3da978e5d537b1e6d04279a070

Signed-off-by: Udaya Ranga <udaya.ranga@arm.com>
Change-Id: Idc0e2092bdfea7773fcae61329d12e5c6a6483c6
(cherry picked from commit b68a5918)

remove UINT8 and UINT16 from DType in tosa.fbs schema

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Idcb285326748f37ed36ca116d8db5215d8c4a399

This removes Yield and YieldAttribute from tosa.fbs schema

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I406ea1bbe34758aa69f063e212014dc46f86b459

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: I97c99431c38b884f367fb7ec9e0a5ffd3f049055

fopen() is deprecated on Windows

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: Ia9825558ed241c00111638274a416d418f5c18d0

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: I9d469f37994d433461259bd2e9ccd630b2e3fc13

Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>
Change-Id: I019685dd639b152e2acdff89a46662317cbc8587

- Introduced `CXX_FLAGS` and `LINKER_FLAGS` for Hardened compiler and linker options.
- Added `apply_flags()` function to enforce compiler and linker flags per target.
- Marked third-party includes (`half/include`) as `SYSTEM PUBLIC` to suppress warnings.

Signed-off-by: Yuvaraj Venkatesh <yuvaraj.venkatesh@arm.com>
Change-Id: I1b1e06f9bdd7c10d87fba31d6f25d9fa13f072be

- Add support for unsigned floats
- Other improvements to cfloat.h
- Add cfixed template for fixed point types
- Reorganise cmicroscaling with floating point types in cfloat.h and
  fixed point types in cfixed.h
- Add missing specialisations for numeric_limits

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: Ia471bda84f1784ccf49277f93df2c2e712af5b36

Calling from pytests

Change-Id: I86eb0ac5f52ee3317e5fb6b5c32f08f11b6f945c
Signed-off-by: Philip Wilkinson <philip.wilkinson@arm.com>