- added TosaSerializationRegion
 - aligned API's in each class with current source code
 - removed reference to include/operator.def (do not exist)
 - removed reference to quantization information (no long applies)

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I33e83284e42a15a508f39ed0ebeef6e4db479568

Victor Anaehobi authored Sep 04, 2024 and Eric Kunze committed Sep 10, 2024

Change-Id: Iffcef7f0fe313fdf24559a3e09631431f7cec15c

Update the license header to use Apache V2.0

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I083e79002dc36bc6cbdcd501a049be31a63f6937

- In the previous implementation, we're receiving warnings when the
  input val is negative. That warning now becomes an ERROR starting from
numpy 2.0
- Updated the cast usage to achive the old behavior (cast overflows) as
  suggested by the warning.

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I21cb8a0c7dbac898ff5b06b9ead62070a9edd2b3

Ian Tayler Lessa authored Aug 08, 2024 and Eric Kunze committed Aug 12, 2024

Previously we were incorrectly serialising fp8e5m2 tensors into the
flatbuffers. Now we handle serialisation properly.

The code still assumes the input array to be of dtype uint8. A future
patch should allow fp8e5m2 tensors to be passed in native form, with the
library itself handling conversions to uint8 if necessary.

Signed-off-by: Ian Tayler Lessa <ian.taylerlessa@arm.com>
Change-Id: Ib4772a7ae01d5ce5e85f426dec531a5f4778e2f0

This patch deprecates TableAttribute in tosa.fbs schema and removes it
from attribute.def as well

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: Ifc52b6d24bd1c4539f32e57da792dc3a0ffda593

This patch deprecates following operators:
  DIM
  CONCAT_SHAPE
  ADD_SHAPE
  SUB_SHAPE
  MUL_SHAPE
  DIV_SHAPE

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I1cfda7c11f629d2dd0b06d578bde0c1cf93be8e1

Won Jong Jeon authored Aug 01, 2024 and Eric Kunze committed Aug 02, 2024

- Neaten NaN handling and fix some issues with E8M0
- Fix downshifting new significands
- Add serialisation support for microscaling types

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I1b27ff5d7262cbeac5871a86d53bfa6a6691f147

Removes FullyConnected Operator by deprecating related enum and
attributes

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I83e1e3747d3f2ccb3fb181c3ce23468a201f9411

Add support for Ties To Odd, Ties Away, Round To Zero, Round To Positive
Infinity and Round To Negative Infinity rounding modes. Default
behaviour remains Ties To Even.

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I72b34073284dc338794612f4a3ddadd4363fcf4d

* Adds typedefs for commonly used floating point types.
* Adds a new header containing typedefs and implementations of Open
  Compute Microscaling formats.

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I0ad0e3c71e91d9e3af3b20d3a580b2ac52cdebec

Jerry-Ge authored Jul 29, 2024 and Eric Kunze committed Jul 30, 2024

- Rewrites the subnormal and rounding code to fix a bug which resulted in
very small inputs being transformed into much larger destination values.
- Adds an explicit flush-to-zero control for the cast operator.

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Ia165d026f7764189c4f1704b7407493f55118597

- Jira ticket: MLTOSA-813
- Update CMakeLists.txt to make it compatible with tools like
  FetchContent.

Signed-off-by: Justin Ngo <justin.ngo@arm.com>
Change-Id: I22f6bf4df3f3860115fd77b1cc66b2d71bcef2ad

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Id3e6a204da7a30bf29a3493ce05766f0e0f7e96b

Signed-off-by: Kaushik Varadharajan <kaushik.varadharajan@arm.com>
Change-Id: Ic640f7d48720ce9403790588e46333c028960756

Tests run with `pytest` command in repository's root directory.

Signed-off-by: Kaushik Varadharajan <kaushik.varadharajan@arm.com>
Change-Id: I9d8a13b233ffafc9119ef503d46f7808461a194f

- Implement convert_schema_to_header.py to convert tosa schema file to
  tosa_schema.h
- Enable loading tosa schema directly from a string from the header file

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Iafcccf2a03fd8968acd2d12c0081e85c10a91ef4

Tests can be run with the `pytest` command from the repository's
root directory.

Signed-off-by: Kaushik Varadharajan <kaushik.varadharajan@arm.com>
Change-Id: Id1ead34da927d4455964cb211e4fc0c6294e4bdf

Tests can be run with the "ctest" command in the /build directory after
building.

Signed-off-by: Kaushik Varadharajan <kaushik.varadharajan@arm.com>
Change-Id: Ie2faf74471f8497f10121b70ee81d8cc739f56c2

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: Icb20951a3310935abcd1ebce512eac1ef81c9f42

Signed-off-by: Kaushik Varadharajan <kaushik.varadharajan@arm.com>
Change-Id: I1ee130d4028d2d61c3ff44e36b5c923891c11717

Adding a framework for unit testing. Tests are run with the "ctest"
command in the /build directory after building.

Signed-off-by: Kaushik Varadharajan <kaushik.varadharajan@arm.com>
Change-Id: Ibdc5a90de6284d2118124dab561b5ba0183cf32c

Tai Ly authored May 16, 2024 and Jerry-Ge committed May 28, 2024

Signed-off-by: Jerry <jerry.ge@arm.com>
Change-Id: I3f1f9c03ab1ad39ca1d7483160217bf3b55badac

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I8b6f28cfc7fdf395d5f82c07eca53cfd598fe550

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Idd667410cbb66358cd422cb0be22564ffbf8628a

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I52f6fea3e8b4cd5ff0886ccfa12396a680558670

Won Jong Jeon authored Apr 23, 2024 and Won Jong Jeon committed May 04, 2024

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: Ib2ee84ee729125c10870a22f4732811eaa387a3f

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I0d2075f90988d4fd1139a11b5c154bdd600bb2cd

Tai Ly authored Apr 24, 2024 and Eric Kunze committed Apr 26, 2024

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I9ab0e8ab4e3c37f1dd135b57661b25e18a5df5cb

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: I9d1fcfb6fd70548b8c1dce8ea768b631bf87eb39

Signed-off-by: Eric Kunze <eric.kunze@arm.com>
Change-Id: Icbc231ada16eeba38452c2c7cec8e66cf43d3c0e

Signed-off-by: Won Jeon <won.jeon@arm.com>
Change-Id: I786aca0a2f137cebd446a3a71c8d6fe186286957

Change-Id: I1a52c596ea225355fe505f783d875a01023ff63e

This patch removes the "type" field from PadAttribute and ClampAttribute
because they are unused and unneeded.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I378291b340ecee86824f25b3887aa4511207db23

Adds type to PadAttribute and ClampAttribute so their pad_const
and max_val/min_val can be deserialized according to type

Adds conversion functions of U8 arrays to/from BF16/FP8 values
Also, refactor and expose TosaSerializer.convertDataToUint8Vec
for converting dtype/data to uint8 list for serialization
And modify convertDataToUint8Vec to serialize bf16 values into
2 bytes each, and serialize fp8 values into single bytes each.

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I05659e8187c76d359f1cc9f71c8c23cafd0e877f

Numpy rank 0 files correctly written as shape () instead of (1)
Constant tensors of rank 0 now have data written out

Signed-off-by: Jeremy Johnson <jeremy.johnson@arm.com>
Change-Id: Ie4bad8f798674cdb0484955e9db684f7f4100145

This adds acc_type to ConvAttribute and TransposeConvAttribute

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I73bab71b2eb90f6451fadee21d5bed1811ecbfd7

Tai Ly authored Mar 08, 2024 and Eric Kunze committed Mar 11, 2024

This patch implements following changes to attribute fields:
- PadAttribute: delete padding field, replace pad_const_int
	and pad_const_fp fields by pad_const, a field of
	ubyte array
- ClampAttribute: replace min_int, max_int, min_fp and max_fp
	fields by min_val and max_val, fields of ubyte arrays
- RescaleAttribute: delete multiplier and shift fields

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I5b075d29677cffca9ff2292708141d48410e7e72

- If we save FP16 in FP32 containers, it will change byte representation
- which causes wrong values after deserialization
- Update the code to store F16 values in F16 containers

Signed-off-by: Jerry Ge <jerry.ge@arm.com>
Change-Id: I2ddea67471997c596980faea1419422d96bad60d

removed attributes for Reshape, Slice and Tile Ops
renamed field accum_dtype to acc_type,
renamed then_branch/else_branch to then_graph/else_graph
renamed cond_branch/body_branch to cond_graph/body_graph

Signed-off-by: Tai Ly <tai.ly@arm.com>
Change-Id: I2001f19519987d9e64c18b1f11762f9d3b9be4ec