Adding BatchMatMul operator to the internal resolver in generic
inference_runner.

Change-Id: I1e1248ebd570ad508e2151a42b3e38349c0249f2
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

The tests expected all the data types across input and output tensors
to be same. These were also limited to 8-bit signed/unsigned values.
This patch make it possible to have the test vectors be of different
types while being able to get a generic (void) pointer to arrays from
the generated getter functions.

Change-Id: Id6d8b13803cd2f2ed66fee52eaed86af194b995d
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

* Use 'u55' as the default NPU ID for tflite-micro
  if other NPU values don't match

Change-Id: I6826acf7f33379e8c1edc591cd6d621234a87099
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

* Moving some of the complexity from the
  setup script to a separate file

Change-Id: I6fcbbb4d804ce00593c5fde1c062be332056e6e4
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

Hugues Kamba Mpiana authored Jun 12, 2024 and Alex Tawse committed Jun 14, 2024

* Adding --downloads-dir to set_up_default_resources.py.
  This is complementary to the RESOURCES_PATH
  CMake option in the main project.
* Some tidying and refactoring to agree with
  Pylint rules.

Change-Id: Id395130ea0b71aa0670163294a2de33da227718f
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

* The previous version of Jinja2 was flagged as vulnerable,
  so this change bumps the version.
  https://github.com/advisories/GHSA-h75v-3vvj-5mfj



Change-Id: Iaea4457e6f8132e82faa21be3cda5011a2f1425a
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>

TensorFlow Lite Micro build produced warnings/errors with the latest
Arm Compiler (version 6.22) because of conflict between floating
point standard conformance and optimisation level.

As the TensorFlow Lite Micro's Makefile uses `-ffp-mode=full` for the
Arm Compiler, the fix is to use `-O3` for compiling the kernels. For
CMSIS DSP library we set -ffp-mode=full` for all Arm Compilers.

The issue was first raised here:
https://discuss.mlplatform.org/t/tensorflow-build-failure-with-arm-compiler-6-22/287



Change-Id: I5c19c4016a922b596b84937a366d261fd9570090
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Minor changes to release notes and documentation. A fix for Arm
Compiler toolchain file has also been added.

Change-Id: Ibe56b3eddb9a0df533972b76ce60f26d2fe4a3d3
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Updating submodules to pinned 24.05 components.

* core-platform: 24.05 tag
* core-driver:   24.05 tag
* cmsis-nn:      v6.0.0 tag
* cmsis-dsp:     v1.15.0 (no change)
* cmsis:         51f8f89612c8330c0116479cfe3a2cb04c390e2b
* tensorflow:    8e22946b3faa51564df5dd9194f7540b2694892c

Vela compiler (fetched from PyPi) version updated to 3.12.

Change-Id: Ibf4a5412368f303db1be9e7ab32504b0daac9c68
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Minor correction for URL in the CMSIS pack descriptor file (PDSC) and
updates made to the YML file used for generating the CMSIS-pack.

Change-Id: Ic8c7374ac5f7bf348328df5c972e6ca13b842171
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Adding 23.02 version of the CMSIS pack generated from sources at
23.02 tag. Note that this is more than a year old but the refresh
was needed to support TensorFlow Lite Micro CMSIS-pack's current
version 1.23.2.

There will be another refresh of the pack soon, once dependency
packs are made available.

Change-Id: I6e4072db16237db6bafc26ec09c193f10414255b
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Updating dependencies to pinned versions from the 24.02 json.

See https://git.mlplatform.org/ml/ethos-u/ethos-u.git/plain/24.02.json



Change-Id: I0859551d7e58668c5956df148a2d942012e403b5
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Adding Arm Corstone-310 and Arm Corstone-315 FVPs to the Dockerfile.
These will be in addition to the default Arm Corstone-300 FVP.

Change-Id: Id6352bca80dc516edbd99639975e561ce81b8bbf
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

For projects wrapping ml-embedded-eval-kit, this helper module file
makes it easier to import some top level variables and to call into
functions exposed by utility scripts as part of their env setup.

Change-Id: I1cf8d2513776d653590871dc791c68349a38a884
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Minor fixes to broken links in markdown files. Added a note about
timing adapters being disabled in Arm Corstone-315 by default.

Change-Id: I7f0b33adc8c38e8be7a5bfcebbf5d87f4e22430c
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Alex Tawse authored Apr 18, 2024 and Kshitij Sisodia committed May 07, 2024

* Updating linker scripts + scatter files to utilise
  64KiB boot region of Corstone-315.
* Now target 3 loading regions - boot, bram and dram.

Change-Id: Ieb9f03e53d913ded4facc15ab2171ce647b405e5
Signed-off-by: Alex Tawse <alex.tawse@arm.com>
Tested-by: mlecosys <mlecosys@arm.com>
Reviewed-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Refactoring for CMake configuration options to allow target platform
to drive their own defaults for certain dependent options.

For example, the MPS3 target platform defaults to SSE-300 sub-system
while native target doesn't need to worry about sub-system and CMSIS
options which it will never use. This allows MPS4 target to default
to SSE-315 and set the NPU arch to Arm Ethos-U65 as it should, which
otherwise would have had to be explictly specified by the user.

A welcome by-product of this is also that the options summary at the
end of a successful CMake configuration stage would only include the
settings that are actually used by the given target.

Change-Id: Ibb7f8233d427cd33f39eeb4c71d88193aa998ebd
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
Tested-by: mlecosys <mlecosys@arm.com>
Reviewed-by: Alex Tawse <alex.tawse@arm.com>
Reviewed-by: Conor Kennedy <conor.kennedy@arm.com>
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

This patch adds initial support for MPS4 based Arm Corstone-315 FVPs.
The applications will execute on the FVP but with INITSVTOR set to
`0x12000000` explicitly. The default value is the 64kiB code region
at `0x11000000`. The linker scripts will be changed for the initial
boot logic and vector table to be moved to the code region.

This patch adds `source/hal/source/platform/mps4` directory. There is
considerable overlap with MPS3 platform and this is expected to be the
case until the support for MPS4 matures. Refactoring to pull in
common bits from these targets will follow. Same goes for the CMake
build support added under `scripts/cmake/platforms/mps4`.

Change-Id: I981be9e1ec57cfedcf7d340b4f19e5eb40b5cbd3
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
Tested-by: mlecosys <mlecosys@arm.com>
Reviewed-by: Conor Kennedy <conor.kennedy@arm.com>
Reviewed-by: Alex Tawse <alex.tawse@arm.com>
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

* The previous version of Pillow was flagged
  as vulnerable, so this change bumps the version

Change-Id: I176c12c4df266de8f871b58efdcc277b090a31fa
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

Dockerfile updated for it to download the latest Fixed Virtual
Platform (FVP) version 11.24.

Minor documentation change to say that Arm Corstone-310 FVP is
also available to download from the Arm Ecosystem FVP page.

Change-Id: Icd19f71f53b4a6f1b912919e42e941fb23800d57
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Hugues Kamba Mpiana authored Mar 04, 2024 and Alex Tawse committed Mar 06, 2024

* An optional argument has been added to the
  `set_up_default_resources.py` Python script to allow
  passing of a user defined use case resources metadata JSON file.
  This shortens the build time by only downloading the resources the
  end user is interested in. It also shortens the optimization part
  which takes additional minutes as it is done for all models and for
  all the specified NPU configurations.
* Adding changes to comply with Pylint
* Adding --use-case argument in `set_up_default_resources.py` to
  restrict setting up resources to the specified use cases.

Signed-off-by: Hugues Kamba-Mpiana <hugues.kambampiana@arm.com>
Change-Id: I8d38249d8a0b52e66c26e5e74c03657e29f979b0
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

Stray header file for MPS3 platform left over from refactoring in
commit c22e80 has been removed.

Change-Id: I197756e7183654fff0b0c97e7647ab72b62d96f9
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Correction for misprint in AN547 application note which proliferated to
AN552. There are only 3 DMA interfaces.

Signed-off-by: Liam Barry <liam.barry@arm.com>
Change-Id: I53dab9cbc41f80d7a2818ce6c5b8372ecbdfbd1a

The NPU timing adapter base addresses had been defined in mutiple
places, making it difficult to determine which one is actually being
used. This patch cleans up unused definitions from memory-map header
files for different targets and the CMake template files.

The expectation is for component base addresses to be set by platform
specific CMake files that include/wrap the component directories.

Change-Id: Ic39794ffbdb872b4b0c900cbcec8e386bb32c4eb
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

* The previously-used version of resampy contained
  a bug which caused any Python script that imported
  resampy to slow down significantly.

Change-Id: I668cdf26fa2582c131698aa5e80f95b684fc692a
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

Change-Id: Iee2cea2bcb8fd315753b702a501cca2e672af386
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>

Change-Id: Ic34b01af1a7e763b92ade52a4833201d4287ec60
Reviewed-on: https://eu-gerrit-2.euhpc.arm.com/c/ml/ecosystem/ml-embedded-evaluation-kit/+/775365


Tested-by: mlecosys <mlecosys@arm.com>
Reviewed-by: Conor Kennedy <conor.kennedy@arm.com>
Reviewed-by: Richard Burton <richard.burton@arm.com>

Richard Burton authored Nov 30, 2023 and Richard Burton committed Nov 30, 2023

* Updated NPU components and dependencies (core-driver, core-platform,
Vela, CMSIS, TensorFlow Lite Micro) to 23.11 release SHAs.
* Changed Python version to 3.10
* Updated release notes and other documentation
* Added workarounds to scripts in order to address build issues

Signed-off-by: Aron Virginas-Tar <aron.virginas-tar@arm.com>

Change-Id: I0a639b80881b53eebb216085b7e6764e3be8ca67

Co-authored-by: Gabor Abonyi <gabor.abonyi@arm.com>

Signed-off-by: Richard Burton <richard.burton@arm.com>
Change-Id: I6792576cf21285d73aa8213a4497cf23502ff795

*Removed default behaviour of unit-test executables to redirect output
to file.
*Accompanying change made to CI script to generate xml files there instead.
*Switched to newer minor version of Catch.
*Note: Support for simultaneous output to console and file is available in new major version (Catch 3).

Other unit test cleanup:
* Redundant warnings about common tests output removed
* Static cast added to silence compiler warning
* Removed additional printing in RNNoiseModelTests

Signed-off-by: Liam Barry <liam.barry@arm.com>
Change-Id: If9d7f366ec205a7cd49a45198a15867ef7b75afd

Richard Burton authored Nov 13, 2023 and Richard Burton committed Nov 13, 2023

* Change reference to all ops resolver
* Added our own 'all ops resolver'
* Move Labels objects out of BRAM for simple_platform
* Minor fixes to documentation

Signed-off-by: Richard Burton <richard.burton@arm.com>
Change-Id: I8b0d66ce83287f2bc027cfc36a1f378c97755481

* Simplified the landing README file
* Rearranged sections for improved reading flow

Signed-off-by: Ayaan Masood <Ayaan.Masood@arm.com>
Change-Id: I050b39d1acdb08626134e66af2ce2eee1dbffbf9

Liam Barry authored Nov 07, 2023 and Liam Barry committed Nov 08, 2023

Change-Id: Id6e7e735e8891b59533036a7d216033a3d26e1c6

Signed-off-by: Liam Barry <liam.barry@arm.com>
Change-Id: Ib471b1808252d64a08382e06e28936dcd5c636ab

Conor Kennedy authored Oct 25, 2023 and Richard Burton committed Nov 06, 2023

Change-Id: Id3acb2d225c4890f716052e874f01651ee1a5481
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>

Signed-off-by: Richard <Burton&lt;richard.burton@arm.com>
Change-Id: I833f5edfbd080a67f2863a250be3199879d5f81f

Richard Burton authored Nov 03, 2023 and Richard Burton committed Nov 03, 2023

Signed-off-by: Richard Burton <richard.burton@arm.com>

Change-Id: I087e23f43b41fa0ef97ec7dcaeba807f6cba17e7

Alex Tawse authored Sep 29, 2023 and Richard Burton committed Oct 26, 2023

* All Python scripts updated to abide by Pylint rules
* good-names updated to permit short variable names:
  i, j, k, f, g, ex
* ignore-long-lines regex updated to allow long lines
  for licence headers
* Shell scripts now compliant with Shellcheck

Signed-off-by: Alex Tawse <Alex.Tawse@arm.com>
Change-Id: I8d5af8279bc08bb8acfe8f6ee7df34965552bbe5

TF and CMSIS-NN updated to support additional NN operation

Signed-off-by: Liam Barry <liam.barry@arm.com>
Change-Id: I7ef151a598ca7c7cb63977b0cd2f58cdc4fd432b

* For numpy versions 1.23 onwards remove comditional python statements

Change-Id: Ie0aa54da9fc0f7fd426cd324b1b785d4794fc1c7
Signed-off-by: Gauri Sahnan <gauri.sahnan@arm.com>

Liam Barry authored Sep 27, 2023 and Nina Drozd committed Oct 04, 2023

Previously, execution path following failed tensor allocation
was not covered by tests.

Minor amendment added to make ~Model virtual.
During testing it was noticed that intentional errors simulated in
certain common tests would result in misleading output for subsequent tests
as the error messages appear in the console output of the next failing test.
Documentation and print statements added until a solution is found.

Change-Id: Iaf3e0f32ce9e0505921251cd41f73030108d2cb1
Signed-off-by: Liam Barry <liam.barry@arm.com>