Alex Tawse authored Oct 01, 2024 and Alex Tawse committed Oct 02, 2024

* Adds support for Arm Corstone-320 reference system
* Includes support for Arm Ethos-U85 NPU

Change-Id: I049d582379d8feb5e969ada82db12f6747d2fd69
Signed-off-by: Alex Tawse <alex.tawse@arm.com>
Co-authored-by: Codrut-Grigore Irimie <codrut-grigore.irimie@arm.com>

Adding 24.08 version of CMSIS-pack with updated dependencies for
use-case-api.yml. This pack has been tested with examples in
https://github.com/Arm-Examples/mlek-cmsis-pack-examples

.

Change-Id: I75f58ab7fffd46460442746583a0119ffda19ce8
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

The floating point mode flag `-ffp-mode` was incorrectly set for GNU
toolchain in the TensorFlow Lite Micro CMake file. This patch adds
check for compiler.

Change-Id: I8295d23a4b91f8fec5470ebe036dc358ecc7f595
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Richard Burton authored Sep 27, 2024 and Kshitij Sisodia committed Sep 27, 2024

Due to changes in Keras, TensorFlow 2.14.1 is currently the latest version that will currently work with TF MOT

Signed-off-by: Richard Burton <richard.burton@arm.com>
Change-Id: I2a7a99d6147408fa9d6d7ce9eca997b250f91367

Adding support to build against CMSIS-6 sources. CMake configuration
parameter `CMSIS_VER` can be set to use CMSIS versions 5 or 6; the
default is kept at 5 with the aim to update it to 6 once it has been
tested sufficiently.

This patch renames the old submodule from `cmsis` to `cmsis-5` and
adds a new submodule `cmsis-6`. Another dependency downloaded during
CMake configuration is one file from
https://git.mlplatform.org/ml/ethos-u/ethos-u-core-software.git

. If
we need more files from this repo, it may be worth adding this as a
submodule too.

Change-Id: I0239f253c1c69f9adab33900b08323cdcf7b67d6
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Adding some general guidance on using MLEK as a dependency.

Change-Id: I62380e8b27e4b84366647261e63fb07447dfe3fa
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

This patch adds a fix for TensorFlow Lite Micro runtime errors not
being reported correctly by our applications.

Change-Id: I6750ed0ce30e538b30c3fe4d19bfc8fcd3a54e72
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Updating submodules to pinned 24.08 components.

    * core-platform: 24.08 tag
    * core-driver:   24.08 tag
    * cmsis-nn:      95f293df19c9a38806868fe12a64a4f9b457f9c1
    * cmsis-dsp:     v1.15.0 (no change)
    * cmsis:         4a819a09ccadacc3bad2def1d5121f137fc330fb
    * tensorflow:    c01ca97f52ca451bfba714d7eb8ae0349d85f537

    Vela compiler (fetched from PyPi) version updated to 4.0.0.

Change-Id: I04a56ded02945baefadca46d55623f627cc70eaf
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

* Add references to Corstone-315 where necessary

Signed-off-by: Alex Tawse <alex.tawse@arm.com>
Change-Id: I43d14ff1217a62e9505a5168073cf72144777343

* Minimum Python version specified to be 3.10

Signed-off-by: Alex Tawse <alex.tawse@arm.com>
Change-Id: I0cc16eb98595fc3914ab1bce8d8f760f57bd2d73

Adding BatchMatMul operator to the internal resolver in generic
inference_runner.

Change-Id: I1e1248ebd570ad508e2151a42b3e38349c0249f2
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

The tests expected all the data types across input and output tensors
to be same. These were also limited to 8-bit signed/unsigned values.
This patch make it possible to have the test vectors be of different
types while being able to get a generic (void) pointer to arrays from
the generated getter functions.

Change-Id: Id6d8b13803cd2f2ed66fee52eaed86af194b995d
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

* Use 'u55' as the default NPU ID for tflite-micro
  if other NPU values don't match

Change-Id: I6826acf7f33379e8c1edc591cd6d621234a87099
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

* Moving some of the complexity from the
  setup script to a separate file

Change-Id: I6fcbbb4d804ce00593c5fde1c062be332056e6e4
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

Hugues Kamba Mpiana authored Jun 12, 2024 and Alex Tawse committed Jun 14, 2024

* Adding --downloads-dir to set_up_default_resources.py.
  This is complementary to the RESOURCES_PATH
  CMake option in the main project.
* Some tidying and refactoring to agree with
  Pylint rules.

Change-Id: Id395130ea0b71aa0670163294a2de33da227718f
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

* The previous version of Jinja2 was flagged as vulnerable,
  so this change bumps the version.
  https://github.com/advisories/GHSA-h75v-3vvj-5mfj



Change-Id: Iaea4457e6f8132e82faa21be3cda5011a2f1425a
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>

TensorFlow Lite Micro build produced warnings/errors with the latest
Arm Compiler (version 6.22) because of conflict between floating
point standard conformance and optimisation level.

As the TensorFlow Lite Micro's Makefile uses `-ffp-mode=full` for the
Arm Compiler, the fix is to use `-O3` for compiling the kernels. For
CMSIS DSP library we set -ffp-mode=full` for all Arm Compilers.

The issue was first raised here:
https://discuss.mlplatform.org/t/tensorflow-build-failure-with-arm-compiler-6-22/287



Change-Id: I5c19c4016a922b596b84937a366d261fd9570090
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Minor changes to release notes and documentation. A fix for Arm
Compiler toolchain file has also been added.

Change-Id: Ibe56b3eddb9a0df533972b76ce60f26d2fe4a3d3
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Updating submodules to pinned 24.05 components.

* core-platform: 24.05 tag
* core-driver:   24.05 tag
* cmsis-nn:      v6.0.0 tag
* cmsis-dsp:     v1.15.0 (no change)
* cmsis:         51f8f89612c8330c0116479cfe3a2cb04c390e2b
* tensorflow:    8e22946b3faa51564df5dd9194f7540b2694892c

Vela compiler (fetched from PyPi) version updated to 3.12.

Change-Id: Ibf4a5412368f303db1be9e7ab32504b0daac9c68
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Minor correction for URL in the CMSIS pack descriptor file (PDSC) and
updates made to the YML file used for generating the CMSIS-pack.

Change-Id: Ic8c7374ac5f7bf348328df5c972e6ca13b842171
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Adding 23.02 version of the CMSIS pack generated from sources at
23.02 tag. Note that this is more than a year old but the refresh
was needed to support TensorFlow Lite Micro CMSIS-pack's current
version 1.23.2.

There will be another refresh of the pack soon, once dependency
packs are made available.

Change-Id: I6e4072db16237db6bafc26ec09c193f10414255b
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Updating dependencies to pinned versions from the 24.02 json.

See https://git.mlplatform.org/ml/ethos-u/ethos-u.git/plain/24.02.json



Change-Id: I0859551d7e58668c5956df148a2d942012e403b5
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Adding Arm Corstone-310 and Arm Corstone-315 FVPs to the Dockerfile.
These will be in addition to the default Arm Corstone-300 FVP.

Change-Id: Id6352bca80dc516edbd99639975e561ce81b8bbf
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

For projects wrapping ml-embedded-eval-kit, this helper module file
makes it easier to import some top level variables and to call into
functions exposed by utility scripts as part of their env setup.

Change-Id: I1cf8d2513776d653590871dc791c68349a38a884
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Minor fixes to broken links in markdown files. Added a note about
timing adapters being disabled in Arm Corstone-315 by default.

Change-Id: I7f0b33adc8c38e8be7a5bfcebbf5d87f4e22430c
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Alex Tawse authored Apr 18, 2024 and Kshitij Sisodia committed May 07, 2024

* Updating linker scripts + scatter files to utilise
  64KiB boot region of Corstone-315.
* Now target 3 loading regions - boot, bram and dram.

Change-Id: Ieb9f03e53d913ded4facc15ab2171ce647b405e5
Signed-off-by: Alex Tawse <alex.tawse@arm.com>
Tested-by: mlecosys <mlecosys@arm.com>
Reviewed-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Refactoring for CMake configuration options to allow target platform
to drive their own defaults for certain dependent options.

For example, the MPS3 target platform defaults to SSE-300 sub-system
while native target doesn't need to worry about sub-system and CMSIS
options which it will never use. This allows MPS4 target to default
to SSE-315 and set the NPU arch to Arm Ethos-U65 as it should, which
otherwise would have had to be explictly specified by the user.

A welcome by-product of this is also that the options summary at the
end of a successful CMake configuration stage would only include the
settings that are actually used by the given target.

Change-Id: Ibb7f8233d427cd33f39eeb4c71d88193aa998ebd
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
Tested-by: mlecosys <mlecosys@arm.com>
Reviewed-by: Alex Tawse <alex.tawse@arm.com>
Reviewed-by: Conor Kennedy <conor.kennedy@arm.com>
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

This patch adds initial support for MPS4 based Arm Corstone-315 FVPs.
The applications will execute on the FVP but with INITSVTOR set to
`0x12000000` explicitly. The default value is the 64kiB code region
at `0x11000000`. The linker scripts will be changed for the initial
boot logic and vector table to be moved to the code region.

This patch adds `source/hal/source/platform/mps4` directory. There is
considerable overlap with MPS3 platform and this is expected to be the
case until the support for MPS4 matures. Refactoring to pull in
common bits from these targets will follow. Same goes for the CMake
build support added under `scripts/cmake/platforms/mps4`.

Change-Id: I981be9e1ec57cfedcf7d340b4f19e5eb40b5cbd3
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>
Tested-by: mlecosys <mlecosys@arm.com>
Reviewed-by: Conor Kennedy <conor.kennedy@arm.com>
Reviewed-by: Alex Tawse <alex.tawse@arm.com>
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

* The previous version of Pillow was flagged
  as vulnerable, so this change bumps the version

Change-Id: I176c12c4df266de8f871b58efdcc277b090a31fa
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

Dockerfile updated for it to download the latest Fixed Virtual
Platform (FVP) version 11.24.

Minor documentation change to say that Arm Corstone-310 FVP is
also available to download from the Arm Ecosystem FVP page.

Change-Id: Icd19f71f53b4a6f1b912919e42e941fb23800d57
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Hugues Kamba Mpiana authored Mar 04, 2024 and Alex Tawse committed Mar 06, 2024

* An optional argument has been added to the
  `set_up_default_resources.py` Python script to allow
  passing of a user defined use case resources metadata JSON file.
  This shortens the build time by only downloading the resources the
  end user is interested in. It also shortens the optimization part
  which takes additional minutes as it is done for all models and for
  all the specified NPU configurations.
* Adding changes to comply with Pylint
* Adding --use-case argument in `set_up_default_resources.py` to
  restrict setting up resources to the specified use cases.

Signed-off-by: Hugues Kamba-Mpiana <hugues.kambampiana@arm.com>
Change-Id: I8d38249d8a0b52e66c26e5e74c03657e29f979b0
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

Stray header file for MPS3 platform left over from refactoring in
commit c22e80 has been removed.

Change-Id: I197756e7183654fff0b0c97e7647ab72b62d96f9
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

Correction for misprint in AN547 application note which proliferated to
AN552. There are only 3 DMA interfaces.

Signed-off-by: Liam Barry <liam.barry@arm.com>
Change-Id: I53dab9cbc41f80d7a2818ce6c5b8372ecbdfbd1a

The NPU timing adapter base addresses had been defined in mutiple
places, making it difficult to determine which one is actually being
used. This patch cleans up unused definitions from memory-map header
files for different targets and the CMake template files.

The expectation is for component base addresses to be set by platform
specific CMake files that include/wrap the component directories.

Change-Id: Ic39794ffbdb872b4b0c900cbcec8e386bb32c4eb
Signed-off-by: Kshitij Sisodia <kshitij.sisodia@arm.com>

* The previously-used version of resampy contained
  a bug which caused any Python script that imported
  resampy to slow down significantly.

Change-Id: I668cdf26fa2582c131698aa5e80f95b684fc692a
Signed-off-by: Alex Tawse <alex.tawse@arm.com>

Change-Id: Iee2cea2bcb8fd315753b702a501cca2e672af386
Signed-off-by: Conor Kennedy <conor.kennedy@arm.com>

Change-Id: Ic34b01af1a7e763b92ade52a4833201d4287ec60
Reviewed-on: https://eu-gerrit-2.euhpc.arm.com/c/ml/ecosystem/ml-embedded-evaluation-kit/+/775365


Tested-by: mlecosys <mlecosys@arm.com>
Reviewed-by: Conor Kennedy <conor.kennedy@arm.com>
Reviewed-by: Richard Burton <richard.burton@arm.com>

Richard Burton authored Nov 30, 2023 and Richard Burton committed Nov 30, 2023

* Updated NPU components and dependencies (core-driver, core-platform,
Vela, CMSIS, TensorFlow Lite Micro) to 23.11 release SHAs.
* Changed Python version to 3.10
* Updated release notes and other documentation
* Added workarounds to scripts in order to address build issues

Signed-off-by: Aron Virginas-Tar <aron.virginas-tar@arm.com>

Change-Id: I0a639b80881b53eebb216085b7e6764e3be8ca67

Co-authored-by: Gabor Abonyi <gabor.abonyi@arm.com>

Signed-off-by: Richard Burton <richard.burton@arm.com>
Change-Id: I6792576cf21285d73aa8213a4497cf23502ff795

*Removed default behaviour of unit-test executables to redirect output
to file.
*Accompanying change made to CI script to generate xml files there instead.
*Switched to newer minor version of Catch.
*Note: Support for simultaneous output to console and file is available in new major version (Catch 3).

Other unit test cleanup:
* Redundant warnings about common tests output removed
* Static cast added to silence compiler warning
* Removed additional printing in RNNoiseModelTests

Signed-off-by: Liam Barry <liam.barry@arm.com>
Change-Id: If9d7f366ec205a7cd49a45198a15867ef7b75afd