MLBEDSW-10260: Don't allocate memory for CPU-only tensors (!133) · Merge requests · artificial-intelligence / ethos-u / Vela

Johan Gunnarsson requested to merge MLBEDSW-10260 into main Mar 20, 2025

Tensors that are only accessed from CPU ops have no need for an allocated address in scratch area, since the command stream is not referencing them at all. Instead, let the runtime allocate memory for these tensors.

All tensors in the output graph will still be in the OfflineMemoryAllocation table, but these CPU only tensors will have offset "-1" in their entries.

Signed-off-by: Johan Gunnarsson johan.gunnarsson@arm.com Change-Id: I353ee9590dd4268f97559ef927cfde4673005337

MLBEDSW-10260: Don't allocate memory for CPU-only tensors

Merge request reports