Commits · b650c26dac488ae661963ad5e5833c2348e0d8f4 · Kleidi / KleidiAI

Nov 28, 2024

Matmul int8 micro-kernels for F32 <- QA8DX (LHS) x QS8ICX (RHS) · f51cd7ec

Gian Marco Iodice authored Nov 28, 2024 and

Jakub Sujak committed Nov 28, 2024



- Add GeMM-like micro-kernels
- Add GeMV-like micro-kernels

Signed-off-by: Gian Marco Iodice <gianmarco.iodice@arm.com>

Reviewed-by: Jakub Sujak <jakub.sujak@arm.com>
Approved-by: Jakub Sujak <jakub.sujak@arm.com>

f51cd7ec

Nov 27, 2024

Matmul int4 micro-kernel variants 16x4 and 1x4 for QSI8D32 (LHS) x QSI4C32 (RHS) -> F32 · 39ab4d69

Michael Kozlov authored Nov 27, 2024 and

Felix Johnny Thomasmathibalan committed Nov 27, 2024



Signed-off-by: Michael Kozlov <michael.kozlov@arm.com>

Signed-off-by: Anitha Raj <anitha.raj@arm.com>

Reviewed-by: Viet-Hoa Do <viet-hoa.do@arm.com>
Reviewed-by: Anitha Raj <anitha.raj@arm.com>
Reviewed-by: Anton Bondarenko <anton.bondarenko@arm.com>
Approved-by: Jakub Sujak <jakub.sujak@arm.com>
Approved-by: Anton Bondarenko <anton.bondarenko@arm.com>

39ab4d69

Nov 04, 2024

Add list of v0.4.0 changes to CHANGELOG · 7985c263

Jakub Sujak authored Nov 04, 2024

Signed-off-by: Jakub Sujak <jakub.sujak@arm.com>

Reviewed-by: Anton Bondarenko <anton.bondarenko@arm.com>
Approved-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>

7985c263

Oct 16, 2024

Add SME F32 GEMV micro-kernel · 5d265fa1

Jakub Sujak authored Oct 16, 2024

Compute the Vector-Matrix multiply of F32 inputs to produce an F32 matrix, optimized using SME instructions.

Signed-off-by: Jakub Sujak <jakub.sujak@arm.com>

Approved-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>

5d265fa1

Oct 14, 2024
- Add int4 matrix multiplication ukernels with dotprod extension · 10930855
  Anitha Raj authored Oct 14, 2024 and Felix Johnny Thomasmathibalan committed Oct 14, 2024
```
Signed-off-by: Anitha Raj <anitha.raj@arm.com>

Reviewed-by: Anitha Raj <anitha.raj@arm.com>
Approved-by: Gian Marco Iodice <gianmarco.iodice@arm.com>
```
  10930855
Sep 27, 2024
- Mention removal of FP16 GEMV in CHANGELOG · 35e156d6
  Jakub Sujak authored Sep 27, 2024 and Felix Johnny Thomasmathibalan committed Sep 27, 2024
```
Signed-off-by: Jakub Sujak <jakub.sujak@arm.com>

Approved-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>
```
  v0.3.0-rc2
  
  35e156d6
- Extend qsi4cxp RHS packing kernels to support signed int4 inputs · 49f0ca8b
  Anitha Raj authored Sep 27, 2024 and Felix Johnny Thomasmathibalan committed Sep 27, 2024
```
Signed-off-by: Anitha Raj <anitha.raj@arm.com>

Approved-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>
```
  49f0ca8b
- Update changelog for 0.3.0 release · fab361a5
  Felix Johnny Thomasmathibalan authored Sep 27, 2024
```
Signed-off-by: Felix Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>

Approved-by: Jakub Sujak <jakub.sujak@arm.com>
```
  fab361a5
Sep 25, 2024

Revert "Add FP32 GEMV micro kernel" · 33ba646c

Jakub Sujak authored Sep 25, 2024 and

Felix Johnny Thomasmathibalan committed Sep 25, 2024

This reverts commit f4f59599

The existing FP32 GEMM micro-kernel (matmul_clamp_f32_f32_f32p8x1biasf32_6x8x4_neon_mla) has a dedicated path for M=1 (a "GEMV" operation).

Signed-off-by: Jakub Sujak <jakub.sujak@arm.com>

Approved-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>

33ba646c

Sep 12, 2024

Matmul int4 micro-kernels for QAI8DX (LHS) x QSI4C32 (RHS) -> F32 · ae4b17a6

Gian Marco Iodice authored Sep 12, 2024 and

Viet-Hoa Do committed Sep 12, 2024



- The LHS matrix is Quantized (Q) Asymmetric (A) Signed 8-bit (I8) with per-row
(DX) quantization parameters
- The RHS matrix is quantized (Q) Symmetric (S) Signed 4-bit (I4) with
per-block quantization
- The destination is F32
- Implement micro-kernels to perform the matrix multiplication
- Implement a micro-kernel to pack the RHS matrix

Signed-off-by: Gian Marco Iodice <gianmarco.iodice@arm.com>

Signed-off-by: Anitha Raj <anitha.raj@arm.com>

Signed-off-by: Viet-Hoa Do <viet-hoa.do@arm.com>

Reviewed-by: Viet-Hoa Do <viet-hoa.do@arm.com>
Reviewed-by: Anitha Raj <anitha.raj@arm.com>
Reviewed-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>
Reviewed-by: Jakub Sujak <jakub.sujak@arm.com>
Reviewed-by: Max Ren <maxren@meta.com>
Approved-by: Viet-Hoa Do <viet-hoa.do@arm.com>

ae4b17a6

Aug 30, 2024

Add FP32 GEMV micro kernel · f4f59599

Felix Johnny Thomasmathibalan authored Aug 30, 2024 and

Jakub Sujak committed Aug 30, 2024



Signed-off-by: Felix Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>

Approved-by: Jakub Sujak <jakub.sujak@arm.com>

f4f59599

Aug 19, 2024

Bump version to v0.2.0 · 1ea3667f

Jakub Sujak authored Aug 19, 2024 and

Felix Johnny Thomasmathibalan committed Aug 19, 2024



Signed-off-by: Jakub Sujak <jakub.sujak@arm.com>

Approved-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>

1ea3667f

Aug 16, 2024

Matmul int4 micro-kernels for QSI8D32 (LHS) x QSI4C32 (RHS) -> F32 · cf999441

Gian Marco Iodice authored Aug 16, 2024 and

Jakub Sujak committed Aug 16, 2024



* The LHS matrix is Quantized (Q) Symmetric (S) Signed 8-bit (I8) with per-block quantization (D32) quantization parameters
* The RHS matrix is Quantized (Q) Symmetric (S) Signed 4-bit (I4) with per-block quantization(C32) F16 scale factors,
* The destination is F32
* Implement micro-kernels to perform the matrix multiplication
* Implement a micro-kernel to pack the LHS and RHS matrices
* Added unit tests

Signed-off-by: Gian Marco <Iodice gianmarco.iodice@arm.com>

Signed-off-by: Anitha <Raj Anitha.Raj@arm.com>

Signed-off-by: Viet-Hoa Do <viet-hoa.do@arm.com>

Reviewed-by: Viet-Hoa Do <viet-hoa.do@arm.com>
Reviewed-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>
Reviewed-by: Jakub Sujak <jakub.sujak@arm.com>
Approved-by: Jakub Sujak <jakub.sujak@arm.com>

cf999441

Jul 15, 2024

Update release log for v0.1.0 · 8fda0bd9

Felix Johnny Thomasmathibalan authored Jul 15, 2024



Signed-off-by: Felix Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>

Approved-by: Anton Bondarenko <anton.bondarenko@arm.com>

8fda0bd9

Jul 05, 2024

Minor fixes · 547f7506

Jakub Sujak authored Jul 05, 2024



Signed-off-by: Jakub Sujak <jakub.sujak@arm.com>

Approved-by: Anton Bondarenko <anton.bondarenko@arm.com>

547f7506

Jul 04, 2024

Add CHANGELOG.md file · 0dd5b868

Jakub Sujak authored Jul 04, 2024

Signed-off-by: Jakub Sujak <jakub.sujak@arm.com>

Reviewed-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>
Approved-by: Felix Johnny Thomasmathibalan <felixjohnny.thomasmathibalan@arm.com>

0dd5b868