i8mm

2.12x faster IQ4_XS prefill on Arm Neoverse: the missing smmla repack kernel for llama.cpp. IQ4_XS is the smallest standard 4-bit GGUF and had an accelerated matmul path on Intel AMX but none on Arm. Measured stock-vs-patched on free Neoverse N2 CI.

Prove whether an Arm binary can actually use the chip's matrix hardware. Static ISA verifier + CI gate for AArch64 AI runtimes (SME/SME2, i8mm, dotprod).

int8 vector search for Arm that reaches SDOT and SMMLA. 9.1x faster than the fastest working FAISS int8 mode at slightly better recall, with every number reproducible in CI on free Arm runners.