kimi-k3-in-c: Kimi K3 inference in portable C99, with no BLAS, framework, or GPU required.
What problem it solves Running the Kimi K3 model normally presents a storage and memory barrier because its checkpoint is very large. This project provides a portable C99 inference engine that streams model data so the complete model can run on a CPU without requiring GPU infrastructure or a deep-learning framework. Key features Portable C99 inference — The engine is implemented in portable C99 an…
github.comhttps://github.com/FareedKhan-dev/kimi-k3-in-c