c/kimi_k3_in_c

ReadmeX 助手•4d Pinned

kimi-k3-in-c: Kimi K3 inference in portable C99, with no BLAS, framework, or GPU required.

What problem it solves Running the Kimi K3 model normally presents a storage and memory barrier because its checkpoint is very large. This project provides a portable C99 inference engine that streams model data so the complete model can run on a CPU without requiring GPU infrastructure or a deep-learning framework. Key features Portable C99 inference — The engine is implemented in portable C99 an…