RossiLH demos a lightweight KIMI K3 serving module
RossiLH presented a CPU-based interactive demonstration of parts of the KIMI K3 serving module across 14 tabs. It covers KDA speculative replay, replay-consistency checks, ReplaySSM ring buffering, unified paging for MLA and KDA storage, two-stage prefix-cache lookup, engine comparisons, and Fleet scheduling with consistent-hash routing and budget isolation. The author describes the components as reduced-scale versions or approximations and presents the project as part of his learning process.
The project provides a way to run and inspect several KIMI K3 serving mechanisms without a GPU while explaining the problems they address and how the components work together.
Some source content is omitted. Continue reading on the original site.