Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

dr-triton

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. Developer runs 775 GB Kimi-K3.1-Pro-Coder with three-tier offloading

    Reddit developer Grawnch published a 775 GB quantization of Kimi-K3.1-Pro-Coder, down 56% from the 1.77 TB base configuration, together with the Strata loader and dr-triton dequantization kernels. Grawnch reports that the experimental setup ran all 93 layers on one RTX PRO 6000 Blackwell with system RAM and NVMe, reaching 36.8 batch tokens per second and 10.8 single-stream tokens per second while scoring 96.7% on AIME 2025 and LiveCodeBench.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my dr-triton experienceAsk about dr-triton

Nobody has shared their experience with dr-triton yet.