LlamAmpere

Headlines · 1

1. Nov 1
   2.3bpw Qwen 27B checkpoint targets 200K context on 12GB Ampere cards

   Developer JakeATX released an updated 2.3bpw Qwen 27B checkpoint using the new AmperInteger+ quantization format, which combines fractional 2–3-bit weights, trellis-based encoding, and an RCO-like optimization. He reports that the checkpoint scored 84.3% on LiveCode Bench with a strict grader across three runs, compared with 83.9% for Qwen3.6 27B BF16 and 90.3% for Qwen3.8 BF16. Using a custom SJKVaRN build and runtime changes, he says the 7.4GiB on-card checkpoint can support 200K-token context on a single 12GB Ampere card.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my LlamAmpere experienceAsk about LlamAmpere