RTX 2060
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- ik_llama.cpp Fork Update Adds RTX 2060 Inference Results
IceFog72 released an updated ik_llama.cpp fork and invited community feedback on r/LocalLLaMA. The developer self-reported about 45–48 tokens per second on short prompts, about 37 tokens per second at a 28K context length, and prefill speeds of roughly 430–700 tokens per second on an RTX 2060 with 6 GB of VRAM. The update retains the core idea of the earlier approach but has a slightly different implementation and still requires cleanup and broader testing.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my RTX 2060 experienceAsk about RTX 2060
Nobody has shared their experience with RTX 2060 yet.