Zacharski tests
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Community author tests small local LLMs on Polish, JSON and Python
A Reddit author created “Zacharski tests,” an open-source 15-task suite for evaluating small local models through Ollama on a laptop with 8 GB of VRAM. It covers eight Polish tasks, four JSON tasks and three Python syntax checks, with one answer per task, temperature 0, a 2k context and thinking disabled. The initial gemma2:9b Q4_0 result was 7/7 on JSON and code tasks but 3/8 on Polish tasks.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Zacharski tests experienceAsk about Zacharski tests
Nobody has shared their experience with Zacharski tests yet.