社区测试小型本地模型的波兰语与代码能力
Reddit 作者创建了开源的“Zacharski tests”，通过 Ollama 在一台配备 8GB 显存的笔记本上测试小型本地模型。测试包含 8 项波兰语任务、4 项 JSON 任务和 3 项 Python 语法检查，每项仅生成一次答案，温度设为 0，上下文为 2k，并关闭思考模式。首批结果中，gemma2:9b Q4_0 在 JSON 和代码任务中得分 7/7，在波兰语任务中得分 3/8。
这套精简测试让用户能按自身硬件和量化方式复现本地模型表现，但小样本及目前仅测试一个模型的结果不能视作通用排名。
I wanted to know how small local models handle my native language, not just English. I couldn't find a simple way to check a model's Polish in a few minutes, on my own PC, in the quantization I actually run – so I wrote one. That's how "Zacharski tests" started: a small task set that runs through Ollama, since that's what I use on my laptop with an RTX 5050 (8 GB).
The tasks:
- Polish (8): diacritics, declension, masculine-personal gender, numerals, vocative, verb aspect, genitive – plus one knowledge question (the first recorded Polish sentence, from the 13th-century Book of Henryków).
- JSON (4): scored strict and lenient.
- Python (3): syntax check only.
Results so far:
| Model | Quant | JSON + code | Polish |
| gemma2:9b | Q4_0 | 7/7 | 3/8 |
#Zacharski tests#Ollama#gemma2:9b#Qwen3#Llama 3.1#Gemma 3#Bielik 11B#Bielik-Minitron 7B#Open PL LLM Leaderboard#SpeakLeash#NVIDIA GeForce RTX 5050