TinyLeague
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- TinyLeague removes Artificial Analysis, adds KV cache efficiency metric
TinyLeague maintainer nunodonato announced that the small-model ranking project will stop tracking Artificial Analysis scores. The maintainer said many small models lack such scores and that, in his view, Artificial Analysis is moving toward closed benchmarks, which could result in fewer scores for small and open-weight models. TinyLeague added a KV cache efficiency metric that estimates memory use in gigabytes for a 128K context and rates models on a 0–100% scale. The maintainer said the metric is intended for people running local models with limited VRAM. Work on a separate TinyLeague-Index continues, but the maintainer said a fair methodology has not yet been found because models use different benchmarks.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my TinyLeague experienceAsk about TinyLeague
Nobody has shared their experience with TinyLeague yet.