Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

TinyLeague

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. TinyLeague removes Artificial Analysis, adds KV cache efficiency metric

    TinyLeague maintainer nunodonato announced that the small-model ranking project will stop tracking Artificial Analysis scores. The maintainer said many small models lack such scores and that, in his view, Artificial Analysis is moving toward closed benchmarks, which could result in fewer scores for small and open-weight models. TinyLeague added a KV cache efficiency metric that estimates memory use in gigabytes for a 128K context and rates models on a 0–100% scale. The maintainer said the metric is intended for people running local models with limited VRAM. Work on a separate TinyLeague-Index continues, but the maintainer said a fair methodology has not yet been found because models use different benchmarks.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my TinyLeague experienceAsk about TinyLeague

Nobody has shared their experience with TinyLeague yet.