Vals Index

Headlines · 2

1. 6h
   DeepSeek V4.1 Flash's Terminal-Bench score differs across model card, AA and Vals

   A post on r/LocalLLaMA compares three Terminal-Bench 4.0 scores for DeepSeek-V4.1-Flash-1017: 42.3% reported on the model card, 34% from Artificial Analysis and 31.82% from the Vals index. The poster notes that the model card says the Claude Code harness was used and guesses that AA and Vals instead use mini-swe-agent, which he suggests could explain the lower results; he also points to the benchmark's eight-hour task limit and provider token throughput as possible sources of skew. Taking the 42.3% figure, he says the model would be on par with Fable 5, released June 9, 2026.

   r/LocalLLaMA · 🔥 5
2. Oct 11
   Google launches Gemini 4 Argon globally with half-price API pricing

   Google announced on October 14 that its flagship Gemini 4 Argon is available worldwide to developers, enterprises and paid subscribers: developers can access it through Google AI Studio and the Gemini API, AI Ultra subscribers through Antigravity, and Pro and Ultra users through the Gemini app and AI Mode in Search. Google says the model targets complex multi-step work in coding, finance, law, cybersecurity and scientific research. Launch pricing is $2 per million input tokens and $10 per million output tokens with a 95% cached-input discount through November 30, after which prices return to $4 and $20.

   TestingCatalog · 🔥 0

Experience and discussion from the community

Share my Vals Index experienceAsk about Vals Index