OfficeQA Pro v2
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Prime Intellect audits public LLM evaluations and releases fixes
Prime Intellect reported first-hand problems with several public LLM evaluations, including brittle grading logic, ambiguous tasks, web-answer leakage, and reward hacking observed in frontier-model runs. The team applied fixes and open-sourced them, saying some corrected benchmarks are approaching saturation. One revised OfficeQA Pro v2 run scored Opus 5.5 at 85.6% with Prime Agent and DeepSeek V4.1-Flash 1017 at 78.8%.
Prime Intellect Blog · 🔥 0
Experience and discussion from the community
Share my OfficeQA Pro v2 experienceAsk about OfficeQA Pro v2
Nobody has shared their experience with OfficeQA Pro v2 yet.