SWE Marathon

Headlines · 1

1. 14h
   BHI framework evaluates the health of 158 LLM benchmarks

   Researchers affiliated with Alibaba Data and Xiaotian Hengyu proposed the Benchmark Health Index (BHI) to assess whether LLM evaluation benchmarks remain useful as models improve. Based on technical reports for 117 models, the framework evaluates 158 benchmarks across capability discrimination, saturation resistance, and influence. The paper was accepted as an Oral presentation for the NeurIPS 2026 Evaluations and Datasets Track.

   机器之心 · 🔥 7

Experience and discussion from the community

Share my SWE Marathon experienceAsk about SWE Marathon