Gemini 2.5 Pro

Headlines · 1

1. Oct 22
   Frontier audio models struggle to label ASMR sounds, developer benchmark finds

   A developer training a text-to-ASMR model evaluated eight frontier audio models as sound labellers on 480 clips with the same prompt and 20 labels, reporting that all struggled with fine-grained trigger sounds. Gemini 3.1 Pro had the highest trigger F1 against human labels at 0.325, while Claude Opus 5.5 and Grok 4.7, given spectrogram images, scored 0.121 and 0.110; Gemini 3.1 Pro named brushing in 92% of clean FSD50K/ESC-50 clips but reached only 0.18 brushing F1 on real ASMR, and whispering F1 was 0.70 to 0.79. The author reports Gemini 3.1 Pro at $0.0088 per clip and MiMo at $0.0008, and the findings come from a single r/MachineLearning post without independent verification.

   r/MachineLearning · 🔥 0

Experience and discussion from the community

Share my Gemini 2.5 Pro experienceAsk about Gemini 2.5 Pro