University of New South Wales

Headlines · 1

1. 10h
   VoxMem benchmark: audio LLMs all fall below 40% accuracy at 32K context

   A joint team from the University of Melbourne and UNSW released VoxMem, an audio-LLM memory benchmark built on an "acoustic evidence × memory operation" taxonomy covering 15 combinations, 3,196 evaluation instances, 34,743 speech sessions and roughly 177 hours of audio. Questions are held constant across 8K–64K history lengths so only conversation length varies. Across 15 mainstream audio models, overall accuracy stayed below 40% at 32K context; memory for speaker identity, paralinguistic cues such as tone and emotion, and environmental sound lagged clearly behind semantic recall of what was said, and all categories degraded as history grew.

   AIbase AI新闻 · 🔥 8

Experience and discussion from the community

Share my University of New South Wales experienceAsk about University of New South Wales