Steadyworks

Headlines · 1

1. Nov 2
   Realtime-Bench tests AI systems under real-time interaction

   Researchers introduced Realtime-Bench, a 50-task benchmark for evaluating general-purpose AI systems whose decisions and actions must respond to changing conditions in real time. It includes 30 web tasks and 20 game tasks, measuring temporal state awareness, adaptive deliberation, and time-aware action selection under wall-clock, paused-clock, and token-clock conditions. Import AI reported that GPT-6-Astra achieved the highest wall-clock pass rate at 36%, while high-reasoning models approached 70% to 80% with the clock paused.

   Import AI · 🔥 0

Experience and discussion from the community

Share my Steadyworks experienceAsk about Steadyworks