VibeVideoBench
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- VibeVideoBench tests code-driven video generation by multimodal agents
The paper authors introduce VibeVideoBench, a benchmark with 239 English- and Chinese-language tasks across 12 categories for multimodal agents that create videos by writing code rather than using image or video generation models. Each agent has one hour to deliver a finished MP4 with sound, and evaluation combines delivery checks, roughly 13,000 task-specific rubric checks, task-specific quality criteria, and three VLM judge panels. Across nine agent systems and 2,151 scored rollouts, GPT-6 Astra and Claude Opus 5.5 ranked first and second under both the judges and human annotators, while the strongest system met every core requirement on 76.3% of tasks.
Hugging Face · Papers · 🔥 0
Experience and discussion from the community
Share my VibeVideoBench experienceAsk about VibeVideoBench
Nobody has shared their experience with VibeVideoBench yet.