DialFork
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- DialFork Benchmarks Procedural Hallucination in Conversational Agents
Idiap Research Institute and Logitech released DialFork, an open benchmark for measuring procedural hallucination in conversational LLM agents, including failures where agents remain fluent and use tools correctly but omit or misorder required conversational steps. It includes more than 36,000 dialogues spanning 24 tasks and 12 domains, with drift annotations checked by 30 human annotators and an LLM judge calibrated against them. The data, code, paper, predictions, human judgments, and three task leaderboards are publicly available.
r/MachineLearning · 🔥 0
Experience and discussion from the community
Share my DialFork experienceAsk about DialFork
Nobody has shared their experience with DialFork yet.