Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

DialFork

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. DialFork Benchmarks Procedural Hallucination in Conversational Agents

    Idiap Research Institute and Logitech released DialFork, an open benchmark for measuring procedural hallucination in conversational LLM agents, including failures where agents remain fluent and use tools correctly but omit or misorder required conversational steps. It includes more than 36,000 dialogues spanning 24 tasks and 12 domains, with drift annotations checked by 30 human annotators and an LLM judge calibrated against them. The data, code, paper, predictions, human judgments, and three task leaderboards are publicly available.

    r/MachineLearning · 🔥 0

Experience and discussion from the community

Share my DialFork experienceAsk about DialFork

Nobody has shared their experience with DialFork yet.