创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

DialFork评测智能体程序性幻觉

AI 总结

Idiap Research Institute与Logitech发布DialFork,用于评测对话式LLM智能体的程序性幻觉,即智能体即使表达流畅、工具调用正确,仍可能遗漏或打乱必要步骤。基准包含逾3.6万段对话,覆盖24项任务和12个领域,并由30名人工标注员及经其校准的LLM裁判检查漂移标注。数据、代码、论文、预测结果、人工判断及三个任务排行榜均已公开。

深度见解

DialFork将程序遵循作为独立于事实准确性和工具调用正确性的评测维度,为智能体开发者提供了公开测试集与排行榜,以衡量这种被忽视的失效模式。

Hi all, author here (Idiap Research Institute, joint work with Logitech). We recently released DialFork and thought it might interest people here. It's a benchmark for a failure mode of LLM agents that is easy to miss: every turn is fluent and factual, the tool calls are correct, yet the agent stops following the procedure it was given. For example, asked for the weather, it fetches the forecast (correct tool call) but never tells you, and starts asking you to rate its service instead.

Most steps of a conversational procedure aren't tool calls but things the agent has to say: asking, confirming, telling the result. When an agent drifts from these steps, we call it procedural hallucination: a third axis, alongside factual accuracy and correct tool use, and one that has been largely overlooked. To our knowledge, DialFork is the first benchmark aimed at measuring this axis: what the agent has to say, and in what order.

How it's built: we simulate dialogues where an agent follows its workflow (24 tasks, 12 domains), then fork them: we replay each one and, at a chosen turn, give the agent an instruction that makes it drift, in different, complementary ways. That gives over 36k dialogues where we know where each drift starts and how far it goes, checked with 30 human annotators and an LLM judge calibrated on them.

#DialFork#Idiap Research Institute#Logitech#Hugging Face

原文约 3 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。