LiveKit实测Gemini 4 Hydrogen工具诚实性与语音延迟
LiveKit Blog 报道了 Gemini 4 Hydrogen 与 Gemini 3.8 Flash 在工具型语音智能体中的受控对比。在共108份测试记录中,Gemini 4 Hydrogen的54次测试未出现虚假工具报告,而 Gemini 3.8 Flash 出现两次;另一项延迟测试也显示,在受测配置下前者更早开始回复。
该测试披露了方法与结果,可为需要调用工具的语音智能体选型提供实践参考,但单一来源和较窄的测试范围限制了更广泛的结论。
We had early access to Gemini 4 Hydrogen at LiveKit, so I put it in a voice agent and broke the hotel booking tool on purpose. I wanted to see how Hydrogen would handle it. Hydrogen told the caller the booking failed every time. It also started its replies sooner than Gemini 3.8 Flash.
It told the caller the hotel booking failed#Link to this section
The demo is a travel concierge. A caller's flight got cancelled. The agent looks up the trip, rebooks the flight, books a hotel, and texts the itinerary. I set the book_hotel tool to fail on every call. Nothing in the agent's instructions says what to do when a tool fails.
Here's how the end of one run went, right after the agent rebooked the flight.
The hotel booking fails
#Gemini 4 Hydrogen#Gemini 3.8 Flash#LiveKit#LiveKit Inference#LiveKit Google plugin#Google