Voice AI Execs Cite Accuracy, Speed and Trust Barriers
PolyAI CTO Shawn Wen told TechCrunch AI that despite full-duplex models that can speak while users talk, voice AI has not had its “ChatGPT moment.” He said reasoning needs to be faster so systems can retrieve answers quickly and conversations feel natural. Otter CMO Alex Gay said speaker identification, intent capture, linking conversations with organizational knowledge and expressive speech are important for meeting automation. Wen said automatic speech recognition models often miss keywords and impair context capture. Gay said inaccurate transcriptions can lead to flawed summaries and actions and undermine trust in the platform. Otter is exploring ways to notify meeting participants about recordings, while Wen said enterprise users should know when they are speaking with AI.
The executives identify recognition accuracy, reasoning speed, conversational naturalness and disclosure as practical challenges for deploying voice AI in enterprise customer service and meeting workflows.
The theory of voice being the next big interface has picked up strong momentum, with investors pouring billions of dollars into voice AI startups working on areas ranging from model makers to enterprise customer service providers, and from meeting note-takers to AI-powered dictation.
Every week there is a new model or a tool release that claims to sound human and converse like one. However, in reality, that might not be the case. Enterprise voice AI platform PolyAI’s CTO Shawn Wen thinks that despite the release of full-duplex models — which can speak while listening to you — voice AI hasn’t had its “ChatGPT moment” yet.
“We have reached the milestone of developing full-duplex models. The next challenge is to make reasoning very fast, so that the models can fetch answers quickly and the conversation feels natural,” he told me onstage at the HumanX conference last month.
He also said that AI agents in customer service should not sound robotic and should give callers enough confidence that they can solve problems.
“I think the next stage will be slightly different because once the voice is good enough, like, and the customer is willing to engage with them for the first two or three turns, they start to build confidence, and over time, they will feel like I probably don’t have to talk to a human if the agent can solve my problem,” he said.