Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Rebuilding a self-hosted voice assistant with microWakeWord

AI summary

A developer rebuilt a self-hosted Platypush voice assistant pipeline using the new assistant.microwakeword plugin, assistant.openai for Whisper transcription, the openai plugin for responses and context, and tts.openai for speech. The shared audio preprocessor now supports Silero, WebRTC, and energy-based VAD with hysteresis, sliding-window smoothing, and an adaptive noise floor; on the author’s synthetic benchmark, conversation end detection improved from 6–10 seconds to 1.0–1.6 seconds after the final word.

In-depth insight

The project provides concrete implementation details, configuration, and code changes for assembling a more robust self-hosted AI voice stack, although its benchmark and tuned defaults were tested only by the author on synthetic audio and a few personal recordings.

I wrote an article a couple of months ago describing how I rebuilt my old voice assistant pipeline in Platypush.

And I wrote earlier articles describing my journey through self-hosted voice assistants - in 2024 (with Picovoice), in 2020 (diving into the legacy assistant.google integration, the now defunct assistant.alexa integration, the now defunct Snowboy integration, the now defunct DeepSpeech integration and Picovoice) and the original article in 2019 describing the Google Assistant integration.

For a couple of months I used the voice pipeline described in my latest article as my main driver, but after getting used to the robustness of commercial voice assistants I was unhappy with the high rates of false positives/negatives of my self-hosted pipeline, as well as its lack of robustness in detecting start/end of speech, especially in noisy environments and using cheap microphones.

#Platypush#assistant.microwakeword#microWakeWord#OpenAI#Whisper#Silero VAD#ESPHome#Home Assistant Voice#Ollama#Piper#TTS

Original · 6 min readRead the original
Group chat

No comments yet. Start the conversation.