Rebuilding a self-hosted voice assistant with microWakeWord
A developer rebuilt a self-hosted Platypush voice assistant pipeline using the new assistant.microwakeword plugin, assistant.openai for Whisper transcription, the openai plugin for responses and context, and tts.openai for speech. The shared audio preprocessor now supports Silero, WebRTC, and energy-based VAD with hysteresis, sliding-window smoothing, and an adaptive noise floor; on the author’s synthetic benchmark, conversation end detection improved from 6–10 seconds to 1.0–1.6 seconds after the final word.
The project provides concrete implementation details, configuration, and code changes for assembling a more robust self-hosted AI voice stack, although its benchmark and tuned defaults were tested only by the author on synthetic audio and a few personal recordings.
- Wake word detection: a new assistant.microwakeword plugin
- Speech-to-text: assistant.openai, with a much better ear
- Responses and context: the openai plugin
- Text-to-speech: tts.openai
- The full configuration
- What changed on the code side
- Caveats
I wrote an article a couple of months ago describing how I rebuilt my old voice assistant pipeline in Platypush.
And I wrote earlier articles describing my journey through self-hosted voice assistants - in 2024 (with Picovoice), in 2020 (diving into the legacy assistant.google integration, the now defunct assistant.alexa integration, the now defunct Snowboy integration, the now defunct DeepSpeech integration and Picovoice) and the original article in 2019 describing the Google Assistant integration.
For a couple of months I used the voice pipeline described in my latest article as my main driver, but after getting used to the robustness of commercial voice assistants I was unhappy with the high rates of false positives/negatives of my self-hosted pipeline, as well as its lack of robustness in detecting start/end of speech, especially in noisy environments and using cheap microphones.
#Platypush#assistant.microwakeword#microWakeWord#OpenAI#Whisper#Silero VAD#ESPHome#Home Assistant Voice#Ollama#Piper#TTS