MonsterHouse brings Nemotron voices to a Halloween garage door
Creator MonsterHouse built an interactive Halloween projection that listens to trick-or-treaters and responds as a grumpy pirate ship, becoming friendlier when visitors are polite. The system combines NVIDIA Nemotron Voice Agent, Nemotron Speech ASR, Nemotron 3.5 Bolt E4B 4GB, Magpie TTS Zeroshot and Audio2Face-3D, with the conversational and animation workload running on a single workstation. Its pipeline also uses LoRA for personality, Nemotron 3 Nano Omni for costume descriptions, and YOLO with ByteTrack for visitor counting and tracking.
The project provides a concrete, technically substantial example of combining local NVIDIA open models, speech synthesis and facial animation in a single interactive character installation.
Building a Haunted House with NVIDIA Nemotron Open Models
Or rather…
Boo! Now Get Off My Lawn!
TL;DR: MonsterHouse is an interactive projection I created for Halloween. He listens to trick-or-treaters, answers in the voice of a grumpy old pirate ship and softens when visitors remember their manners. He is built on the NVIDIA Nemotron Voice Agent with NVIDIA Nemotron ASR, Nemotron 3.5 Bolt E4B 4GB, Magpie TTS Zeroshot and Audio2Face-3D, and he runs on a single workstation.
I wanted the kids visiting my house at Halloween to interact in a fun and unique way. The house was going to be in charge and giving out the treats, but more grumpy than scary. Somehow, my solution was to give the garage door a mouth and teach him to complain.
That became MonsterHouse: a grumpy old building with pirate stories, a fiery grin and a suspicious weakness for “please.” NVIDIA Nemotron Voice Agent supplies the conversation foundation. Nemotron Speech does the listening, Bolt E4B is the brain, NVIDIA Magpie TTS Zeroshot is the live voice, and NVIDIA Audio2Face-3D makes the wooden mouth talk.
#MonsterHouse#NVIDIA#NVIDIA Nemotron Voice Agent#NVIDIA Nemotron Speech ASR#NVIDIA Nemotron 3.5 Bolt E4B 4GB#NVIDIA Magpie TTS Zeroshot#NVIDIA Audio2Face-3D#NVIDIA Nemotron 3 Nano Omni#YOLO#ByteTrack#Unreal Engine 5#Autodesk Maya