Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

MonsterHouse brings Nemotron voices to a Halloween garage door

AI summary

Creator MonsterHouse built an interactive Halloween projection that listens to trick-or-treaters and responds as a grumpy pirate ship, becoming friendlier when visitors are polite. The system combines NVIDIA Nemotron Voice Agent, Nemotron Speech ASR, Nemotron 3.5 Bolt E4B 4GB, Magpie TTS Zeroshot and Audio2Face-3D, with the conversational and animation workload running on a single workstation. Its pipeline also uses LoRA for personality, Nemotron 3 Nano Omni for costume descriptions, and YOLO with ByteTrack for visitor counting and tracking.

In-depth insight

The project provides a concrete, technically substantial example of combining local NVIDIA open models, speech synthesis and facial animation in a single interactive character installation.

Building a Haunted House with NVIDIA Nemotron Open Models

Or rather…

Boo! Now Get Off My Lawn!

TL;DR: MonsterHouse is an interactive projection I created for Halloween. He listens to trick-or-treaters, answers in the voice of a grumpy old pirate ship and softens when visitors remember their manners. He is built on the NVIDIA Nemotron Voice Agent with NVIDIA Nemotron ASR, Nemotron 3.5 Bolt E4B 4GB, Magpie TTS Zeroshot and Audio2Face-3D, and he runs on a single workstation.

I wanted the kids visiting my house at Halloween to interact in a fun and unique way. The house was going to be in charge and giving out the treats, but more grumpy than scary. Somehow, my solution was to give the garage door a mouth and teach him to complain.

That became MonsterHouse: a grumpy old building with pirate stories, a fiery grin and a suspicious weakness for “please.” NVIDIA Nemotron Voice Agent supplies the conversation foundation. Nemotron Speech does the listening, Bolt E4B is the brain, NVIDIA Magpie TTS Zeroshot is the live voice, and NVIDIA Audio2Face-3D makes the wooden mouth talk.

#MonsterHouse#NVIDIA#NVIDIA Nemotron Voice Agent#NVIDIA Nemotron Speech ASR#NVIDIA Nemotron 3.5 Bolt E4B 4GB#NVIDIA Magpie TTS Zeroshot#NVIDIA Audio2Face-3D#NVIDIA Nemotron 3 Nano Omni#YOLO#ByteTrack#Unreal Engine 5#Autodesk Maya

Original · 9 min readRead the original
Group chat

No comments yet. Start the conversation.