Reddit user details an IVY assistant spanning local and cloud models
A Reddit user described building IVY, an assistant that combines local Qwen3.8-27B inference on two RTX 3090 GPUs with DeepSeek and Claude models hosted in the cloud. The system also includes a web chat, voice and facial-animation pipelines, GPU-accelerated retrieval, and additional creative models served through llama-swap. The post provides a detailed personal build account, but its claims are not independently verified.
The post offers a concrete example of combining local inference, cloud-model fallbacks, retrieval, voice, and animation in one personal AI assistant.
| Slow news day.. Core: Hardware IVY's brain (the language models) Memory Voice and hearing (PC) Face (3090) Creative and teacher models on the 3090 (llama-swap, loaded on demand) submitted by /u/Fabulous_Fact_606 [link] [comments] |
#IVY#Qwen3.8-27B#DeepSeek#Claude Opus 5.5#Claude Sonnet 5.5#Claude Haiku 5.5#llama-swap#NVIDIA cuVS#Qwen3-Embedding-8B#Qwen3-Reranker-4B#Breeze TTS 2#Qwen3-ASR