Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Reddit user details an IVY assistant spanning local and cloud models

AI summary

A Reddit user described building IVY, an assistant that combines local Qwen3.8-27B inference on two RTX 3090 GPUs with DeepSeek and Claude models hosted in the cloud. The system also includes a web chat, voice and facial-animation pipelines, GPU-accelerated retrieval, and additional creative models served through llama-swap. The post provides a detailed personal build account, but its claims are not independently verified.

In-depth insight

The post offers a concrete example of combining local inference, cloud-model fallbacks, retrieval, voice, and animation in one personal AI assistant.

Slow news day.. Core: Hardware IVY's brain (the language models) Memory Voice and hearing (PC) Face (3090) Creative and teacher models on the 3090 (llama-swap, loaded on demand) submitted by /u/Fabulous_Fact_606 [link] [comments]

#IVY#Qwen3.8-27B#DeepSeek#Claude Opus 5.5#Claude Sonnet 5.5#Claude Haiku 5.5#llama-swap#NVIDIA cuVS#Qwen3-Embedding-8B#Qwen3-Reranker-4B#Breeze TTS 2#Qwen3-ASR

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.