Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

llama-swap

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. Reddit user details an IVY assistant spanning local and cloud models

    A Reddit user described building IVY, an assistant that combines local Qwen3.8-27B inference on two RTX 3090 GPUs with DeepSeek and Claude models hosted in the cloud. The system also includes a web chat, voice and facial-animation pipelines, GPU-accelerated retrieval, and additional creative models served through llama-swap. The post provides a detailed personal build account, but its claims are not independently verified.

    r/LocalLLaMA · 🔥 0
  2. Berth v0.3 parks local AI engines in system RAM to speed GPU switching

    Berth, a system service its developer describes in a r/LocalLLaMA post, watches the GPU and swaps and loads whichever engine the user wants, so that VRAM is dedicated to each running function without manual swaps or leftover processes holding memory. The developer has released v0.3, which parks engines in system RAM instead of unloading them, so switching back to a parked engine skips the reload from disk. They are looking for testers with 64, 96 or 128 GB of RAM and a 24 GB card, multi-GPU machines, Windows with an NVIDIA card, and AMD on Linux, noting that their own 62 GB workstation cannot measure parking at larger sizes because Strata alone pins 40 GB.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my llama-swap experienceAsk about llama-swap

Nobody has shared their experience with llama-swap yet.