Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Berth

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. Berth v0.4.1 brings alpha GPU scheduling for local AI workloads

    Berth v0.4.1 is presented as an alpha, Go-based GPU resource manager for sharing local AI, image-generation, voice, and gaming workloads. The Reddit project post says it provides leases, priority queues, engine switching, monitoring, multi-GPU management, an OpenAI-compatible gateway, and integrations including Claude Code and Codex; these capabilities were not independently verified.

    r/LocalLLaMA · 🔥 0
  2. Berth v0.3 parks local AI engines in system RAM to speed GPU switching

    Berth, a system service its developer describes in a r/LocalLLaMA post, watches the GPU and swaps and loads whichever engine the user wants, so that VRAM is dedicated to each running function without manual swaps or leftover processes holding memory. The developer has released v0.3, which parks engines in system RAM instead of unloading them, so switching back to a parked engine skips the reload from disk. They are looking for testers with 64, 96 or 128 GB of RAM and a 24 GB card, multi-GPU machines, Windows with an NVIDIA card, and AMD on Linux, noting that their own 62 GB workstation cannot measure parking at larger sizes because Strata alone pins 40 GB.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Berth experienceAsk about Berth

Nobody has shared their experience with Berth yet.