exo

Headlines · 1

1. 6d
   TradeMAV’s $109 RAMDeck Hub Crowdfunds Multi-Device AI Inference

   TradeMAV is crowdfunding RAMDeck on Indiegogo for $109, offering a low-power hub that coordinates model inference across Windows PCs, Macs, Linux systems and Android phones. It divides model layers among devices rather than merging their RAM at the hardware level, building on llama.cpp’s free RPC backend and adding device discovery, layer placement, failure recovery, a dashboard and an OpenAI-compatible API. Vendor demonstrations showed fast MoE results but much slower dense-model performance of around two tokens per second, while the hub’s processor, memory, ports and power draw remain undisclosed.

   TechRadar · 🔥 0

Experience and discussion from the community

Share my exo experienceAsk about exo