Mirai

Headlines · 2

1. Nov 1
   2.3bpw Qwen 27B checkpoint targets 200K context on 12GB Ampere cards

   Developer JakeATX released an updated 2.3bpw Qwen 27B checkpoint using the new AmperInteger+ quantization format, which combines fractional 2–3-bit weights, trellis-based encoding, and an RCO-like optimization. He reports that the checkpoint scored 84.3% on LiveCode Bench with a strict grader across three runs, compared with 83.9% for Qwen3.6 27B BF16 and 90.3% for Qwen3.8 BF16. Using a custom SJKVaRN build and runtime changes, he says the 7.4GiB on-card checkpoint can support 200K-token context on a single 12GB Ampere card.

   r/LocalLLaMA · 🔥 0
2. Oct 31
   Anthropic warns small AI models could enable self-replicating botnets

   Engadget reports that Anthropic's Frontier Red Team found small AI models may be only months away from replicating and spreading across insecure devices, creating slow, hard-to-kill autonomous botnets. Experts broadly agreed that such capability could emerge in the near future, but Georgia Tech professor Michael Bailey disputed the characterization of the emulation as full self-replication. He said it demonstrated sharding and device hopping in a network where the exploit was trivial, rather than worm-like propagation, and that Anthropic did not attempt model retraining. Anthropic suggested that internet service providers notify customers of infections and limit infected devices to a safe list of websites, as well as possible regulation. Bailey separately emphasized patching, device isolation, strong passwords and security hygiene.

   Engadget AI · 🔥 0

Experience and discussion from the community

Share my Mirai experienceAsk about Mirai

All

uzu•4d Pinned

uzu: A high-performance inference engine for AI models.

What problem it solves Developers need to run AI models inside applications while handling model downloads, inference configuration, and chat sessions. The project presents local inference with data privacy and no inference costs as its deployment model. Key features High-level application API — The engine exposes a simple API for creating an engine, loading a model, opening a chat session, and re…

github.comhttps://github.com/trymirai/uzu