Nemotron

Headlines · 5

1. 3h
   Kapitsa: open-source Apple Silicon inference engine tuned for Qwen and Nemotron

   Developer Ye at Nace.ai posted Kapitsa on r/LocalLLaMA, an Apache 2.0 open-source inference engine for Apple Silicon aimed at running coding agents on local models on Macs. Kapitsa supports only two model families — Qwen (3.5 4B, 3.8 27B, 3.6 35B-A3B and 3.8 Flash-Next) and NVIDIA Nemotron (3.5 Lightning, Bolt, Super-VL plus Dory 4B) — so the team can customize Metal kernels per architecture. The author published decode-speed tables on M1 Pro 16GB, M4 Pro 48GB and M5 Max 128GB machines, claiming it beats mlx-serve, oMLX, Ollama, MLX and llama.cpp in most cases, while trailing mlx-serve and oMLX by roughly 2-3% on Qwen3.8 Flash-Next. He also warns readers not to trust benchmarks, points them to a built-in kapitsa bench command to test themselves, notes that 4-bit quantization costs some quality, and says the new codebase should be expected to have bugs.

   r/LocalLLaMA · 🔥 5
2. 3d
   AI safety worries mount as the industry keeps racing ahead

   This week's enterprise AI roundup reports that after a run of "rogue agent" incidents, more government officials are calling for regulation, several states are suing OpenAI, about 400 scientists urged global AI oversight, and Microsoft's president said AI is less regulated than a carton of milk. On the money side, Anthropic told investors revenue grew 45% sequentially to $16.8B in Q3, a slowdown that could pull its planned IPO valuation from $2T toward $1.5T, while CoreWeave's debt load weighed on neocloud and supplier shares. On models and products, Meta released the 816B-parameter open-weight Muse Spark Open for coding and agent work plus Muse Wonder for personal and professional agents, Nvidia expanded its Nemotron family, and Grok Voice 3.0, Gemini 4 Argon and Microsoft's Maia 300 also arrived, alongside news that Character.AI filed for bankruptcy.

   SiliconANGLE AI · 🔥 0
3. 3d
   Nvidia's nearly $40B AI deal spree signals a frontier-model pivot

   An analysis by PingWest says Nvidia has arranged nearly $40 billion in AI deals over the past year involving Poolside, Hugging Face, Groq, Essential AI and Reflection, through licensing, investment, hiring and acquisitions. It reports a $6 billion Poolside technology license plus a $1 billion investment, an announced roughly $12.93 billion Hugging Face acquisition that is still pending, and a Groq licensing deal that media reports put near $20 billion though the companies did not disclose terms. The article argues Nvidia is moving from an AI infrastructure supplier toward a company that also builds frontier intelligence, while cautioning that these arrangements are not all paid acquisition cash.

   品玩 实时要闻 · 🔥 0
4. Oct 10
   Nvidia in talks to acquire or invest more in open-weight startup Reflection AI

   Nvidia is in advanced but early-stage talks to acquire US open-weight model startup Reflection AI or to increase its investment in the company, according to Financial Times sources, who cautioned the negotiations could still fall apart. The structure is undetermined: it could be an acquihire that absorbs the core team and licenses technology to avoid lengthy antitrust review, a new equity round, or a partnership giving Reflection more chips and compute; Bloomberg reported Nvidia is discussing boosting its investment or offering computing power. Reflection AI released its first open-weight model, Beam, on October 5; Nvidia had already invested $800 million and the startup was valued at about $25 billion in its March funding round. Both companies declined to comment.

   Techmeme · 🔥 0
5. Oct 7
   Fine-Tuned Nemotron Reports Gold-Level IOI and IMO Results

   A Hugging Face post reports gold-level results after fine-tuning Nemotron for the International Olympiad in Informatics (IOI) and International Mathematical Olympiad (IMO). The provided source contains no further details about the fine-tuning method or results.

   Hugging Face · 🔥 0

Experience and discussion from the community

Share my Nemotron experienceAsk about Nemotron