DeepSpeed

Headlines · 4

1. 4d
   Developer releases sdft_zero3 for self-distillation under ZeRO-3

   Developer ifiaposto released sdft_zero3, a plug-and-play GitHub repository combining self-distillation with an EMA teacher, ZeRO-3, and PEFT. The author says it includes LoRA adapter switching for teacher and student passes, resumable EMA teacher checkpoints, and DeepSpeed configurations intended to address memory spikes. The author reports testing the method with Qwen3.5 and ToolAlpaca.

   r/MachineLearning · 🔥 0
2. Oct 19
   Biren raises about HK$17B in three rounds as stock falls ~65% from peak

   A Mktcap column republished by TMTPost says Biren Technology listed on the Hong Kong exchange on January 2 as the city's first GPU stock, raising HK$6.204 billion net, then completed discounted placements in July and on October 8, bringing total fundraising to about HK$17 billion in under ten months. The October placement was priced at HK$31.08; the shares closed at HK$30.36 that day, down 11.85%, and fell to HK$24.98 by October 15, roughly 65% below the HK$70.75 peak. The article says Biren is not short of cash — first-half 2026 revenue was RMB 1.236 billion, up about 20 times year on year, with RMB 4.86 billion of bank deposits at end-June — and that roughly 70% of the new placement goes to supply-chain procurement and production preparation for its next product; it cites a Daiwa note saying management raised its 2027 revenue guidance to RMB 20 billion from RMB 10 billion, and notes BR20X has been powered on and entered post-tape-out validation, with sampling slated for Q4 2026 and volume deployment in 2027.

   钛媒体 · 🔥 0
3. Oct 15
   Soup CLI v0.76.0 refuses config settings that never took effect

   Soup, an open-source LLM fine-tuning CLI, shipped v0.76.0, which now refuses to load settings that were previously accepted but never actually applied — including training.quantization_aware: true, training.use_longlora and backend: unsloth on several tasks — so configs that loaded before may now fail, and the project advises running soup doctor --config soup.yaml first. The tool pitches one-command, single-YAML fine-tuning and an opt-in, still-BETA layer-streaming mode (stream_layers: true) that it says can LoRA fine-tune an 8B model on a 4 GB laptop GPU. The README also records a silent wrong-gradient defect on NF4 above roughly 165 MiB per layer that has been repaired, and notes that throughput figures from before and after the fix are not directly comparable.

   GitHub Trending · Python · 🔥 0
4. Oct 11
   Hugging Face Transformers tops GitHub Trending

   Hugging Face's Transformers library appeared on GitHub Trending's daily list. The project positions itself as the model-definition framework for state-of-the-art text, vision, audio, video and multimodal models, for both inference and training, and its documentation says there are over 1M Transformers model checkpoints on the Hugging Face Hub. It says the library interoperates with training frameworks such as Axolotl, Unsloth, DeepSpeed, FSDP and PyTorch-Lightning, and with inference engines and modeling libraries including vLLM, SGLang, TGI, llama.cpp and mlx, and requires Python 3.10+ and PyTorch 2.6+.

   GitHub Trending（每日） · 🔥 0

Experience and discussion from the community

Share my DeepSpeed experienceAsk about DeepSpeed