GPT-OSS-20B

Headlines · 4

1. 3d
   Generic Feedback Matches Detailed Critiques in Fin-SD Study

   The Fin-SD researchers report applying hindsight self-distillation to GPT-OSS-20B for multi-step financial reasoning, where a student locates its first incorrect step and generates a critique before a frozen copy distills the result back under reverse KL. The author-linked Reddit summary says a fixed generic feedback line matched the roughly three-point gain from detailed self-written critiques, while critiques from a model six times larger did not materially improve performance; Fin-SD also matched OPSD trained with full reference solutions while using 9.5% fewer tokens.

   r/MachineLearning · 🔥 0
2. Oct 23
   AWS Adds a Hands-On Multi-Turn RL Guide for SageMaker AI

   AWS Machine Learning Blog published an end-to-end guide to multi-turn reinforcement learning (MTRL) on Amazon SageMaker AI, covering agent deployment, dataset preparation, training, MLflow monitoring and evaluation at serving settings. The workflow trains a policy using a reward for the outcome of an entire multi-step episode, without requiring the correct action trajectory, and supports agents hosted on Bedrock AgentCore or customer infrastructure. In AWS’s Wordle example, the company reports that gpt-oss-20b improved from 61% to 84% solve rate at default reasoning effort and from 15% to 69% at its trained low-effort setting, costing about $339 in training tokens.

   AWS Machine Learning Blog · 🔥 0
3. Oct 22
   Modal Releases Open-Source Spindle Training Server

   Modal released Spindle, an open-source training server compatible with Thinking Machines' Tinker API that runs in a user's Modal workspace. It supports full-parameter training and multi-LoRA for open models, while users control the server and pay for GPU time rather than tokens. Modal says its default configurations are tuned to maximize GPU utilization and that Spindle can support hundreds of concurrent training runs at similar performance and lower cost than closed-source APIs; the release remains in beta.

   Modal Blog · 🔥 0
4. Oct 20
   AWS fine-tunes GPT-OSS-20B for multilingual reasoning

   AWS Machine Learning Blog reports that supervised fine-tuning raised GPT-OSS-20B’s reasoning-language accuracy from 22% to 100% on a 50-case test covering English, French, German, Spanish and Italian. Applying GRPO after SFT increased answer-language accuracy from 62% to 70%, while a Qwen2.5-7B control experiment added 6 points on multilingual reasoning but produced no gain on GSM8K.

   AWS Machine Learning Blog · 🔥 0

Experience and discussion from the community

Share my GPT-OSS-20B experienceAsk about GPT-OSS-20B