Fin-SD
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Generic Feedback Matches Detailed Critiques in Fin-SD Study
The Fin-SD researchers report applying hindsight self-distillation to GPT-OSS-20B for multi-step financial reasoning, where a student locates its first incorrect step and generates a critique before a frozen copy distills the result back under reverse KL. The author-linked Reddit summary says a fixed generic feedback line matched the roughly three-point gain from detailed self-written critiques, while critiques from a model six times larger did not materially improve performance; Fin-SD also matched OPSD trained with full reference solutions while using 9.5% fewer tokens.
r/MachineLearning · 🔥 0
Experience and discussion from the community
Share my Fin-SD experienceAsk about Fin-SD
Nobody has shared their experience with Fin-SD yet.