KL-Shampoo
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Reddit user questions OKLS step efficiency versus Muon
A Reddit post asks why OKLS, described as a zero-staleness implementation of KL-Shampoo, may be outperformed by Muon in step efficiency. The submitter claims that SOAP is more step-efficient than Shampoo, KL-Shampoo is more step-efficient than SOAP, and OKLS only surpasses Muon in parameter efficiency during very long training runs. The supplied post does not include benchmark measurements, implementation details, or responses that resolve these comparisons.
r/MachineLearning · 🔥 0
Experience and discussion from the community
Share my KL-Shampoo experienceAsk about KL-Shampoo
Nobody has shared their experience with KL-Shampoo yet.