Jayden Teoh
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 2
- Richard Sutton Says Raw Compute Alone Is Not Enough for Intelligence
In a new post on X, Turing Award winner Richard Sutton argues that raw compute by itself cannot produce intelligence and that AI science needs clever new methods, describing the field as "far from finished." The Decoder notes Sutton has previously criticized the limits of simply scaling large language models, called synthetic data a "big mistake," and advocated agents with world models that keep learning from their own experience. Researchers Jerry Tworek and Jayden Teoh responded to Sutton's framing, while OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei argue that LLM scaling is far from exhausted.
The Decoder · 🔥 0 - Soft-MTP Recovers a Cleaner Signal for Multi-Token Prediction
Jayden Teoh's preprint “Multi-Token Prediction Done Right” introduces Soft-MTP, a gradient-recovery method that separates a KL self-distillation signal from noisy residual components in standard multi-token prediction training. The paper reports that Soft-MTP can be implemented as a one-line change, supports DeepSeek- and Meta-style MTP, adds no parameters, and showed lower perplexity, faster speculative decoding, and higher zero-shot accuracy across model sizes from 167M to 1.2B. These gains are reported by the paper's author and have not been independently corroborated in the supplied sources.
r/MachineLearning · 🔥 0
Experience and discussion from the community
Share my Jayden Teoh experienceAsk about Jayden Teoh
Nobody has shared their experience with Jayden Teoh yet.