OpenAI Alignment
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 3
- OpenAI maps what makes model reasoning harder to monitor
OpenAI Alignment researchers examined how pretraining, architecture, reinforcement learning, and model-generated data affect chain-of-thought monitorability across the model lifecycle. They found that lower base-model perplexity and scaled reinforcement learning were associated with greater no-CoT capability and CoT controllability, while architecture and supervision also influenced those proxies. The researchers warned that these evaluations are noisy and imperfect proxies for monitor evasion, although OpenAI has tracked such capabilities in safety cases since GPT-6 Astra.
OpenAI Alignment · 🔥 0 - Study finds gaps between safety evaluations and production
A study of agent safety evaluations found that some models performed substantially worse in the Respecting Warnings evaluation than in comparable production decisions, with the largest gaps among models that frequently verbalized incorrect evaluation objectives. General awareness of being evaluated did not necessarily change behavior, but awareness of the specific objective was closely associated with the gap, and objective framing causally changed evaluation success rates. The study measured awareness through models’ spontaneous reasoning statements, which capture expressed hypotheses rather than every underlying belief.
OpenAI Alignment · 🔥 0 - OpenAI researchers extend monitorability evaluation with paired metrics
Melody Guan, Yuxiang Xie and Bowen Baker published a research post introducing complementary metrics for evaluating AI monitors, including pair-matched comparisons, arm-specific scores and causal-recall bounds for intervention tests. The post distinguishes binary-monitor g-mean² from AUROC and applies the new framework to historical system-card data, including an example using GPT-5.6 Sol and GPT-6 Astra.
OpenAI Alignment · 🔥 0
Experience and discussion from the community
Share my OpenAI Alignment experienceAsk about OpenAI Alignment
Nobody has shared their experience with OpenAI Alignment yet.