创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

开源仓库汇集20项Transformer可解释性研究

AI 总结

BedFalse6021分享了一个开源仓库,其中包含20项关于下一概念建模、机制可解释性和模型控制的探索性研究。作者称,这是一个独立项目,用于记录Transformer处理和编辑内部特征的实验。仓库涵盖数独等结构化任务、包括IOI在内的GPT-2可解释性实验,以及玩具并行模型。每次运行均附有源代码、保存结果和解释,混合结果与负面结果也均有分类。作者表示,该项目没有取得性能突破,并且规划和编码阶段大量使用了AI工具。

深度见解

公开源代码、保存结果、解释和分类记录的负面结果,使实验设置和观察结果可供检查,也便于他人尝试复现。原报告没有说明这些发现是否经过独立验证。

Hi everyone,

I wanted to share an open-source repo collecting 20 exploratory studies focused on Next-Concept Modeling (NCM), mechanistic interpretability (like IOI in GPT-2), and model controls.

Link: https://github.com/Quantix-eng/ncm-experiment-notes

This is an independent project documenting empirical experiments on how transformers process and edit internal features. No performance breakthroughs here—just honest documentation of observations alongside rigorous controls.

The repo covers NCM on structured tasks (like Sudoku), mechanistic interpretability in GPT-2, and toy parallel models. I've included all source code, saved results, and interpretations for every run.

For full transparency, I’ve categorized every outcome, including the mixed and completely negative results. AI tools were also heavily used during the planning and coding phases.

Would love to get your feedback on the setups or interpretation limits.

submitted by /u/BedFalse6021 [link] [comments]

#ncm-experiment-notes#GPT-2#Next-Concept Modeling

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。