ICLR 2027评审分数集中于2分
由/u/latenticlabs提交的一项分析统计了OpenReview上73,410条ICLR 2027公开评审,涉及23,759篇投稿。分析称57%的评审打了2分,1.5%打了4分,论文平均分中位数为2.0。2、2、3的组合平均分为2.33,已高于多数论文。直方图基于11月6日读取的OpenReview列表中前25,000篇投稿,投稿总数约为40,800篇,并非随机样本。配套页面由分析作者制作,只展示计数。
这项分析为观察ICLR 2027新四级评分制的实际使用情况提供了初步的经验视角。
ICLR 2027 moved to a 4-point scale (1 clear reject, 2 weak reject, 3 weak accept, 4 clear accept), so nobody has a feel yet for what a given set of scores means. We counted the public scores on OpenReview: 73,410 reviews on 23,759 submissions.
A couple of things that surprised us: [1] 57% of all reviews are a 2. Only 1.5% are a 4. [2] The median paper averages exactly 2.0.
So a 2, 2, 3 (mean 2.33) is already above most papers. Where 2.5, 2.67 and 3.0 land, and the full histogram, are here:
https://draft.scime.ai/iclr-odds?utm\_source=reddit&utm\_medium=social&utm\_campaign=iclr2027
Note: [1] we built the page. It shows counts only: no titles,
authors or review text.
[2] this is the first 25,000 of ~40,800 submissions in.
OpenReview's listing order, read Nov 6, not a
random sample.
submitted by /u/latenticlabs [link] [comments]