ICLR 2027 review scores cluster around 2
An analysis submitted by /u/latenticlabs counted 73,410 public OpenReview reviews covering 23,759 ICLR 2027 submissions. It reports that 57% of reviews received a 2 and 1.5% received a 4, while the median paper averaged 2.0. A 2, 2, 3 combination, averaging 2.33, was above most papers. The histogram was based on the first 25,000 of roughly 40,800 submissions in OpenReview's listing order, read on November 6, rather than a random sample. The accompanying page, built by the analysis authors, shows counts only.
The analysis provides an initial empirical view of how ICLR 2027's new four-point review scale is being applied.
ICLR 2027 moved to a 4-point scale (1 clear reject, 2 weak reject, 3 weak accept, 4 clear accept), so nobody has a feel yet for what a given set of scores means. We counted the public scores on OpenReview: 73,410 reviews on 23,759 submissions.
A couple of things that surprised us: [1] 57% of all reviews are a 2. Only 1.5% are a 4. [2] The median paper averages exactly 2.0.
So a 2, 2, 3 (mean 2.33) is already above most papers. Where 2.5, 2.67 and 3.0 land, and the full histogram, are here:
https://draft.scime.ai/iclr-odds?utm\_source=reddit&utm\_medium=social&utm\_campaign=iclr2027
Note: [1] we built the page. It shows counts only: no titles,
authors or review text.
[2] this is the first 25,000 of ~40,800 submissions in.
OpenReview's listing order, read Nov 6, not a
random sample.
submitted by /u/latenticlabs [link] [comments]