Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

ICLR 2027 review scores cluster around 2

AI summary

An analysis submitted by /u/latenticlabs counted 73,410 public OpenReview reviews covering 23,759 ICLR 2027 submissions. It reports that 57% of reviews received a 2 and 1.5% received a 4, while the median paper averaged 2.0. A 2, 2, 3 combination, averaging 2.33, was above most papers. The histogram was based on the first 25,000 of roughly 40,800 submissions in OpenReview's listing order, read on November 6, rather than a random sample. The accompanying page, built by the analysis authors, shows counts only.

In-depth insight

The analysis provides an initial empirical view of how ICLR 2027's new four-point review scale is being applied.

ICLR 2027 moved to a 4-point scale (1 clear reject, 2 weak reject, 3 weak accept, 4 clear accept), so nobody has a feel yet for what a given set of scores means. We counted the public scores on OpenReview: 73,410 reviews on 23,759 submissions.

A couple of things that surprised us: [1] 57% of all reviews are a 2. Only 1.5% are a 4. [2] The median paper averages exactly 2.0.

So a 2, 2, 3 (mean 2.33) is already above most papers. Where 2.5, 2.67 and 3.0 land, and the full histogram, are here:

https://draft.scime.ai/iclr-odds?utm\_source=reddit&utm\_medium=social&utm\_campaign=iclr2027

Note: [1] we built the page. It shows counts only: no titles,

authors or review text.

[2] this is the first 25,000 of ~40,800 submissions in.

OpenReview's listing order, read Nov 6, not a

random sample.

submitted by /u/latenticlabs [link] [comments]

#ICLR 2027#OpenReview#latenticlabs

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.