Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

CogGym

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. CogGym tests 50 language models on 258 psychology experiments

    According to 掘金 · 人工智能, the MIT-led CogGym project standardized 258 cognitive-science experiments in a task-independent EML format and tested 50 language models against recorded human responses. The best model reached R² scores of 0.59 for text, 0.58 for images, and 0.43 for video, compared with human reliabilities of 0.93, 0.95, and 0.92. Performance improved with model scale, but common-sense reasoning advanced more slowly than mathematical and programming capabilities, while repeated sampling produced overly sharp response distributions.

    掘金 · 人工智能 · 🔥 0

Experience and discussion from the community

Share my CogGym experienceAsk about CogGym

Nobody has shared their experience with CogGym yet.