Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Cajal-1: an open 218M-parameter whole-cortex fMRI encoding model

AI summary

A developer posting on Reddit's r/MachineLearning released Cajal-1, a 218-million-parameter whole-cortex encoding model trained on fMRI data from 2,000 people's brains as they watched films, TV and images. The author says the model predicts fMRI responses at 20,484 points across the human cortex every 1.49 seconds for any video, podcast or song, without a scanner, and claims it is 25% more accurate than Meta's TRIBE v2 on held-out films, tracking the real brain more closely in 27 of 32 recordings. The model and a Colab demo are open on Hugging Face; the comparison is self-reported and has not been independently verified.

In-depth insight

The author reports it outperforms Meta's TRIBE v2 on held-out films and has released the model plus a Colab demo openly, making a whole-cortex fMRI response predictor available for outside researchers to test.

I built and trained a 218-million-parameter model on fMRI data from 2,000 peoples brains as they watched films, TV, and images.

Cajal-1.

On the films Meta held out to test TRIBE v2, Cajal-1 is 25% more accurate and closer to the real brain in 27 of 32 recordings.

Give it any video, podcast, or song, and it predicts fMRI responses at 20,484 points across the human cortex every 1.49 seconds. Same speed, no scanner needed.

It's named after Santiago Ramón y Cajal, the first Spaniard to win a Nobel Prize in science. In the 1890s, he used Golgi's silver stain (of Golgi Body fame) to draw neurons by hand and showed that the brain is built from separate cells. A century later, we can predict how these cells respond brain-wide to any stimulus we come across.

The model and a Colab demo are now open:

https://huggingface.co/ffh92r32rm0/Cajal-1

#Cajal-1#TRIBE v2#Meta#Hugging Face

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.