Independent Audit Questions TRIBE v2 Brain-Map Fidelity
A solo, self-funded audit reported by r/MachineLearning tested whether Meta's TRIBE v2 recovers canonical fMRI maps using classic visual, auditory and motion stimuli plus a synthetic control. It found no significant retinotopy or tonotopy, but sharp motion selectivity localized to MT+ with an effect size of d=4.31 and a reported 52-fold enrichment over chance. The apparent eccentricity signal changed under three stimulus-geometry controls and was interpreted as an image-statistics confound rather than a positional code.
The audit suggests that TRIBE v2 may recover strong category-specific motion selectivity without reproducing spatial retinotopic or frequency-based tonotopic organization, highlighting the importance of testing brain-encoding models against canonical functional maps.
TRIBE v2 predicts fMRI from video/audio/text. Its own paper never tested whether it reproduces classic topographic maps (retinotopy, tonotopy, motion selectivity) — and its methods section admits video features get spatially averaged before prediction, which should wreck position info. Nobody checked. I ran the classic mapping stimuli (checkerboard wedges/rings, hemifield flicker, moving dots, tone sweeps) through it and fit the same models you'd fit to real fMRI, validated against a synthetic ground-truth control first.
Results: no retinotopic map (d=0.05, n.s.), no tonotopic map (ρ=-0.07, n.s., even with loudness controlled), but motion selectivity is sharp and lands precisely in MT+ (d=4.31, 52x enrichment over chance).
The fun part: eccentricity looked null by default, but flipped to significant and "correct" under three separate stimulus-geometry controls — a classic image-statistics confound masquerading as a positional code, not a real signature of position.
Solo project, self-funded, code+paper here: https://jakubstrawa1.github.io/audit-multimodal-brain-response/
Curious if anyone's seen this WHERE-vs-WHAT dissociation checked in other brain-encoding or video models — feels like it should generalize.
submitted by /u/Own_Tank1283 [link] [comments]