SO-101 Bench adds a digital-twin benchmark for spatial robot manipulation
Truman Hickok’s paper introduces SO-101 Bench, an Isaac Lab digital twin of a physical SO-101 setup for language-conditioned spatial manipulation. It includes four tasks, 138 objects across seen, unseen-instance and unseen-class splits, 916 evaluation episodes and 3,629 simulated demonstrations; the digital twin reproduced the physical arm’s policy ranking with Spearman rho of 1.00, although simulation overestimated success. Across nine VLAs and world-action models, the best learned policies scored nearly 61%, while an LLM agent combining code generation with a learned grasping policy reached 83.2%.
The benchmark provides a low-cost simulation environment with held-out-object evaluation and physical-robot validation, making it directly relevant to embodied-AI research on inexpensive robot arms.
Computer Science > Computer Vision and Pattern Recognition
arXiv:2610.36420 (cs)
[Submitted on 27 Oct 2026]
Title:SO-101 Bench: Accessible Spatial Manipulation
Authors:Truman Hickok
View a PDF of the paper titled SO-101 Bench: Accessible Spatial Manipulation, by Truman Hickok