USDCraft: LLM-written programs build articulated 3D assets for robot simulation
An arXiv paper introduces USDCraft, a framework in which a pretrained LLM writes and revises executable programs to turn partial or corrupted meshes into simulation-ready articulated USD assets, without task-specific training. It uses source geometry analysis, which converts the source mesh into a metric textual description separating observed surface from unknown space, plus iterative geometric rechecking that re-encodes each candidate so discrepancies point to program edits. The authors report leading articulation recovery on two benchmarks and validate the approach in real-to-sim-to-real robot manipulation, with assets loading into Isaac Sim without manual adjustment.
If it reproduces reliably, LLM-driven code generation for simulation assets could cut the manual modelling burden in robot sim-to-real pipelines.
Computer Science > Robotics
arXiv:2610.11322 (cs)
[Submitted on 8 Oct 2026]
Title:USDCraft: Geometrically Grounded Programmatic Modeling of Articulated 3D Assets for Simulation
Authors:Chuanrui Zhang, Zaijia Yang, Duomin Wang, Lu Shi, Daquan Zhou, Ruihua Zhang, Ziwei Wang
View a PDF of the paper titled USDCraft: Geometrically Grounded Programmatic Modeling of Articulated 3D Assets for Simulation, by Chuanrui Zhang and 6 other authors