Einsia launches Frontier3DBench for coding agents in 3D worlds
Einsia released Frontier3DBench, a benchmark with 145 tasks across nine categories that tests 11 model-harness configurations producing editable Blender projects and runnable Unreal Engine worlds. Evaluation covers appearance, structure and behavior through rendered views, scene inspection and runtime tests. Einsia reports that GPT-6.1-sol led overall, while GPT-6-astra led interactive-world tasks and MiniMax-M3.1-Flash ranked second in scene editing.
The benchmark targets whether coding agents can transfer from generating individual 3D assets to building coordinated, interactive environments, and it reports a large gap between local mechanisms and stateful workflows.
Can the same coding agent build a detailed 3D object, assemble a scene, and make an interactive world actually work?
Our team at Einsia released Frontier3DBench to test that progression: 145 tasks across 9 categories, with 11 model–harness configurations producing editable Blender projects and runnable Unreal Engine worlds.
Evaluation covers appearance, structure, and behavior through rendered views, scene inspection, and runtime tests.
A few results:
- GPT-6.1-sol leads overall and on objects and scenes, while GPT-6-astra leads interactive worlds.
- MiniMax-M3.1-Flash ranks sixth overall but second on scene editing.
- Every configuration scores lower on reference-based reconstruction than text-driven generation in both object and scene tasks.
- Across 165 world submissions, local mechanisms score much higher than stateful workflows: 83.08 vs. 30.26 out of 100.
The interesting question is how well an agent’s strengths carry over from individual assets to environments with coordinated interactions and persistent state.
Project and examples: https://lab.einsia.ai/frontier3dbench Paper: https://lab.einsia.ai/frontier3dbench/Frontier3DBench.pdf GitHub: https://github.com/Einsia/Frontier3D
submitted by /u/OliviaYii [link] [comments]
#Einsia#Frontier3DBench#GPT-6.1-sol#GPT-6-astra#MiniMax-M3.1-Flash#Blender#Unreal Engine