StarSkirmish Bench v0.2: GPT-6 Astra tops LLM StarCraft bot ranking
StarSkirmish Bench v0.2 gives each large model one hour to write a Protoss bot in C++ for StarCraft: Brood War, then scores it by win rate against human-written and demo bots. GPT-6 Astra leads with 57, followed by GPT-6.1 Sol at 46, with Gemini 4 Argon and Claude Opus 5.5 tied at 39, Claude Fable 5.1 at 37, then Claude Sonnet 5.5 (26), Muse Wonder Full and Claude Haiku 5.5 (21) and GPT-6 Luna (13). Even the best model, GPT-6 Astra, wins only about 7% of games against top human-written bots Stardust, PurpleWave and BananaBrain, so the benchmark is far from saturated; practicing against strong opponents is the strongest predictor of a model's score, with Claude Fable 5.1 a clear outlier.
It offers a cross-model view of long-horizon agentic coding, showing frontier models can autonomously refine game bots yet remain well behind top human-written ones.