Paper proposes WebHarbor, 153 Dockerized website environments for GUI agents
A paper submitted to arXiv proposes WebHarbor, a suite of 153 executable, Dockerized website environments with 3,518 tasks, built to reconstruct real web services under deterministic control and to span multi-step and post-authentication workflows. The authors report that a Qwen 4B-level GUI agent trained with reinforcement learning in WebHarbor generalizes to unseen tasks and performs competitively with leading open-source GUI web agents across four benchmarks. The code and data are publicly available.
The authors state that live website evaluation suffers from changing content, access restrictions, and limited coverage of authenticated workflows, while existing synthetic training environments often lack functional depth and visual fidelity. WebHarbor targets those gaps with stable, deterministic environments for both evaluation and cost-efficient reinforcement learning.
Computer Science > Artificial Intelligence
arXiv:2611.03634 (cs)
[Submitted on 2 Nov 2026]
Title:WebHarbor: Docking Real Websites for Evolving GUI Agent Environments
Authors:Zhaoyang Wang, Qianhui Wu, Boyu Gou, Demi Wang, Jiacheng Zhang, Peichun Hua, Qize Li, Shi Qiu, Yifan Jiang, Yifan Zhang, Zexu Jin, Baolin Peng, Bolin Shen, Chetan Bansal, Dehan Kong, Deren Lei, Dongshen Peng, Fengqing Jiang, Hao Cheng, Haoqing Wang, Jiaming Shan, Jicheng Wang, Jingguang Zhou, Jixuan He, Kaide Zeng, Kangyu Zhu, Lama Moukheiber, Mufan Qiu, Peng Xia, Qihan Sun, Qingwei Lin, Qiushi Sun, Ruichen Zhang, Shuqing Luo, Si Qin, Sicheng Fan, Tao Xiong, Wenlin Yao, Xinyu Zhang, Xinyue Zeng, Xuanrui Li, Xuchao Zhang, Yian Wang, Yichao Liu, Yiming Liang, Yiyang Zhou, Yizhu Jiao, Yuetai Li, Yurun Chen, Yuxuan Zhang, Zheyuan Yang, Zhiyuan Yao, Zhongyang Li, Zihao Li, Zili Wang, Jianfeng Gao, Huaxiu Yao
View a PDF of the paper titled WebHarbor: Docking Real Websites for Evolving GUI Agent Environments, by Zhaoyang Wang and 56 other authors