English
Related papers

Related papers: MobileGym: A Verifiable and Highly Parallel Simula…

200 papers

Current mobile GUI agent benchmarks systematically fail to assess memory capabilities, with only 5.2-11.8% memory-related tasks and no cross-session learning evaluation. We introduce MemGUI-Bench, a comprehensive memory-centric benchmark…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Guangyi Liu , Pengxiang Zhao , Yaozhen Liang , Qinyi Luo , Shunye Tang , Yuxiang Chai , Weifeng Lin , Han Xiao , WenHao Wang , Siheng Chen , Zhengxi Lu , Gao Wu , Hao Wang , Liang Liu , Yong Liu

We introduce a novel virtual robotic toolkit myGym, developed for reinforcement learning (RL), intrinsic motivation and imitation learning tasks trained in a 3D simulator. The trained tasks can then be easily transferred to real-world…

Robotics · Computer Science 2020-12-23 Michal Vavrecka , Nikita Sokovnin , Megi Mejdrechova , Gabriela Sejnova , Marek Otahal

A central bottleneck for phone-use agents is that controllable, reproducible environments covering real mobile behavior are hard to build at scale. Existing mobile-agent benchmarks have made important progress on evaluation, but they do not…

Mobile graphical user interface (GUI) agents enable AI models to autonomously operate smartphones on behalf of users. However, most existing systems focus primarily on optimizing task accuracy and rely on cloud-hosted models for inference,…

Artificial Intelligence · Computer Science 2026-05-27 Runxi Huang , Liyu Zhang , Shengzhong Liu , Xiaomin Ouyang

Large-scale, high-quality interaction trajectories are essential for advancing mobile Graphical User Interface (GUI) agents. While existing methods typically rely on labor-intensive human demonstrations or automated model exploration to…

Artificial Intelligence · Computer Science 2026-02-02 Linjia Kang , Zhimin Wang , Yongkang Zhang , Duo Wu , Jinghe Wang , Ming Ma , Haopeng Yan , Zhi Wang

Among existing online mobile-use benchmarks, AndroidWorld has emerged as the dominant benchmark due to its reproducible environment and deterministic evaluation; however, recent agents achieving over 90% success rates indicate its…

Computation and Language · Computer Science 2026-01-01 Quyu Kong , Xu Zhang , Zhenyu Yang , Nolan Gao , Chen Liu , Panrong Tong , Chenglin Cai , Hanzhang Zhou , Jianan Zhang , Liangyu Chen , Zhidan Liu , Steven Hoi , Yue Wang

This paper introduces the Structural Optimization gym (SOgym), a novel open-source Reinforcement Learning (RL) environment designed to advance machine learning in Topology Optimization (TO). SOgym enables RL agents to generate physically…

Artificial Intelligence · Computer Science 2024-07-15 Thomas Rochefort-Beaudoin , Aurelian Vadean , Niels Aage , Sofiane Achiche

Understanding the world and explaining it with scientific theories is a central aspiration of artificial intelligence research. Proposing theories, designing experiments to test them, and then revising them based on data are fundamental to…

Machine Learning · Computer Science 2025-10-16 Kanishk Gandhi , Michael Y. Li , Lyle Goodyear , Agam Bhatia , Louise Li , Aditi Bhaskar , Mohammed Zaman , Noah D. Goodman

PC-Gym is an open-source tool for developing and evaluating reinforcement learning (RL) algorithms in chemical process control. It features environments that simulate various chemical processes, incorporating nonlinear dynamics,…

In order to practically implement the door opening task, a policy ought to be robust to a wide distribution of door types and environment settings. Reinforcement Learning (RL) with Domain Randomization (DR) is a promising technique to…

Robotics · Computer Science 2022-05-25 Yusuke Urakami , Alec Hodgkinson , Casey Carlin , Randall Leu , Luca Rigazio , Pieter Abbeel

Despite promising progress in reinforcement learning (RL), developing algorithms for autonomous driving (AD) remains challenging: one of the critical issues being the absence of an open-source platform capable of training and effectively…

Machine Learning · Computer Science 2021-11-16 Parth Kothari , Christian Perone , Luca Bergamini , Alexandre Alahi , Peter Ondruska

In this paper, we propose Rogue-Gym, a simple and classic style roguelike game built for evaluating generalization in reinforcement learning (RL). Combined with the recent progress of deep neural networks, RL has successfully trained…

Machine Learning · Computer Science 2019-06-04 Yuji Kanagawa , Tomoyuki Kaneko

Development of applications related to closed-loop control requires either testing on the field or on a realistic simulator, with the latter being more convenient, inexpensive, safe, and leading to shorter development cycles. To address…

Evaluating the scientific discovery capabilities of large language model based agents, particularly how they cope with varying environmental complexity and utilize prior knowledge, requires specialized benchmarks currently lacking in the…

Machine Learning · Computer Science 2025-10-28 Yimeng Chen , Piotr Piȩkos , Mateusz Ostaszewski , Firas Laakom , Jürgen Schmidhuber

Long-horizon planning is widely recognized as a core capability of autonomous LLM-based agents; however, current evaluation frameworks suffer from being largely episodic, domain-specific, or insufficiently grounded in persistent economic…

As AI agents leave the lab and venture into the real world as autonomous vehicles, delivery robots, and cooking robots, it is increasingly necessary to design and comprehensively evaluate algorithms that tackle the ``open-world''. To this…

Artificial Intelligence · Computer Science 2024-06-09 Shivam Goel , Yichen Wei , Panagiotis Lymperopoulos , Klara Chura , Matthias Scheutz , Jivko Sinapov

With the advancement of modern robotics, autonomous agents are now capable of hosting sophisticated algorithms, which enables them to make intelligent decisions. But developing and testing such algorithms directly in real-world systems is…

Robotics · Computer Science 2022-08-16 Emon Dey , Jumman Hossain , Nirmalya Roy , Carl Busart

Reinforcement Learning (RL) is a promising solution, allowing Unmanned Underwater Vehicles (UUVs) to learn optimal behaviors through trial and error. However, existing simulators lack efficient integration with RL methods, limiting training…

Robotics · Computer Science 2024-10-21 Shuguang Chu , Zebin Huang , Mingwei Lin , Dejun Li , Ignacio Carlucho

Driven by inherent uncertainty and the sim-to-real gap, robust reinforcement learning (RL) seeks to improve resilience against the complexity and variability in agent-environment sequential interactions. Despite the existence of a large…

Machine Learning · Computer Science 2025-02-28 Shangding Gu , Laixi Shi , Muning Wen , Ming Jin , Eric Mazumdar , Yuejie Chi , Adam Wierman , Costas Spanos

Public-transit systems face a number of operational challenges: (a) changing ridership patterns requiring optimization of fixed line services, (b) optimizing vehicle-to-trip assignments to reduce maintenance and operation codes, and (c)…

Systems and Control · Electrical Eng. & Systems 2021-07-02 Ruixiao Sun , Rongze Gui , Himanshu Neema , Yuche Chen , Juliette Ugirumurera , Joseph Severino , Philip Pugliese , Aron Laszka , Abhishek Dubey