English
Related papers

Related papers: MobileGym: A Verifiable and Highly Parallel Simula…

200 papers

With the remarkable advancements of large language models (LLMs), LLM-based agents have become a research hotspot in human-computer interaction. However, there is a scarcity of benchmarks available for LLM-based mobile agents. Benchmarking…

Artificial Intelligence · Computer Science 2024-07-02 Shihan Deng , Weikai Xu , Hongda Sun , Wei Liu , Tao Tan , Jianfeng Liu , Ang Li , Jian Luan , Bin Wang , Rui Yan , Shuo Shang

An embodied system must not only model the patterns of the external world but also understand its own motion dynamics. A motion dynamic model is essential for efficient skill acquisition and effective planning. In this work, we introduce…

Machine Learning · Computer Science 2025-04-10 Chenjie Hao , Weyl Lu , Yifan Xu , Yubei Chen

Online Reinforcement Learning (RL) offers a promising paradigm for enhancing GUI agents through direct environment interaction. However, its effectiveness is severely hindered by inefficient credit assignment in long-horizon tasks and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Han Xiao , Guozhi Wang , Hao Wang , Shilong Liu , Yuxiang Chai , Yue Pan , Yufeng Zhou , Xiaoxin Chen , Yafei Wen , Hongsheng Li

Autonomous agents that execute human tasks by controlling computers can enhance human productivity and application accessibility. However, progress in this field will be driven by realistic and reproducible benchmarks. We present…

The training paradigm for large language models (LLMs) is moving from static datasets to experience-based learning, where agents acquire skills via interacting with complex environments. To facilitate this transition we introduce GEM…

The promise of AI-driven scientific discovery hinges on whether AI agents can autonomously design and execute the computational workflows that underpin modern science. Molecular dynamics (MD) simulation presents a natural test bed to…

Artificial Intelligence · Computer Science 2026-05-12 Vinay Kumar , Satyendra Rajput , Mausam , N. M. Anoop Krishnan

Real world applications of Reinforcement Learning (RL) are often partially observable, thus requiring memory. Despite this, partial observability is still largely ignored by contemporary RL benchmarks and libraries. We introduce Partially…

Machine Learning · Computer Science 2023-03-06 Steven Morad , Ryan Kortvelesy , Matteo Bettini , Stephan Liwicki , Amanda Prorok

Task offloading, crucial for balancing computational loads across devices in networks such as the Internet of Things, poses significant optimization challenges, including minimizing latency and energy usage under strict communication and…

Machine Learning · Computer Science 2024-10-10 Frederico Metelo , Stevo Racković , Pedro Ákos Costa , Cláudia Soares

Due to the empirical success of reinforcement learning, an increasing number of students study the subject. However, from our practical teaching experience, we see students entering the field (bachelor, master and early PhD) often struggle.…

The increasing complexity of wireless environments, characterized by user mobility and dynamic obstructions, poses challenges for the maintenance of Line-of-Sight (LoS) connectivity. Mobile base stations (gNBs) stand as a promising solution…

Networking and Internet Architecture · Computer Science 2025-08-06 Pedro Duarte , André Coelho , Manuel Ricardo

Graphical user interface (GUI)-based mobile agents automate digital tasks on mobile devices by interpreting natural-language instructions and interacting with the screen. While recent methods apply reinforcement learning (RL) to train…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Li Gu , Zihuan Jiang , Zhixiang Chi , Huan Liu , Ziqiang Wang , Yuanhao Yu , Glen Berseth , Yang Wang

In this work, we introduce MedAgentSim, an open-source simulated clinical environment with doctor, patient, and measurement agents designed to evaluate and enhance LLM performance in dynamic diagnostic settings. Unlike prior approaches, our…

Computation and Language · Computer Science 2025-10-02 Mohammad Almansoori , Komal Kumar , Hisham Cholakkal

Memory Gym presents a suite of 2D partially observable environments, namely Mortar Mayhem, Mystery Path, and Searing Spotlights, designed to benchmark memory capabilities in decision-making agents. These environments, originally with finite…

Machine Learning · Computer Science 2025-01-22 Marco Pleines , Matthias Pallasch , Frank Zimmer , Mike Preuss

Reinforcement learning (RL) is one of the most active fields of AI research. Despite the interest demonstrated by the research community in reinforcement learning, the development methodology still lags behind, with a severe lack of…

Machine Learning · Computer Science 2023-06-08 Andreas Schuderer , Stefano Bromuri , Marko van Eekelen

As large language models (LLMs) continue to improve in reasoning and decision-making, there is a growing need for realistic and interactive environments where their abilities can be rigorously evaluated. We present VirtualEnv, a…

Artificial Intelligence · Computer Science 2026-02-10 Kabir Swain , Sijie Han , Ayush Raina , Jin Zhang , Shuang Li , Michael Stopa , Antonio Torralba

As intelligent systems and multi-agent coordination become increasingly central to real-world applications, there is a growing need for simulation tools that are both scalable and accessible. Existing high-fidelity simulators, while…

Artificial Intelligence · Computer Science 2026-02-06 Rohan Patil , Jai Malegaonkar , Xiao Jiang , Andre Dion , Gaurav S. Sukhatme , Henrik I. Christensen

This paper presents OpenGridGym, an open-source Python-based package that allows for seamless integration of distribution market simulation with state-of-the-art artificial intelligence (AI) decision-making algorithms. We present the…

Artificial Intelligence · Computer Science 2022-03-10 Rayan El Helou , Kiyeob Lee , Dongqi Wu , Le Xie , Srinivas Shakkottai , Vijay Subramanian

AI agents are increasingly used to diagnose and mitigate failures in production systems, known as agentic Site Reliability Engineering (SRE). Current SRE benchmarks are limited to oversimplistic SRE tasks and are unfortunately hard to…

Artificial Intelligence · Computer Science 2026-05-14 Jackson Clark , Yiming Su , Saad Mohammad Rafid Pial , Yifang Tian , Lily Gniedziejko , Hans-Arno Jacobsen , Yinfang Chen , Tianyin Xu

We introduce REAL, a benchmark and framework for multi-turn agent evaluations on deterministic simulations of real-world websites. REAL comprises high-fidelity, deterministic replicas of 11 widely-used websites across domains such as…

We present SWE-Gym, the first environment for training real-world software engineering (SWE) agents. SWE-Gym contains 2,438 real-world Python task instances, each comprising a codebase with an executable runtime environment, unit tests, and…

Software Engineering · Computer Science 2025-06-09 Jiayi Pan , Xingyao Wang , Graham Neubig , Navdeep Jaitly , Heng Ji , Alane Suhr , Yizhe Zhang