English
Related papers

Related papers: Exploration-Driven Generative Interactive Environm…

200 papers

Simulation is a crucial component of any robotic system. In order to simulate correctly, we need to write complex rules of the environment: how dynamic agents behave, and how the actions of each of the agents affect the behavior of others.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Seung Wook Kim , Yuhao Zhou , Jonah Philion , Antonio Torralba , Sanja Fidler

There is a recent surge in interest for imitation learning, with large human video-game and robotic manipulation datasets being used to train agents on very complex tasks. While deep neuroevolution has recently been shown to match the…

Neural and Evolutionary Computing · Computer Science 2023-04-26 Maximilien Le Clei , Pierre Bellec

While Vision-Language-Action (VLA) models show strong generalizability in various tasks, real-world deployment of robotic policy still requires large-scale, high-quality human expert demonstrations. However, data collection via human…

Training agents to act in embodied environments typically requires vast training data or access to accurate simulation, neither of which exists for many cases in the real world. Instead, world models are emerging as an alternative…

Training Vision-Language Models (VLMs) for Graphical User Interfaces (GUI) agents via Reinforcement Learning (RL) faces critical challenges: environment-based RL requires costly interactions, while environment-free methods struggle with…

Machine Learning · Computer Science 2025-02-27 Jiani Zheng , Lu Wang , Fangkai Yang , Chaoyun Zhang , Lingrui Mei , Wenjie Yin , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

Many challenges remain before AI agents can be deployed in real-world environments. However, one virtue of such environments is that they are inherently multi-agent and contain human experts. Using advanced social intelligence in such an…

Machine Learning · Computer Science 2025-08-22 Eric Ye , Ren Tao , Natasha Jaques

Web agents based on large language models have demonstrated promising capability in automating web tasks. However, current web agents struggle to reason out sensible actions due to the limitations of predicting environment changes, and…

Artificial Intelligence · Computer Science 2026-02-18 Zhouzhou Shen , Xueyu Hu , Xiyun Li , Tianqing Fang , Juncheng Li , Shengyu Zhang

World models for interactive video generation have largely focused on single-agent settings, where future observations are generated from a single control signal. However, many generated environments require multi-agent interaction:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Fangfu Liu , Kai He , Tianchang Shen , Tianshi Cao , Sanja Fidler , Yueqi Duan , Jun Gao , Igor Gilitschenski , Zian Wang , Xuanchi Ren

Building generalist agents that can rapidly adapt to new environments is a key challenge for deploying AI in the digital and real worlds. Is scaling current agent architectures the most effective way to build generalist agents? We propose a…

Artificial Intelligence · Computer Science 2025-02-25 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , Insup Lee

Generating safety-critical scenarios in high-fidelity simulations offers a promising and cost-effective approach for efficient testing of autonomous vehicles. Existing methods typically rely on manipulating a single vehicle's trajectory…

Machine Learning · Computer Science 2025-05-07 Jiawei Wang , Xintao Yan , Yao Mu , Haowei Sun , Zhong Cao , Henry X. Liu

Neuroevolution (NE) has recently proven a competitive alternative to learning by gradient descent in reinforcement learning tasks. However, the majority of NE methods and associated simulation environments differ crucially from biological…

Neural and Evolutionary Computing · Computer Science 2023-08-07 Gautier Hamon , Eleni Nisioti , Clément Moulin-Frier

Large Language Model agents are reshaping the industrial landscape. However, most practical agents remain human-designed because tasks differ widely, making them labor-intensive to build. This situation poses a central question: can we…

Artificial Intelligence · Computer Science 2026-04-29 Zhezheng Hao , Hong Wang , Jian Luo , Jianqing Zhang , Yuyan Zhou , Qiang Lin , Can Wang , Hande Dong , Jiawei Chen

Post-training GUI agents in interactive environments is critical for developing generalization and long-horizon planning capabilities. However, training on real-world applications is hindered by high latency, poor reproducibility, and…

Artificial Intelligence · Computer Science 2026-02-17 Yuan Cao , Dezhi Ran , Mengzhou Wu , Yuzhe Guo , Xin Chen , Ang Li , Gang Cao , Gong Zhi , Hao Yu , Linyi Li , Wei Yang , Tao Xie

The rapid development of large language and multimodal models has sparked significant interest in using proprietary models, such as GPT-4o, to develop autonomous agents capable of handling real-world scenarios like web navigation. Although…

Computation and Language · Computer Science 2024-10-28 Hongliang He , Wenlin Yao , Kaixin Ma , Wenhao Yu , Hongming Zhang , Tianqing Fang , Zhenzhong Lan , Dong Yu

The paradigm of agentic AI is shifting from engineered complex workflows to post-training native models. However, existing agents are typically confined to static, predefined action spaces--such as exclusively using APIs, GUI events, or…

Machine Learning · Computer Science 2025-12-11 Kaichen He , Zihao Wang , Muyao Li , Anji Liu , Yitao Liang

General virtual agents need to handle multimodal observations, master complex action spaces, and self-improve in dynamic, open-domain environments. However, existing environments are often domain-specific and require complex setups, which…

Artificial Intelligence · Computer Science 2025-02-17 Longtao Zheng , Zhiyuan Huang , Zhenghai Xue , Xinrun Wang , Bo An , Shuicheng Yan

Graphical User Interface (GUI) agents can automate complex tasks across digital environments, but their development is hindered by the scarcity of high-quality trajectory data for training. Existing approaches rely on expensive human…

Computation and Language · Computer Science 2025-03-04 Yiheng Xu , Dunjie Lu , Zhennan Shen , Junli Wang , Zekun Wang , Yuchen Mao , Caiming Xiong , Tao Yu

Realistic fine-grained multi-agent simulation of real-world complex systems is crucial for many downstream tasks such as reinforcement learning. Recent work has used generative models (GANs in particular) for providing high-fidelity…

Machine Learning · Computer Science 2022-02-25 Changyu Chen , Avinandan Bose , Shih-Fen Cheng , Arunesh Sinha

Recent advances in world models have greatly enhanced interactive environment simulation. Existing methods mainly fall into two categories: (1) static world generation models, which construct 3D environments without active agents, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yitong Wang , Fangyun Wei , Hongyang Zhang , Bo Dai , Yan Lu

Graphical User Interface (GUI) Agents, powered by large language and vision-language models, hold promise for enabling end-to-end automation in digital environments. However, their progress is fundamentally constrained by the scarcity of…

Machine Learning · Computer Science 2025-09-22 Musen Lin , Minghao Liu , Taoran Lu , Lichen Yuan , Yiwei Liu , Haonan Xu , Yu Miao , Yuhao Chao , Zhaojian Li