English
Related papers

Related papers: Simulus: Combining Improvements in Sample-Efficien…

200 papers

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

Robotics · Computer Science 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang

In embodied AI, a persistent challenge is enabling agents to robustly adapt to novel domains without requiring extensive data collection or retraining. To address this, we present a world model implanting framework (WorMI) that combines the…

Artificial Intelligence · Computer Science 2025-09-05 Minjong Yoo , Jinwoo Jang , Sihyung Yoon , Honguk Woo

Scalable multi-agent driving simulation requires behavior models that are both realistic and computationally efficient. We address this by optimizing the behavior model that controls individual traffic participants. To improve efficiency,…

Robotics · Computer Science 2026-04-15 Fabian Konstantinidis , Moritz Sackmann , Ulrich Hofmann , Christoph Stiller

A major challenge in autonomous vehicle research is modeling agent behaviors, which has critical applications including constructing realistic and reliable simulations for off-board evaluation and forecasting traffic agents motion for…

Artificial Intelligence · Computer Science 2024-09-30 Zhenghao Peng , Wenjie Luo , Yiren Lu , Tianyi Shen , Cole Gulino , Ari Seff , Justin Fu

Transformers have increasingly outperformed gated RNNs in obtaining new state-of-the-art results on supervised tasks involving text sequences. Inspired by this trend, we study the question of how Transformer-based models can improve the…

Machine Learning · Computer Science 2020-08-19 Ricky Loynd , Roland Fernandez , Asli Celikyilmaz , Adith Swaminathan , Matthew Hausknecht

World models are a fundamental component in model-based reinforcement learning (MBRL). To perform temporally extended and consistent simulations of the future in partially observable environments, world models need to possess long-term…

Machine Learning · Computer Science 2023-11-10 Fei Deng , Junyeong Park , Sungjin Ahn

World models for interactive video generation have largely focused on single-agent settings, where future observations are generated from a single control signal. However, many generated environments require multi-agent interaction:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Fangfu Liu , Kai He , Tianchang Shen , Tianshi Cao , Sanja Fidler , Yueqi Duan , Jun Gao , Igor Gilitschenski , Zian Wang , Xuanchi Ren

Continual RL requires an agent to learn new tasks without forgetting previous ones, while improving on both past and future tasks. The most common approaches use model-free algorithms and replay buffers can help to mitigate catastrophic…

Machine Learning · Computer Science 2024-07-17 Luke Yang , Levin Kuhlmann , Gideon Kowadlo

The rapid development of large language model (LLM)-based agents has unlocked new possibilities for autonomous multi-turn reasoning and tool-augmented decision-making. However, their real-world deployment is hindered by severe…

Agent-based social simulation provides a valuable methodology for predicting social information diffusion, yet existing approaches face two primary limitations. Traditional agent models often rely on rigid behavioral rules and lack semantic…

Computers and Society · Computer Science 2025-10-21 Xinyi Li , Zhiqiang Guo , Qinglang Guo , Hao Jin , Weizhi Ma , Min Zhang

Sample efficiency has been a key issue in reinforcement learning (RL). An efficient agent must be able to leverage its prior experiences to quickly adapt to similar, but new tasks and situations. Meta-RL is one attempt at formalizing and…

Machine Learning · Computer Science 2023-01-02 Seyed Roozbeh Razavi Rohani , Saeed Hedayatian , Mahdieh Soleymani Baghshah

For over a decade, model-based reinforcement learning has been seen as a way to leverage control-based domain knowledge to improve the sample-efficiency of reinforcement learning agents. While model-based agents are conceptually appealing,…

Machine Learning · Computer Science 2021-05-28 Brandon Amos , Samuel Stanton , Denis Yarats , Andrew Gordon Wilson

We present a novel study on enhancing the capability of preserving the content in world models, focusing on a property we term World Stability. Recent diffusion-based generative models have advanced the synthesis of immersive and realistic…

Machine Learning · Computer Science 2025-03-12 Soonwoo Kwon , Jin-Young Kim , Hyojun Go , Kyungjune Baek

While model-based reinforcement learning (MBRL) improves sample efficiency by learning world models from raw observations, existing methods struggle to generalize across structurally similar scenes and remain vulnerable to spurious…

Machine Learning · Computer Science 2026-01-28 Zhao-Han Peng , Shaohui Li , Zhi Li , Shulan Ruan , Yu Liu , You He

Recent advances in vision-language models have enabled mobile GUI agents to perceive visual interfaces and execute user instructions, but reliable prediction of action consequences remains critical for long-horizon and high-risk…

Artificial Intelligence · Computer Science 2026-05-25 Weikai Xu , Kun Huang , Yunren Feng , Jiaxing Li , Yuhan Chen , Yuxuan Liu , Zhizheng Jiang , Heng Qu , Pengzhi Gao , Wei Liu , Jian Luan , Xiaolin Hu , Bo An

The fast development of Artificial Intelligence (AI) agents provides a promising way for the realization of intelligent and customized wireless networks. In this paper, we propose a Wireless Multi-Agent System (WMAS), which can provide…

Multiagent Systems · Computer Science 2025-08-04 Jingchen Peng , Dingli Yuan , Boxiang Ren , Jie Fan , Hao Wu , Lu Yang

Differentiable simulators represent an environment's dynamics as a differentiable function. Within robotics and autonomous driving, this property is used in Analytic Policy Gradients (APG), which relies on backpropagating through the…

Artificial Intelligence · Computer Science 2025-11-14 Asen Nachkov , Danda Pani Paudel , Jan-Nico Zaech , Davide Scaramuzza , Luc Van Gool

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics, enabling forward and counterfactual rollouts to support…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xinqing Li , Xin He , Le Zhang , Min Wu , Xiaoli Li , Yun Liu

Reconfigurable manufacturing systems (RMS) are critical for future market adjustment given their rapid adaptation to fluctuations in consumer demands, the introduction of new technological advances, and disruptions in linked supply chain…

Multiagent Systems · Computer Science 2025-11-12 Manonmani Sekar , Nasim Nezamoddini

End-to-end autonomous driving provides a feasible way to automatically maximize overall driving system performance by directly mapping the raw pixels from a front-facing camera to control signals. Recent advanced methods construct a latent…

Machine Learning · Computer Science 2024-05-21 Zeyu Gao , Yao Mu , Chen Chen , Jingliang Duan , Shengbo Eben Li , Ping Luo , Yanfeng Lu