English
Related papers

Related papers: TransDreamer: Reinforcement Learning with Transfor…

200 papers

Inspired by the insights in cognitive science with respect to human memory and reasoning mechanism, a novel evolvable LLM-based (Large Language Model) agent framework is proposed as REMEMBERER. By equipping the LLM with a long-term…

Computation and Language · Computer Science 2023-10-31 Danyang Zhang , Lu Chen , Situo Zhang , Hongshen Xu , Zihan Zhao , Kai Yu

The deployment of Reinforcement Learning (RL) in real-world applications is constrained by its failure to satisfy safety criteria. Existing Safe Reinforcement Learning (SafeRL) methods, which rely on cost functions to enforce safety, often…

Machine Learning · Computer Science 2024-08-09 Weidong Huang , Jiaming Ji , Chunhe Xia , Borong Zhang , Yaodong Yang

Most recent successes in robot reinforcement learning involve learning a specialized single-task agent. However, robots capable of performing multiple tasks can be much more valuable in real-world applications. Multi-task reinforcement…

Robotics · Computer Science 2024-07-19 Elie Aljalbout , Nikolaos Sotirakis , Patrick van der Smagt , Maximilian Karl , Nutan Chen

We present the Multi-Agent Transformer World Model (MATWM), a novel transformer-based world model designed for multi-agent reinforcement learning in both vector- and image-based environments. MATWM combines a decentralized imagination…

Machine Learning · Computer Science 2025-06-24 Azad Deihim , Eduardo Alonso , Dimitra Apostolopoulou

Recent advancements in Model-Based Reinforcement Learning (MBRL) have made it a powerful tool for visual control tasks. Despite improved data efficiency, it remains challenging to train MBRL agents with generalizable perception. Training in…

Machine Learning · Computer Science 2024-10-15 Kyungmin Kim , JB Lanier , Pierre Baldi , Charless Fowlkes , Roy Fox

The primacy bias in model-free reinforcement learning (MFRL), which refers to the agent's tendency to overfit early data and lose the ability to learn from new data, can significantly decrease the performance of MFRL algorithms. Previous…

Machine Learning · Computer Science 2024-08-20 Zhongjian Qiao , Jiafei Lyu , Xiu Li

The DreamerV3 agent recently demonstrated state-of-the-art performance in diverse domains, learning powerful world models in latent space using a pixel reconstruction loss. However, while the reconstruction loss is essential to Dreamer's…

Artificial Intelligence · Computer Science 2024-05-27 Maxime Burchi , Radu Timofte

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

Artificial Intelligence · Computer Science 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

Training sophisticated agents for optimal decision-making under uncertainty has been key to the rapid development of modern autonomous systems across fields. Notably, model-free reinforcement learning (RL) has enabled decision-making agents…

Machine Learning · Computer Science 2025-07-21 Thomas Banker , Ali Mesbah

Simulation-to-reality reinforcement learning (RL) faces the critical challenge of reconciling discrepancies between simulated and real-world dynamics, which can severely degrade agent performance. A promising approach involves learning…

Machine Learning · Computer Science 2025-04-04 JB Lanier , Kyungmin Kim , Armin Karamzade , Yifei Liu , Ankita Sinha , Kat He , Davide Corsi , Roy Fox

Nowadays, model-free reinforcement learning algorithms have achieved remarkable performance on many decision making and control tasks, but high sample complexity and low sample efficiency still hinder the wide use of model-free…

Artificial Intelligence · Computer Science 2020-10-27 Jingbin Liu , Xinyang Gu , Shuai Liu

3D open-world environments with adversarial opponents remain a core challenge for reinforcement learning due to their vast state spaces. Effective reasoning representations are essential in such settings. While existing self-supervised…

Artificial Intelligence · Computer Science 2026-05-26 Yuanfei Xu , Lin Liu , Wengang Zhou , Mingxiao Feng , Houqiang Li

Meta-reinforcement learning (meta-RL) is a promising framework for tackling challenging domains requiring efficient exploration. Existing meta-RL algorithms are characterized by low sample efficiency, and mostly focus on low-dimensional…

Machine Learning · Computer Science 2024-03-18 Zohar Rimon , Tom Jurgenson , Orr Krupnik , Gilad Adler , Aviv Tamar

Transformers have significantly impacted domains like natural language processing, computer vision, and robotics, where they improve performance compared to other neural networks. This survey explores how transformers are used in…

Machine Learning · Computer Science 2023-07-13 Pranav Agarwal , Aamer Abdul Rahman , Pierre-Luc St-Charles , Simon J. D. Prince , Samira Ebrahimi Kahou

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Agentic reinforcement learning increasingly relies on experience-driven scaling, yet real-world environments remain non-adaptive, limited in coverage, and difficult to scale. World models offer a potential way to improve learning efficiency…

Computation and Language · Computer Science 2026-03-06 Yixia Li , Hongru Wang , Jiahao Qiu , Zhenfei Yin , Dongdong Zhang , Cheng Qian , Zeping Li , Pony Ma , Guanhua Chen , Heng Ji

The multiagent-based participatory simulation features prominently in urban planning as the acquired model is considered as the hybrid system of the domain and the local knowledge. However, the key problem of generating realistic agents for…

Multiagent Systems · Computer Science 2017-12-22 Soma Suzuki

Model-based reinforcement learning (MBRL) holds the promise of sample-efficient learning by utilizing a world model, which models how the environment works and typically encompasses components for two tasks: observation modeling and reward…

Machine Learning · Computer Science 2024-06-06 Haoyu Ma , Jialong Wu , Ningya Feng , Chenjun Xiao , Dong Li , Jianye Hao , Jianmin Wang , Mingsheng Long

Training deep learning models takes an extremely long execution time and consumes large amounts of computing resources. At the same time, recent research proposed systems and compilers that are expected to decrease deep learning models…

Machine Learning · Computer Science 2022-05-11 Sean Parker , Sami Alabed , Eiko Yoneki

"Dreaming" enables agents to learn from imagined experiences, enabling more robust and sample-efficient learning of world models. In this work, we consider innovations to the state-of-the-art Dreamer model using probabilistic methods that…

Machine Learning · Computer Science 2026-03-06 Gavin Wong