English
Related papers

Related papers: Continual Reinforcement Learning in 3D Non-station…

200 papers

Homeostasis is a prevalent process by which living beings maintain their internal milieu around optimal levels. Multiple lines of evidence suggest that living beings learn to act to predicatively ensure homeostasis (allostasis). A classical…

Artificial Intelligence · Computer Science 2021-09-15 Hugo Laurençon , Charbel-Raphaël Ségerie , Johann Lussange , Boris S. Gutkin

Real-world reinforcement learning applications are often hindered by delayed feedback from environments, which violates the Markov assumption and introduces significant challenges. Although numerous delay-compensating methods have been…

Machine Learning · Computer Science 2026-02-03 Jongsoo Lee , Jangwon Kim , Jiseok Jeong , Soohee Han

Deep Reinforcement Learning has been successfully applied in various computer games [8]. However, it is still rarely used in real-world applications, especially for the navigation and continuous control of real mobile robots [13]. Previous…

Continual learning is essential for all real-world applications, as frozen pre-trained models cannot effectively deal with non-stationary data distributions. The purpose of this study is to review the state-of-the-art methods that allow…

Machine Learning · Computer Science 2022-02-28 Khadija Shaheen , Muhammad Abdullah Hanif , Osman Hasan , Muhammad Shafique

Traditionally, reinforcement learning methods predict the next action based on the current state. However, in many situations, directly applying actions to control systems or robots is dangerous and may lead to unexpected behaviors because…

Robotics · Computer Science 2020-11-03 Nan Lin , Yuxuan Li , Yujun Zhu , Ruolin Wang , Xiayu Zhang , Jianmin Ji , Keke Tang , Xiaoping Chen , Xinming Zhang

We present a general, two-stage reinforcement learning approach to create robust policies that can be deployed on real robots without any additional training using a single demonstration generated by trajectory optimization. The…

Robotics · Computer Science 2022-01-25 Miroslav Bogdanovic , Majid Khadiv , Ludovic Righetti

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

Model-based reinforcement learning (RL) methods are appealing in the offline setting because they allow an agent to reason about the consequences of actions without interacting with the environment. Prior methods learn a 1-step dynamics…

Machine Learning · Computer Science 2022-11-07 Bogdan Mazoure , Benjamin Eysenbach , Ofir Nachum , Jonathan Tompson

Autonomous lane changing is a critical feature for advanced autonomous driving systems, that involves several challenges such as uncertainty in other driver's behaviors and the trade-off between safety and agility. In this work, we develop…

Robotics · Computer Science 2019-09-26 Ali Alizadeh , Majid Moghadam , Yunus Bicer , Nazim Kemal Ure , Ugur Yavas , Can Kurtulus

We introduce the framework of performative reinforcement learning where the policy chosen by the learner affects the underlying reward and transition dynamics of the environment. Following the recent literature on performative…

Machine Learning · Computer Science 2023-06-08 Debmalya Mandal , Stelios Triantafyllou , Goran Radanovic

Real-world applications of reinforcement learning often involve environments where agents operate on complex, high-dimensional observations, but the underlying (''latent'') dynamics are comparatively simple. However, outside of restrictive…

Machine Learning · Computer Science 2024-10-24 Philip Amortila , Dylan J. Foster , Nan Jiang , Akshay Krishnamurthy , Zakaria Mhammedi

Continual learning refers to the ability of a biological or artificial system to seamlessly learn from continuous streams of information while preventing catastrophic forgetting, i.e., a condition in which new incoming information strongly…

Machine Learning · Computer Science 2019-07-04 German I. Parisi , Christopher Kanan

In most real world scenarios, a policy trained by reinforcement learning in one environment needs to be deployed in another, potentially quite different environment. However, generalization across different environments is known to be hard.…

Machine Learning · Computer Science 2021-04-12 Nicklas Hansen , Rishabh Jangir , Yu Sun , Guillem Alenyà , Pieter Abbeel , Alexei A. Efros , Lerrel Pinto , Xiaolong Wang

In this paper, we propose a multi-timescale replay (MTR) buffer for improving continual learning in RL agents faced with environments that are changing continuously over time at timescales that are unknown to the agent. The basic MTR buffer…

Machine Learning · Computer Science 2020-04-17 Christos Kaplanis , Claudia Clopath , Murray Shanahan

Reinforcement learning (RL) has become a prevalent paradigm for training tool calling agents, which typically requires online interactive environments. Existing approaches either rely on training data with ground truth annotations or…

Machine Learning · Computer Science 2026-05-08 Chenming Tang , Hsiu-Yuan Huang , Weijie Liu , Junqiang Zheng , Saiyong Yang , Yunfang Wu

While Reinforcement Learning (RL) has achieved remarkable success in language modeling, its triumph hasn't yet fully translated to visuomotor agents. A primary challenge in RL models is their tendency to overfit specific tasks or…

Robotics · Computer Science 2025-08-01 Shaofei Cai , Zhancun Mu , Haiwen Xia , Bowei Zhang , Anji Liu , Yitao Liang

Although reinforcement learning has made great strides recently, a continuing limitation is that it requires an extremely high number of interactions with the environment. In this paper, we explore the effectiveness of reusing experience…

Machine Learning · Computer Science 2019-06-25 Matthew Aitchison

Autonomous agents operating in domains such as robotics or video game simulations must adapt to changing tasks without forgetting about the previous ones. This process called Continual Reinforcement Learning poses non-trivial difficulties,…

Machine Learning · Computer Science 2026-02-02 Anthony Kobanda , Odalric-Ambrym Maillard , Rémy Portelas

Reinforcement learning (RL) is one of the active fields in machine learning, demonstrating remarkable potential in tackling real-world challenges. Despite its promising prospects, this methodology has encountered with issues and challenges,…

Machine Learning · Computer Science 2024-11-21 Alireza Rashidi Laleh , Majid Nili Ahmadabadi

Model-based Reinforcement Learning (MBRL) holds promise for data-efficiency by planning with model-generated experience in addition to learning with experience from the environment. However, in complex or changing environments, models in…

Machine Learning · Computer Science 2022-05-24 Esra'a Saleh , John D. Martin , Anna Koop , Arash Pourzarabi , Michael Bowling