English
Related papers

Related papers: Learning Generalizable Behavior via Visual Rewrite…

200 papers

Episodic training, where an agent's environment is reset after every success or failure, is the de facto standard when training embodied reinforcement learning (RL) agents. The underlying assumption that the environment can be easily reset…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Zichen Zhang , Luca Weihs

Visual Reinforcement Learning is a popular and powerful framework that takes full advantage of the Deep Learning breakthrough. It is known that variations in input domains (e.g., different panorama colors due to seasonal changes) or task…

Machine Learning · Computer Science 2025-02-19 Antonio Pio Ricciardi , Valentino Maiorca , Luca Moschella , Riccardo Marin , Emanuele Rodolà

Virtual character animation control is a problem for which Reinforcement Learning (RL) is a viable approach. While current work have applied RL effectively to portray physics-based skills, social behaviours are challenging to design reward…

Machine Learning · Computer Science 2021-04-14 Vihanga Gamage , Cathy Ennis , Robert Ross

Despite the remarkable success of Deep RL in learning control policies from raw pixels, the resulting models do not generalize. We demonstrate that a trained agent fails completely when facing small visual changes, and that…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Shani Gamrian , Yoav Goldberg

Deep reinforcement learning provides a promising approach for text-based games in studying natural language communication between humans and artificial agents. However, the generalization still remains a big challenge as the agents depend…

Computation and Language · Computer Science 2021-09-22 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Chengqi Zhang

Deep Reinforcement Learning (DRL) has produced great achievements since it was proposed, including the possibility of processing raw vision input data. However, training an agent to perform tasks based on image feedback remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Victor Augusto Kich , Junior Costa de Jesus , Ricardo Bedin Grando , Alisson Henrique Kolling , Gabriel Vinícius Heisler , Rodrigo da Silva Guerra

In visuomotor policy learning, the control policy for the robotic agent is derived directly from visual inputs. The typical approach, where a policy and vision encoder are trained jointly from scratch, generalizes poorly to novel visual…

Robotics · Computer Science 2025-09-17 Scott Jones , Liyou Zhou , Sebastian W. Pattinson

Self-trained autonomous agents developed using machine learning are showing great promise in a variety of control settings, perhaps most remarkably in applications involving autonomous vehicles. The main challenge associated with…

Machine Learning · Computer Science 2022-11-11 Patrik Hammersborg , Inga Strümke

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

Machine Learning · Computer Science 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

Learning from raw high dimensional data via interaction with a given environment has been effectively achieved through the utilization of deep neural networks. Yet the observed degradation in policy performance caused by imperceptible…

Machine Learning · Computer Science 2023-01-19 Ezgi Korkmaz

Deep reinforcement learning is a technique for solving problems in a variety of environments, ranging from Atari video games to stock trading. This method leverages deep neural network models to make decisions based on observations of a…

Machine Learning · Computer Science 2022-09-13 Anthony Dowling

As humans, our goals and our environment are persistently changing throughout our lifetime based on our experiences, actions, and internal and external drives. In contrast, typical reinforcement learning problem set-ups consider decision…

Machine Learning · Computer Science 2020-06-19 Annie Xie , James Harrison , Chelsea Finn

Deep reinforcement learning (DRL) has made great achievements since proposed. Generally, DRL agents receive high-dimensional inputs at each step, and make actions according to deep-neural-network-based policies. This learning mechanism…

Multiagent Systems · Computer Science 2019-12-30 Kun Shao , Zhentao Tang , Yuanheng Zhu , Nannan Li , Dongbin Zhao

Many real-world sequential decision making problems are partially observable by nature, and the environment model is typically unknown. Consequently, there is great need for reinforcement learning methods that can tackle such problems given…

Machine Learning · Computer Science 2018-06-08 Maximilian Igl , Luisa Zintgraf , Tuan Anh Le , Frank Wood , Shimon Whiteson

Text-based games (TBG) have emerged as promising environments for driving research in grounded language understanding and studying problems like generalization and sample efficiency. Several deep reinforcement learning (RL) methods with…

Computation and Language · Computer Science 2022-03-30 Mattia Atzeni , Shehzaad Dhuliawala , Keerthiram Murugesan , Mrinmaya Sachan

Deep reinforcement learning (RL) has achieved breakthrough results on many tasks, but agents often fail to generalize beyond the environment they were trained in. As a result, deep RL algorithms that promote generalization are receiving…

Machine Learning · Computer Science 2019-03-18 Charles Packer , Katelyn Gao , Jernej Kos , Philipp Krähenbühl , Vladlen Koltun , Dawn Song

Data driven approaches for decision making applied to automated driving require appropriate generalization strategies, to ensure applicability to the world's variability. Current approaches either do not generalize well beyond the training…

Machine Learning · Computer Science 2022-03-11 Karl Kurzer , Philip Schörner , Alexander Albers , Hauke Thomsen , Karam Daaboul , J. Marius Zöllner

Reinforcement learning (RL) has been successful in training agents in various learning environments, including video-games. However, such work modifies and shrinks the action space from the game's original. This is to avoid trying…

Artificial Intelligence · Computer Science 2020-05-27 Anssi Kanervisto , Christian Scheller , Ville Hautamäki

Recently, empowered with the powerful capabilities of neural networks, reinforcement learning (RL) has successfully tackled numerous challenging tasks. However, while these models demonstrate enhanced decision-making abilities, they are…

Machine Learning · Computer Science 2025-10-09 Zhengpeng Xie , Yulong Zhang

For sophisticated reinforcement learning (RL) systems to interact usefully with real-world environments, we need to communicate complex goals to these systems. In this work, we explore goals defined in terms of (non-expert) human…

Machine Learning · Statistics 2023-02-20 Paul Christiano , Jan Leike , Tom B. Brown , Miljan Martic , Shane Legg , Dario Amodei