English
Related papers

Related papers: Improving Environment Novelty Quantification for E…

200 papers

Curriculum learning is a training method in which an agent is first trained on a curriculum of relatively simple tasks related to a target task in an effort to shorten the time required to train on the target task. Autonomous curriculum…

Machine Learning · Computer Science 2025-03-03 Muhammed Yusuf Satici , Jianxun Wang , David L. Roberts

The past decade has seen vast progress in deep reinforcement learning (RL) on the back of algorithms manually designed by human researchers. Recently, it has been shown that it is possible to meta-learn update rules, with the hope of…

We demonstrate how an evolutionary algorithm can be extended with a curriculum learning process that selects automatically the environmental conditions in which the evolving agents are evaluated. The environmental conditions are selected so…

Neural and Evolutionary Computing · Computer Science 2021-02-18 Nicola Milano , Stefano Nolfi

We introduce CULT (Continual Unsupervised Representation Learning with Typicality-Based Environment Detection), a new algorithm for continual unsupervised learning with variational auto-encoders. CULT uses a simple typicality metric in the…

Machine Learning · Computer Science 2022-07-19 Oliver Daniels-Koch

We propose Unified Distributed Environment (UDE), an environment virtualization toolkit for reinforcement learning research. UDE is designed to integrate environments built on any simulation platform such as Gazebo, Unity, Unreal, and…

Machine Learning · Computer Science 2022-05-17 Woong Gyu La , Sunil Muralidhara , Lingjie Kong , Pratik Nichat

Identifying controllable aspects of the environment has proven to be an extraordinary intrinsic motivator to reinforcement learning agents. Despite repeatedly achieving State-of-the-Art results, this approach has only been studied as a…

Artificial Intelligence · Computer Science 2022-02-18 Oriol Corcoll , Youssef Mohamed , Raul Vicente

Real-world digital environments are highly diverse and dynamic. These characteristics cause agents to frequently encounter unseen environments and distribution shifts, making continual learning in such environments essential for…

Computation and Language · Computer Science 2026-05-12 Tianci Xue , Zeyi Liao , Tianneng Shi , Zilu Wang , Kai Zhang , Dawn Song , Yu Su , Huan Sun

Reinforcement learning (RL) in non-stationary environments is challenging, as changing dynamics and rewards quickly make past experiences outdated. Traditional experience replay (ER) methods, especially those using TD-error prioritization,…

Machine Learning · Computer Science 2025-09-19 Tianyang Duan , Zongyuan Zhang , Songxiao Guo , Yuanye Zhao , Zheng Lin , Zihan Fang , Yi Liu , Dianxin Luan , Dong Huang , Heming Cui , Yong Cui

Language models are exhibiting increasing capability in knowledge utilization and reasoning. However, when applied as agents in embodied environments, they often suffer from misalignment between their intrinsic knowledge and environmental…

Computation and Language · Computer Science 2024-10-01 Hanlin Wang , Chak Tou Leong , Jian Wang , Wenjie Li

Recent advances in video generation have outpaced progress in video editing, which remains constrained by several limiting factors, namely: (a) the task's dependency on supervision severely limits generality, (b) an unnecessary artificial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Harold Haodong Chen , Harry Yang , Ser-Nam Lim

A continual learning agent builds on previous experiences to develop increasingly complex behaviors by adapting to non-stationary and dynamic environments while preserving previously acquired knowledge. However, scaling these systems…

Machine Learning · Computer Science 2025-03-06 Achref Jaziri , Etienne Künzel , Visvanathan Ramesh

As deep reinforcement learning (RL) showcases its strengths in networking and systems, its pitfalls also come to the public's attention--when trained to handle a wide range of network workloads and previously unseen deployment environments,…

Networking and Internet Architecture · Computer Science 2022-09-09 Zhengxu Xia , Yajie Zhou , Francis Y. Yan , Junchen Jiang

Humans naturally adapt to diverse environments by learning underlying rules across worlds with different dynamics, observations, and reward structures. In contrast, existing agents typically demonstrate improvements via self-evolving within…

In Vision-and-Language Navigation (VLN), an agent needs to navigate through the environment based on natural language instructions. Due to limited available data for agent training and finite diversity in navigation environments, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Jialu Li , Hao Tan , Mohit Bansal

An open problem in Machine Learning is how to avoid models to exploit spurious correlations in the data; a famous example is the background-label shortcut in the Waterbirds dataset. A common remedy is to train a model across multiple…

Machine Learning · Statistics 2025-10-15 Madi Matymov , Ba-Hien Tran , Maurizio Filippone

We propose Automatic Curricula via Expert Demonstrations (ACED), a reinforcement learning (RL) approach that combines the ideas of imitation learning and curriculum learning in order to solve challenging robotic manipulation tasks with…

Machine Learning · Computer Science 2022-02-08 Siyu Dai , Andreas Hofmann , Brian Williams

Throughout long history, natural species have learned to survive by evolving their physical structures adaptive to the environment changes. In contrast, current reinforcement learning (RL) studies mainly focus on training an agent with a…

Artificial Intelligence · Computer Science 2023-09-25 Shuang Ao , Tianyi Zhou , Guodong Long , Xuan Song , Jing Jiang

Unsupervised environment design (UED) is a form of automatic curriculum learning for training robust decision-making agents to zero-shot transfer into unseen environments. Such autocurricula have received much interest from the RL…

Machine Learning · Computer Science 2024-08-27 Minqi Jiang , Michael Dennis , Edward Grefenstette , Tim Rocktäschel

A robust body of reinforcement learning techniques have been developed to solve complex sequential decision making problems. However, these methods assume that train and evaluation tasks come from similarly or identically distributed…

Artificial Intelligence · Computer Science 2022-03-24 Jonathan Balloch , Zhiyu Lin , Mustafa Hussain , Aarun Srinivas , Robert Wright , Xiangyu Peng , Julia Kim , Mark Riedl

Despite recent advances in Reinforcement Learning (RL), many problems, especially real-world tasks, remain prohibitively expensive to learn. To address this issue, several lines of research have explored how tasks, or data samples…

Robotics · Computer Science 2022-04-12 Yash Shukla , Christopher Thierauf , Ramtin Hosseini , Gyan Tatiya , Jivko Sinapov