English
Related papers

Related papers: CoMPS: Continual Meta Policy Search

200 papers

Multi-objective Markov decision processes are sequential decision-making problems that involve multiple conflicting reward functions that cannot be optimized simultaneously without a compromise. This type of problems cannot be solved by a…

Machine Learning · Computer Science 2023-08-22 Sherif Abdelfattah , Kathryn Merrick , Jiankun Hu

Robot learning is witnessing a significant increase in the size, diversity, and complexity of pre-collected datasets, mirroring trends in domains such as natural language processing and computer vision. Many robot learning methods treat…

Robotics · Computer Science 2025-08-19 Marius Memmel , Jacob Berg , Bingqing Chen , Abhishek Gupta , Jonathan Francis

When deploying artificial agents in real-world environments where they interact with humans, it is crucial that their behavior is aligned with the values, social norms or other requirements of that environment. However, many environments…

Machine Learning · Computer Science 2023-05-05 Mattijs Baert , Pietro Mazzaglia , Sam Leroux , Pieter Simoens

Continual learning aims to acquire new tasks while preserving performance on previously learned ones, but most methods struggle with catastrophic forgetting. Existing approaches typically treat all layers uniformly, often trading stability…

Machine Learning · Computer Science 2025-12-29 Hengyi Wu , Zhenyi Wang , Heng Huang

Lifelong reinforcement learning provides a promising framework for developing versatile agents that can accumulate knowledge over a lifetime of experience and rapidly learn new tasks by building upon prior knowledge. However, current…

Machine Learning · Computer Science 2015-05-22 Haitham Bou Ammar , Rasul Tutunov , Eric Eaton

Automated Theorem Proving (ATP) in formal languages remains a formidable challenge in AI, demanding rigorous logical deduction and navigating vast search spaces. While large language models (LLMs) have shown promising performance, existing…

Artificial Intelligence · Computer Science 2025-05-19 Zhenwen Liang , Linfeng Song , Yang Li , Tao Yang , Feng Zhang , Haitao Mi , Dong Yu

Developing agents that can execute multiple skills by learning from pre-collected datasets is an important problem in robotics, where online interaction with the environment is extremely time-consuming. Moreover, manually designing reward…

Replay methods are known to be successful at mitigating catastrophic forgetting in continual learning scenarios despite having limited access to historical data. However, storing historical data is cheap in many real-world settings, yet…

Machine Learning · Computer Science 2023-11-22 Marcus Klasson , Hedvig Kjellström , Cheng Zhang

Meta-learning is a branch of machine learning which trains neural network models to synthesize a wide variety of data in order to rapidly solve new problems. In process control, many systems have similar and well-understood dynamics, which…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Daniel G. McClement , Nathan P. Lawrence , Johan U. Backstrom , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni

Following the pivotal success of learning strategies to win at tasks, solely by interacting with an environment without any supervision, agents have gained the ability to make sequential decisions in complex MDPs. Yet, reinforcement…

Machine Learning · Computer Science 2026-03-18 Ezgi Korkmaz

This paper investigates continual learning for semantic parsing. In this setting, a neural semantic parser learns tasks sequentially without accessing full training data from previous tasks. Direct application of the SOTA continual learning…

Computation and Language · Computer Science 2021-09-16 Zhuang Li , Lizhen Qu , Gholamreza Haffari

Reinforcement learning is a widely used approach to autonomous navigation, showing potential in various tasks and robotic setups. Still, it often struggles to reach distant goals when safety constraints are imposed (e.g., the wheeled robot…

Robotics · Computer Science 2024-08-27 Brian Angulo , Gregory Gorbov , Aleksandr Panov , Konstantin Yakovlev

Lifelong learning requires models that can continuously learn from sequential streams of data without suffering catastrophic forgetting due to shifts in data distributions. Deep learning models have thrived in the non-sequential learning…

Computation and Language · Computer Science 2021-07-27 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

Batch reinforcement learning enables policy learning without direct interaction with the environment during training, relying exclusively on previously collected sets of interactions. This approach is, therefore, well-suited for high-risk…

Machine Learning · Computer Science 2024-11-18 Amna Najib , Stefan Depeweg , Phillip Swazinna

Goal-conditioned reinforcement learning endows an agent with a large variety of skills, but it often struggles to solve tasks that require more temporally extended reasoning. In this work, we propose to incorporate imagined subgoals into…

Machine Learning · Computer Science 2021-07-02 Elliot Chane-Sane , Cordelia Schmid , Ivan Laptev

Reinforcement learning (RL) has become an increasingly active area of research in recent years. Although there are many algorithms that allow an agent to solve tasks efficiently, they often ignore the possibility that prior experience…

Artificial Intelligence · Computer Science 2020-01-07 Francisco M. Garcia , Chris Nota , Philip S. Thomas

Workers spend a significant amount of time learning how to make good decisions. Evaluating the efficacy of a given decision, however, can be complicated -- e.g., decision outcomes are often long-term and relate to the original decision in…

Machine Learning · Computer Science 2024-03-20 Hamsa Bastani , Osbert Bastani , Wichinpong Park Sinchaisri

Reinforcement learning is a promising approach to synthesizing policies for challenging robotics tasks. A key problem is how to ensure safety of the learned policy---e.g., that a walking robot does not fall over or that an autonomous car…

Machine Learning · Computer Science 2020-10-22 Osbert Bastani

Search missions require motion planning and navigation methods for information gathering that continuously replan based on new observations of the robot's surroundings. Current methods for information gathering, such as Monte Carlo Tree…

Data-efficient learning algorithms are essential in many practical applications where data collection is expensive, e.g., in robotics due to the wear and tear. To address this problem, meta-learning algorithms use prior experience about…

Machine Learning · Computer Science 2020-10-26 Jean Kaddour , Steindór Sæmundsson , Marc Peter Deisenroth