English
Related papers

Related papers: Lifelong Learning in Costly Feature Spaces

200 papers

A major goal of artificial intelligence (AI) is to create an agent capable of acquiring a general understanding of the world. Such an agent would require the ability to continually accumulate and build upon its knowledge as it encounters…

Machine Learning · Computer Science 2023-06-14 Jorge A. Mendez , Eric Eaton

A lifelong reinforcement learning system is a learning system that has the ability to learn through trail-and-error interaction with the environment over its lifetime. In this paper, I give some arguments to show that the traditional…

Machine Learning · Computer Science 2020-01-28 Changjian Li

Continual learning, or lifelong learning, is a formidable current challenge to machine learning. It requires the learner to solve a sequence of $k$ different learning tasks, one after the other, while retaining its aptitude for earlier…

Machine Learning · Computer Science 2022-04-25 Xi Chen , Christos Papadimitriou , Binghui Peng

The lifelong learning paradigm in machine learning is an attractive alternative to the more prominent isolated learning scheme not only due to its resemblance to biological learning but also its potential to reduce energy waste by obviating…

Machine Learning · Computer Science 2023-08-30 Sanket Vaibhav Mehta , Darshan Patil , Sarath Chandar , Emma Strubell

Current natural language processing models work well on a single task, yet they often fail to continuously learn new tasks without forgetting previous ones as they are re-trained throughout their lifetime, a challenge known as lifelong…

Computation and Language · Computer Science 2020-10-07 Zirui Wang , Sanket Vaibhav Mehta , Barnabás Póczos , Jaime Carbonell

A long-standing challenge in artificial intelligence is lifelong reinforcement learning, where learners are given many tasks in sequence and must transfer knowledge between tasks while avoiding catastrophic forgetting. Policy reuse and…

Machine Learning · Computer Science 2023-11-07 David M. Bossens , Adam J. Sobey

Lifelong learning is essential for intelligent agents operating in dynamic environments. Current large language model (LLM)-based agents, however, remain stateless and unable to accumulate or transfer knowledge over time. Existing…

Artificial Intelligence · Computer Science 2025-06-02 Junhao Zheng , Xidi Cai , Qiuke Li , Duzhen Zhang , ZhongZhi Li , Yingying Zhang , Le Song , Qianli Ma

A fundamental objective in intelligent robotics is to move towards lifelong learning robot that can learn and adapt to unseen scenarios over time. However, continually learning new tasks would introduce catastrophic forgetting problems due…

Robotics · Computer Science 2025-09-16 Pengzhi Yang , Xinyu Wang , Ruipeng Zhang , Cong Wang , Frans A. Oliehoek , Jens Kober

The widespread success of artificial intelligence in fields like natural language processing and computer vision has not yet fully transferred to robotics, where progress is hindered by the lack of large-scale training data and the…

Machine Learning · Computer Science 2025-01-22 William Yue

Continual learning refers to the ability of a biological or artificial system to seamlessly learn from continuous streams of information while preventing catastrophic forgetting, i.e., a condition in which new incoming information strongly…

Machine Learning · Computer Science 2019-07-04 German I. Parisi , Christopher Kanan

Robots deployed in many real-world settings need to be able to acquire new skills and solve new tasks over time. Prior works on planning with skills often make assumptions on the structure of skills and tasks, such as subgoal skills, shared…

Robotics · Computer Science 2022-04-15 Jacky Liang , Mohit Sharma , Alex LaGrassa , Shivam Vats , Saumya Saxena , Oliver Kroemer

We consider a lifelong learning scenario in which a learner faces a neverending and arbitrary stream of facts and has to decide which ones to retain in its limited memory. We introduce a mathematical model based on the online learning…

Machine Learning · Computer Science 2022-01-13 Robi Bhattacharjee , Gaurav Mahajan

Lifelong learning aims to create AI systems that continuously and incrementally learn during a lifetime, similar to biological learning. Attempts so far have met problems, including catastrophic forgetting, interference among tasks, and the…

Machine Learning · Computer Science 2023-08-02 Eseoghene Ben-Iwhiwhu , Saptarshi Nath , Praveen K. Pilly , Soheil Kolouri , Andrea Soltoggio

Maximizing long-term rewards is the primary goal in sequential decision-making problems. The majority of existing methods assume that side information is freely available, enabling the learning agent to observe all features' states before…

Machine Learning · Computer Science 2023-07-19 Saeed Ghoorchian , Evgenii Kortukov , Setareh Maghsudi

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Lifelong reinforcement learning provides a promising framework for developing versatile agents that can accumulate knowledge over a lifetime of experience and rapidly learn new tasks by building upon prior knowledge. However, current…

Machine Learning · Computer Science 2015-05-22 Haitham Bou Ammar , Rasul Tutunov , Eric Eaton

Our research is focused on understanding and applying biological memory transfers to new AI systems that can fundamentally improve their performance, throughout their fielded lifetime experience. We leverage current understanding of…

Machine Learning · Computer Science 2019-02-25 Aswin Raghavan , Jesse Hostetler , Sek Chai

The state-of-the-art online learning approaches are only capable of learning the metric for predefined tasks. In this paper, we consider lifelong learning problem to mimic "human learning", i.e., endowing a new capability to the learned…

Machine Learning · Computer Science 2017-06-13 Gan Sun , Yang Cong , Ji Liu , Xiaowei Xu

Feature Learning aims to extract relevant information contained in data sets in an automated fashion. It is driving force behind the current deep learning trend, a set of methods that have had widespread empirical success. What is lacking…

Machine Learning · Statistics 2015-04-02 Brendan van Rooyen , Robert C. Williamson

A hallmark of human intelligence is the ability to construct self-contained chunks of knowledge and adequately reuse them in novel combinations for solving different yet structurally related problems. Learning such compositional structures…

Machine Learning · Computer Science 2021-03-18 Jorge A. Mendez , Eric Eaton