English
Related papers

Related papers: Continual Sequence Generation with Adaptive Compos…

200 papers

Our research is focused on understanding and applying biological memory transfers to new AI systems that can fundamentally improve their performance, throughout their fielded lifetime experience. We leverage current understanding of…

Machine Learning · Computer Science 2019-02-25 Aswin Raghavan , Jesse Hostetler , Sek Chai

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

We build a theoretical framework for designing and understanding practical meta-learning methods that integrates sophisticated formalizations of task-similarity with the extensive literature on online convex optimization and sequential…

Machine Learning · Computer Science 2019-12-10 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

The utility of learning a dynamics/world model of the environment in reinforcement learning has been shown in a many ways. When using neural networks, however, these models suffer catastrophic forgetting when learned in a lifelong or…

Machine Learning · Computer Science 2019-06-12 Nicholas Ketz , Soheil Kolouri , Praveen Pilly

A major obstacle to developing artificial intelligence applications capable of true lifelong learning is that artificial neural networks quickly or catastrophically forget previously learned tasks when trained on a new one. Numerous methods…

Machine Learning · Computer Science 2019-04-18 Gido M. van de Ven , Andreas S. Tolias

Decomposing knowledge into interchangeable pieces promises a generalization advantage when there are changes in distribution. A learning agent interacting with its environment is likely to be faced with situations requiring novel…

Machine Learning · Computer Science 2021-05-20 Kanika Madan , Nan Rosemary Ke , Anirudh Goyal , Bernhard Schölkopf , Yoshua Bengio

Continual learning is the ability to acquire new knowledge without forgetting the previously learned one, assuming no further access to past training data. Neural network approximators trained with gradient descent are known to fail in this…

Machine Learning · Computer Science 2021-11-05 Rodrigue Siry

Existing research on continual learning of a sequence of tasks focused on dealing with catastrophic forgetting, where the tasks are assumed to be dissimilar and have little shared knowledge. Some work has also been done to transfer…

Machine Learning · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Xingchang Huang

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

Despite advances in deep learning, neural networks can only learn multiple tasks when trained on them jointly. When tasks arrive sequentially, they lose performance on previously learnt tasks. This phenomenon called catastrophic forgetting…

Machine Learning · Computer Science 2018-05-29 Nitin Kamra , Umang Gupta , Yan Liu

In several applications, including in synthetic biology, one often has input/output data on a system composed of many modules, and although the modules' input/output functions and signals may be unknown, knowledge of the composition…

Machine Learning · Computer Science 2026-04-28 Jichi Wang , Eduardo D. Sontag , Domitilla Del Vecchio

Humans commonly solve complex problems by decomposing them into easier subproblems and then combining the subproblem solutions. This type of compositional reasoning permits reuse of the subproblem solutions when tackling future tasks that…

Machine Learning · Computer Science 2022-07-04 Jorge A. Mendez , Harm van Seijen , Eric Eaton

One of the hallmarks of human intelligence is the ability to compose learned knowledge into novel concepts which can be recognized without a single training example. In contrast, current state-of-the-art methods require hundreds of training…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Senthil Purushwalkam , Maximilian Nickel , Abhinav Gupta , Marc'Aurelio Ranzato

We introduce Adaptive Procedural Task Generation (APT-Gen), an approach to progressively generate a sequence of tasks as curricula to facilitate reinforcement learning in hard-exploration problems. At the heart of our approach, a task…

Machine Learning · Computer Science 2021-03-19 Kuan Fang , Yuke Zhu , Silvio Savarese , Li Fei-Fei

A novel and efficient end-to-end learning model for automatic modulation classification is proposed for wireless spectrum monitoring applications, which automatically learns from the time domain in-phase and quadrature data without…

Signal Processing · Electrical Eng. & Systems 2021-01-21 Kaisheng Liao , Yaodong Zhao , Jie Gu , Yaping Zhang , Yi Zhong

Generating new molecules with specified chemical and biological properties via generative models has emerged as a promising direction for drug discovery. However, existing methods require extensive training/fine-tuning with a large dataset,…

Quantitative Methods · Quantitative Biology 2023-04-25 Zichao Wang , Weili Nie , Zhuoran Qiao , Chaowei Xiao , Richard Baraniuk , Anima Anandkumar

Compositional generalization is the ability to generalize systematically to a new data distribution by combining known components. Although humans seem to have a great ability to generalize compositionally, state-of-the-art neural models…

Machine Learning · Computer Science 2021-06-22 Juyong Kim , Pradeep Ravikumar , Joshua Ainslie , Santiago Ontañón

Model ensemble is an effective strategy in continual learning, which alleviates catastrophic forgetting by interpolating model parameters, achieving knowledge fusion learned from different tasks. However, existing model ensemble methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Yuchuan Mao , Zhi Gao , Xiaomeng Fan , Yuwei Wu , Yunde Jia , Chenchen Jing

Pre-trained models have achieved excellent performance on the dialogue task. However, for the continual increase of online chit-chat scenarios, directly fine-tuning these models for each of the new tasks not only explodes the capacity of…

Computation and Language · Computer Science 2022-03-22 Shaoxiong Feng , Xuancheng Ren , Kan Li , Xu Sun

The ability of intelligent agents to learn and remember multiple tasks sequentially is crucial to achieving artificial general intelligence. Many continual learning (CL) methods have been proposed to overcome catastrophic forgetting which…

Machine Learning · Computer Science 2020-09-15 Gehui Shen , Song Zhang , Xiang Chen , Zhi-Hong Deng