English
Related papers

Related papers: Prompt Conditioned VAE: Enhancing Generative Repla…

200 papers

Continual learning (CL) enables deep networks to acquire new knowledge while avoiding catastrophic forgetting. The powerful generalization ability of pre-trained models (PTMs), such as the Contrastive Language-Image Pre-training (CLIP)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Haodong Lu , Xinyu Zhang , Kristen Moore , Jason Xue , Lina Yao , Anton van den Hengel , Dong Gong

Lifelong learning is challenging for deep neural networks due to their susceptibility to catastrophic forgetting. Catastrophic forgetting occurs when a trained network is not able to maintain its ability to accomplish previously learned…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Mengyao Zhai , Lei Chen , Fred Tung , Jiawei He , Megha Nawhal , Greg Mori

With the rapid development of Large Language Models (LLMs), Controllable Text Generation (CTG) has become a critical technology for enhancing system reliability and user experience. Addressing the limitations of traditional methods, this…

Computation and Language · Computer Science 2025-09-23 Yan Zhuang , Yuan Sun

Pre-trained vision-language models (VLMs) have shown remarkable generalization capabilities via prompting, which leverages VLMs as knowledge bases to extract information beneficial for downstream tasks. However, existing methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xiaoyu Qiu , Hao Feng , Yuechen Wang , Wengang Zhou , Houqiang Li

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

Machine Learning · Computer Science 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

Large language models (LLMs) have demonstrated high performance on tasks expressed in natural language, particularly in zero- or few-shot settings. These are typically framed as supervised (e.g., classification) or unsupervised (e.g.,…

Computation and Language · Computer Science 2026-02-27 Yarik Menchaca Resendiz , Roman Klinger

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. In this work, we focus on continual text classification under the class-incremental setting. Recent CL studies…

Computation and Language · Computer Science 2023-05-15 Yifan Song , Peiyi Wang , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

The continual learning capability of large language models (LLMs) is crucial for advancing artificial general intelligence. However, continual fine-tuning LLMs across various domains often suffers from catastrophic forgetting, characterized…

Computation and Language · Computer Science 2025-08-07 Yunan Zhang , Shuoran Jiang , Mengchen Zhao , Yuefeng Li , Yang Fan , Xiangping Wu , Qingcai Chen

Controllable text generation is a growing field within natural language generation (NLG) that focuses on producing text that meets specific constraints in real-world applications. Previous approaches, such as plug-and-play controllers…

Computation and Language · Computer Science 2024-02-07 Hao Wang , Lei Sha

We introduce Prompt Curriculum Learning (PCL), a lightweight reinforcement learning (RL) algorithm that selects intermediate-difficulty prompts using a learned value model to post-train language models. Since post-training LLMs via RL…

Machine Learning · Computer Science 2025-10-02 Zhaolin Gao , Joongwon Kim , Wen Sun , Thorsten Joachims , Sid Wang , Richard Yuanzhe Pang , Liang Tan

Learning new tasks accumulatively without forgetting remains a critical challenge in continual learning. Generative experience replay addresses this challenge by synthesizing pseudo-data points for past learned tasks and later replaying…

Machine Learning · Computer Science 2023-10-09 Zizhao Hu , Mohammad Rostami

This work presents a lifelong learning approach to train a multilingual Text-To-Speech (TTS) system, where each language was seen as an individual task and was learned sequentially and continually. It does not require pooled data from all…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-20 Mu Yang , Shaojin Ding , Tianlong Chen , Tong Wang , Zhangyang Wang

Fine-tuning vision-language models (VLMs) with abundant unlabeled data recently has attracted increasing attention. Existing methods that resort to the pseudolabeling strategy would suffer from heavily incorrect hard pseudolabels when VLMs…

Machine Learning · Computer Science 2024-06-18 Jiahan Zhang , Qi Wei , Feng Liu , Lei Feng

This paper introduces TRUncated ReinForcement Learning for Language (TrufLL), an original ap-proach to train conditional language models from scratch by only using reinforcement learning (RL). AsRL methods unsuccessfully scale to large…

Artificial Intelligence · Computer Science 2021-09-21 Alice Martin Donati , Guillaume Quispe , Charles Ollion , Sylvain Le Corff , Florian Strub , Olivier Pietquin

Continual learning (CL) is a major challenge of machine learning (ML) and describes the ability to learn several tasks sequentially without catastrophic forgetting (CF). Recent works indicate that CL is a complex topic, even more so when…

Machine Learning · Computer Science 2022-06-09 Benedikt Bagus , Alexander Gepperth

This paper introduces \textbf{Q-tuning}, a novel approach for continual prompt tuning that enables the lifelong learning of a pre-trained language model. When learning a new task, Q-tuning trains a task-specific prompt by adding it to a…

Computation and Language · Computer Science 2024-04-24 Yanhui Guo , Shaoyuan Xu , Jinmiao Fu , Jia Liu , Chaosheng Dong , Bryan Wang

Learning a sequence of tasks without access to i.i.d. observations is a widely studied form of continual learning (CL) that remains challenging. In principle, Bayesian learning directly applies to this setting, since recursive and one-off…

Recently, the development of large language models (LLMs) has been significantly enhanced the question answering and dialogue generation, and makes them become increasingly popular in current practical scenarios. While unlike the general…

Computation and Language · Computer Science 2023-09-19 Zhiyuan Hu , Yue Feng , Yang Deng , Zekun Li , See-Kiong Ng , Anh Tuan Luu , Bryan Hooi

Multi-hop question answering (QA) requires reasoning over multiple documents to answer a complex question and provide interpretable supporting evidence. However, providing supporting evidence is not enough to demonstrate that a model has…

Computation and Language · Computer Science 2022-09-16 Zhenyun Deng , Yonghua Zhu , Yang Chen , Qianqian Qi , Michael Witbrock , Patricia Riddle

Pre-trained language models have been recently shown to benefit task-oriented dialogue (TOD) systems. Despite their success, existing methods often formulate this task as a cascaded generation problem which can lead to error accumulation…

Computation and Language · Computer Science 2022-03-02 Yixuan Su , Lei Shu , Elman Mansimov , Arshit Gupta , Deng Cai , Yi-An Lai , Yi Zhang