English
Related papers

Related papers: Adapting BERT for Continual Learning of a Sequence…

200 papers

Attention-based long short-term memory (LSTM) networks have proven to be useful in aspect-level sentiment classification. However, due to the difficulties in annotating aspect-level data, existing public datasets for this task are all…

Computation and Language · Computer Science 2018-06-13 Ruidan He , Wee Sun Lee , Hwee Tou Ng , Daniel Dahlmeier

In real-world applications, dynamic scenarios require the models to possess the capability to learn new tasks continuously without forgetting the old knowledge. Experience-Replay methods store a subset of the old images for joint training.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Xinyuan Gao , Songlin Dong , Yuhang He , Xing Wei , Yihong Gong

Aspect-based sentiment analysis (ABSA) has made significant strides, yet challenges remain for low-resource languages due to the predominant focus on English. Current cross-lingual ABSA studies often centre on simpler tasks and rely heavily…

Computation and Language · Computer Science 2025-08-15 Jakub Šmíd , Pavel Přibáň , Pavel Král

The World Wide Web holds a wealth of information in the form of unstructured texts such as customer reviews for products, events and more. By extracting and analyzing the expressed opinions in customer reviews in a fine-grained way,…

Computation and Language · Computer Science 2017-09-20 Soufian Jebbara , Philipp Cimiano

Online Continual Learning (OCL) is a critical area in machine learning, focusing on enabling models to adapt to evolving data streams in real-time while addressing challenges such as catastrophic forgetting and the stability-plasticity…

Continual Learning (CL) is a powerful tool that enables agents to learn a sequence of tasks, accumulating knowledge learned in the past and using it for problem-solving or future task learning. However, existing CL methods often assume that…

Machine Learning · Computer Science 2025-06-09 Chaofan Pan , Jiafen Liu , Yanhua Li , Linbo Xiong , Fan Min , Wei Wei , Xin Yang

Continual learning (CL) is a paradigm that aims to replicate the human ability to learn and accumulate knowledge continually without forgetting previous knowledge and transferring it to new tasks. Recent instruction tuning (IT) involves…

Computation and Language · Computer Science 2023-10-24 Zihan Zhang , Meng Fang , Ling Chen , Mohammad-Reza Namazi-Rad

In aspect-level sentiment classification (ASC), it is prevalent to equip dominant neural models with attention mechanisms, for the sake of acquiring the importance of each context word on the given aspect. However, such a mechanism tends to…

Computation and Language · Computer Science 2019-06-07 Jialong Tang , Ziyao Lu , Jinsong Su , Yubin Ge , Linfeng Song , Le Sun , Jiebo Luo

This paper proposes a self-supervised learning approach for video features that results in significantly improved performance on downstream tasks (such as video classification, captioning and segmentation) compared to existing methods. Our…

Machine Learning · Computer Science 2019-10-01 Chen Sun , Fabien Baradel , Kevin Murphy , Cordelia Schmid

Aspect-category sentiment analysis (ACSA) aims to predict sentiment polarities of sentences with respect to given aspect categories. To detect the sentiment toward a particular aspect category in a sentence, most previous methods first…

Computation and Language · Computer Science 2020-10-07 Yuncong Li , Cunxiang Yin , Sheng-hua Zhong , Xu Pan

Continual Learning (CL) poses a significant challenge in Artificial Intelligence, aiming to mirror the human ability to incrementally acquire knowledge and skills. While extensive research has focused on CL within the context of…

Machine Learning · Computer Science 2024-06-10 Haotian Zhang , Junting Zhou , Haowei Lin , Hang Ye , Jianhua Zhu , Zihao Wang , Liangcai Gao , Yizhou Wang , Yitao Liang

The increasing volume of online reviews has made possible the development of sentiment analysis models for determining the opinion of customers regarding different products and services. Until now, sentiment analysis has proven to be an…

Computation and Language · Computer Science 2023-08-01 Elena-Simona Apostol , Alin-Georgian Pisică , Ciprian-Octavian Truică

As the application space of language models continues to evolve, a natural question to ask is how we can quickly adapt models to new tasks. We approach this classic question from a continual learning perspective, in which we aim to continue…

Computation and Language · Computer Science 2023-07-13 Adam Fisch , Amal Rannen-Triki , Razvan Pascanu , Jörg Bornschein , Angeliki Lazaridou , Elena Gribovskaya , Marc'Aurelio Ranzato

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Lu Yu , Haoyu Han , Zhe Tao , Hantao Yao , Changsheng Xu

Artificial neural networks suffer from catastrophic forgetting when they are sequentially trained on multiple tasks. To overcome this problem, we present a novel approach based on task-conditioned hypernetworks, i.e., networks that generate…

Machine Learning · Computer Science 2022-04-12 Johannes von Oswald , Christian Henning , Benjamin F. Grewe , João Sacramento

Continual learning (CL) enables deep neural networks to adapt to ever-changing data distributions. In practice, there may be scenarios where annotation is costly, leading to active continual learning (ACL), which performs active learning…

Machine Learning · Computer Science 2025-04-22 Jaehyun Park , Dongmin Park , Jae-Gil Lee

The continual learning (CL) ability is vital for deploying large language models (LLMs) in the dynamic world. Existing methods devise the learning module to acquire task-specific knowledge with parameter-efficient tuning (PET) block and the…

Computation and Language · Computer Science 2024-06-07 Weixiang Zhao , Shilong Wang , Yulin Hu , Yanyan Zhao , Bing Qin , Xuanyu Zhang , Qing Yang , Dongliang Xu , Wanxiang Che

Few-shot continual learning (FSCL) has attracted intensive attention and achieved some advances in recent years, but now it is difficult to again make a big stride in accuracy due to the limitation of only few-shot incremental samples.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ziqi Gu , Chunyan Xu , Zihan Lu , Xin Liu , Anbo Dai , Zhen Cui

Structural correspondence learning (SCL) is an effective method for cross-lingual sentiment classification. This approach uses unlabeled documents along with a word translation oracle to automatically induce task specific, cross-lingual…

Machine Learning · Computer Science 2016-12-06 Nana Li , Shuangfei Zhai , Zhongfei Zhang , Boying Liu

The size and the computational load of fine-tuning large-scale pre-trained neural network are becoming two major obstacles in adopting machine learning in many applications. Continual learning (CL) can serve as a remedy through enabling…

Machine Learning · Computer Science 2023-03-28 Yuliang Cai , Jesse Thomason , Mohammad Rostami