English
Related papers

Related papers: Adapting BERT for Continual Learning of a Sequence…

200 papers

To address the performance limitations of the Segment Anything Model (SAM) in specific domains, existing works primarily adopt adapter-based one-step adaptation paradigms. However, some of these methods are specific developed for specific…

Machine Learning · Computer Science 2025-07-17 Yuan-Chen Shu , Zhiwei Lin , Yongtao Wang

The goal of continual learning (CL) is to efficiently update a machine learning model with new data without forgetting previously-learned knowledge. Most widely-used CL methods rely on a rehearsal memory of data points to be reused while…

Machine Learning · Computer Science 2022-03-29 Lukas Balles , Giovanni Zappella , Cédric Archambeau

The field of Continual Learning (CL) has inspired numerous researchers over the years, leading to increasingly advanced countermeasures to the issue of catastrophic forgetting. Most studies have focused on the single-class scenario, where…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Martin Menabue , Emanuele Frascaroli , Matteo Boschini , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Large pretrained language models (LMs) like BERT have improved performance in many disparate natural language processing (NLP) tasks. However, fine tuning such models requires a large number of training examples for each target task.…

Computation and Language · Computer Science 2022-01-28 Jixuan Wang , Kuan-Chieh Wang , Frank Rudzicz , Michael Brudno

In continual learning, understanding the properties of task sequences and their relationships to model performance is important for developing advanced algorithms with better accuracy. However, efforts in this direction remain…

Machine Learning · Computer Science 2025-02-11 Thinh Nguyen , Cuong N. Nguyen , Quang Pham , Binh T. Nguyen , Savitha Ramasamy , Xiaoli Li , Cuong V. Nguyen

Generative models have demonstrated impressive results on Aspect-based Sentiment Analysis (ABSA) tasks, particularly for the emerging task of extracting Aspect-Category-Opinion-Sentiment (ACOS) quadruples. However, these models struggle…

Computation and Language · Computer Science 2022-11-16 Joseph J. Peper , Lu Wang

Transfer learning aims to solve the data sparsity for a target domain by applying information of the source domain. Given a sequence (e.g. a natural language sentence), the transfer learning, usually enabled by recurrent neural network…

Computation and Language · Computer Science 2019-02-26 Wanyun Cui , Guangyu Zheng , Zhiqiang Shen , Sihang Jiang , Wei Wang

Continual Learning (CL) sequentially learns new tasks like human beings, with the goal to achieve better Stability (S, remembering past tasks) and Plasticity (P, adapting to new tasks). Due to the fact that past training data is not…

Machine Learning · Computer Science 2022-09-27 Qing Sun , Fan Lyu , Fanhua Shang , Wei Feng , Liang Wan

Currently intelligent diagnosis systems lack the ability of continually learning to diagnose new diseases once deployed, under the condition of preserving old disease knowledge. In particular, updating an intelligent diagnosis system with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Wentao Zhang , Yujun Huang , Tong Zhang , Qingsong Zou , Wei-Shi Zheng , Ruixuan Wang

Continual learning (CL) is concerned with learning multiple tasks sequentially without forgetting previously learned tasks. Despite substantial empirical advances over recent years, the theoretical development of CL remains in its infancy.…

Machine Learning · Computer Science 2026-04-27 Liangzu Peng , Uday Kiran Reddy Tadipatri , Ziqing Xu , Eric Eaton , René Vidal

Continual learning (CL) refers to the ability to continuously learn and accumulate new knowledge while retaining useful information from past experiences. Although numerous CL methods have been proposed in recent years, it is not…

Machine Learning · Statistics 2025-03-27 Hanwen Xing , Christopher Yau

We introduce a neural method for transfer learning between two (source and target) classification tasks or aspects over the same domain. Rather than training on target labels, we use a few keywords pertaining to source and target aspects…

Computation and Language · Computer Science 2017-09-26 Yuan Zhang , Regina Barzilay , Tommi Jaakkola

BERT, as one of the pretrianed language models, attracts the most attention in recent years for creating new benchmarks across GLUE tasks via fine-tuning. One pressing issue is to open up the blackbox and explain the decision makings of…

Computation and Language · Computer Science 2021-01-05 Zhengxuan Wu , Desmond C. Ong

A continual learning (CL) algorithm learns from a non-stationary data stream. The non-stationarity is modeled by some schedule that determines how data is presented over time. Most current methods make strong assumptions on the schedule and…

Machine Learning · Computer Science 2022-10-17 Ruohan Wang , Marco Ciccone , Giulia Luise , Andrew Yapp , Massimiliano Pontil , Carlo Ciliberto

Contrastive learning techniques have been widely used in the field of computer vision as a means of augmenting datasets. In this paper, we extend the use of these contrastive learning embeddings to sentiment analysis tasks and demonstrate…

Computation and Language · Computer Science 2021-12-03 Ipsita Mohanty , Ankit Goyal , Alex Dotterweich

Aspect-based sentiment analysis (ABSA) aims to predict fine-grained sentiments of comments with respect to given aspect terms or categories. In previous ABSA methods, the importance of aspect has been realized and verified. Most existing…

Computation and Language · Computer Science 2019-07-09 Bowen Xing , Lejian Liao , Dandan Song , Jingang Wang , Fuzheng Zhang , Zhongyuan Wang , Heyan Huang

Continual Learning (CL) methods usually learn from all available data. However, this is not the case in human cognition which efficiently focuses on key experiences while disregarding the redundant information. Similarly, not all data…

Machine Learning · Computer Science 2024-10-24 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Joaquin Vanschoren

Sentiment analysis is an important task in the field ofNature Language Processing (NLP), in which users' feedbackdata on a specific issue are evaluated and analyzed. Manydeep learning models have been proposed to tackle this task, including…

Computation and Language · Computer Science 2020-11-23 Quoc Thai Nguyen , Thoai Linh Nguyen , Ngoc Hoang Luong , Quoc Hung Ngo

This paper describes our system designed for SemEval-2023 Task 12: Sentiment analysis for African languages. The challenge faced by this task is the scarcity of labeled data and linguistic resources in low-resource settings. To alleviate…

Computation and Language · Computer Science 2023-06-05 Dou Hu , Lingwei Wei , Yaxin Liu , Wei Zhou , Songlin Hu

User modeling in large e-commerce platforms aims to optimize user experiences by incorporating various customer activities. Traditional models targeting a single task often focus on specific business metrics, neglecting the comprehensive…

Information Retrieval · Computer Science 2025-02-28 Mingdai Yang , Fan Yang , Yanhui Guo , Shaoyuan Xu , Tianchen Zhou , Yetian Chen , Simone Shao , Jia Liu , Yan Gao
‹ Prev 1 8 9 10 Next ›