中文
相关论文

相关论文: CLASSIC: Continual and Contrastive Learning of Asp…

200 篇论文

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

机器学习 · 计算机科学 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

Cross-domain sentiment analysis aims to predict the sentiment of texts in the target domain using the model trained on the source domain to cope with the scarcity of labeled data. Previous studies are mostly cross-entropy-based methods for…

计算与语言 · 计算机科学 2022-08-19 Yun Luo , Fang Guo , Zihan Liu , Yue Zhang

Exemplar-free class incremental learning (EF-CIL) is a nontrivial task that requires continuously enriching model capability with new classes while maintaining previously learned knowledge without storing and replaying any old class…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Tianqi Wang , Jingcai Guo , Depeng Li , Zhi Chen

The dynamic expansion architecture is becoming popular in class incremental learning, mainly due to its advantages in alleviating catastrophic forgetting. However, task confusion is not well assessed within this framework, e.g., the…

计算机视觉与模式识别 · 计算机科学 2023-01-04 Bingchen Huang , Zhineng Chen , Peng Zhou , Jiayin Chen , Zuxuan Wu

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

机器学习 · 计算机科学 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Continual learning requires learning incremental tasks with dynamic data distributions. So far, it has been observed that employing a combination of contrastive loss and distillation loss for training in continual learning yields strong…

机器学习 · 计算机科学 2024-05-30 Yichen Wen , Zhiquan Tan , Kaipeng Zheng , Chuanlong Xie , Weiran Huang

We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self-supervised contrastive learning and deep clustering. By viewing contrastive…

机器学习 · 计算机科学 2023-10-23 Thalles Silva , Adín Ramírez Rivera

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Class-incremental learning (CIL) seeks to enable a model to sequentially learn new classes while retaining knowledge of previously learned ones. Balancing flexibility and stability remains a significant challenge, particularly when the task…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Fangwen Wu , Lechao Cheng , Shengeng Tang , Xiaofeng Zhu , Chaowei Fang , Dingwen Zhang , Meng Wang

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new…

Continual learning enables incremental learning of new tasks without forgetting those previously learned, resulting in positive knowledge transfer that can enhance performance on both new and old tasks. However, continual learning poses new…

机器学习 · 计算机科学 2023-08-01 Dawid Rymarczyk , Joost van de Weijer , Bartosz Zieliński , Bartłomiej Twardowski

Acquiring new knowledge without forgetting what has been learned in a sequence of tasks is the central focus of continual learning (CL). While tasks arrive sequentially, the training data are often prepared and annotated independently,…

机器学习 · 计算机科学 2024-01-31 Thuy-Trang Vu , Shahram Khadivi , Mahsa Ghorbanali , Dinh Phung , Gholamreza Haffari

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Adversarial imitation learning (AIL) is a popular method that has recently achieved much success. However, the performance of AIL is still unsatisfactory on the more challenging tasks. We find that one of the major reasons is due to the low…

机器学习 · 计算机科学 2023-07-07 Jialei Huang , Zhaoheng Yin , Yingdong Hu , Yang Gao

Contrastive learning has been frequently investigated to learn effective representations for text clustering tasks. While existing contrastive learning-based text clustering methods only focus on modeling instance-wise semantic similarity…

计算与语言 · 计算机科学 2024-08-27 Qian Yong , Chen Chen , Xiabing Zhou

The rehearsal strategy is widely used to alleviate the catastrophic forgetting problem in class incremental learning (CIL) by preserving limited exemplars from previous tasks. With imbalanced sample numbers between old and new classes, the…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Xiuwei Chen , Xiaobin Chang

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

机器学习 · 计算机科学 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

As Facial Expression Recognition (FER) systems become integrated into our daily lives, these systems need to prioritise making fair decisions instead of aiming at higher individual accuracy scores. Ranging from surveillance systems to…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Nikhil Churamani , Ozgur Kara , Hatice Gunes

Class Incremental Learning (CIL) aims to enable models to learn new classes sequentially while retaining knowledge of previous ones. Although current methods have alleviated catastrophic forgetting (CF), recent studies highlight that the…

机器学习 · 计算机科学 2025-03-19 Guannan Lai , Yujie Li , Xiangkun Wang , Junbo Zhang , Tianrui Li , Xin Yang

In the realm of class-incremental learning (CIL), alleviating the catastrophic forgetting problem is a pivotal challenge. This paper discovers a counter-intuitive observation: by incorporating domain shift into CIL tasks, the forgetting…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Wei Chen , Yi Zhou