English
Related papers

Related papers: AFT: An Exemplar-Free Class Incremental Learning M…

200 papers

Audio-visual continual test-time adaptation involves continually adapting a source audio-visual model at test-time, to unlabeled non-stationary domains, where either or both modalities can be distributionally shifted, which hampers online…

Machine Learning · Computer Science 2026-02-24 Sarthak Kumar Maharana , Akshay Mehra , Bhavya Ramakrishna , Yunhui Guo , Guan-Ming Su

Class-incremental learning is a challenging problem, where the goal is to train a model that can classify data from an increasing number of classes over time. With the advancement of vision-language pre-trained models such as CLIP, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Linlan Huang , Xusheng Cao , Haori Lu , Xialei Liu

Supervised fine-tuning (SFT) plays a critical role for pretrained large language models (LLMs), notably enhancing their capacity to acquire domain-specific knowledge while preserving or potentially augmenting their general-purpose…

Machine Learning · Computer Science 2026-03-31 Ali Taheri , Alireza Taban , Qizhou Wang , Shanshan Ye , Abdolreza Mirzaei , Tongliang Liu , Bo Han

Non-exemplar class-incremental learning refers to classifying new and old classes without storing samples of old classes. Since only new class samples are available for optimization, it often occurs catastrophic forgetting of old knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Ke Song , Quan Xia , Guoqiang Liang , Zhaojie Chen , Yanning Zhang

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and testing data by adapting a given model w.r.t. any testing sample. This task is particularly important for deep models when the test environment…

Machine Learning · Computer Science 2022-06-01 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Shijian Zheng , Peilin Zhao , Mingkui Tan

Exemplar-free class-incremental learning is very challenging due to the negative effect of catastrophic forgetting. A balance between stability and plasticity of the incremental process is needed in order to obtain good accuracy for past as…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Grégoire Petit , Adrian Popescu , Hugo Schindler , David Picard , Bertrand Delezoide

Anomaly detection has many important applications, such as monitoring industrial equipment. Despite recent advances in anomaly detection with deep-learning methods, it is unclear how existing solutions would perform under…

Sound · Computer Science 2022-04-06 Bingqing Chen , Luca Bondi , Samarjit Das

The alignment of large language models (LLMs) is crucial not only for unlocking their potential in specific tasks but also for ensuring that responses meet human expectations and adhere to safety and ethical principles. Current alignment…

Computation and Language · Computer Science 2024-06-18 Ruijun Chen , Jiehao Liang , Shiping Gao , Fanqi Wan , Xiaojun Quan

Deep learning organ segmentation approaches require large amounts of annotated training data, which is limited in supply due to reasons of confidentiality and the time required for expert manual annotation. Therefore, being able to train…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Abdelrahman Elskhawy , Aneta Lisowska , Matthias Keicher , Josep Henry , Paul Thomson , Nassir Navab

In response to the threat of adversarial examples, adversarial training provides an attractive option for enhancing the model robustness by training models on online-augmented adversarial examples. However, most of the existing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jia-Li Yin , Lehui Xie , Wanqing Zhu , Ximeng Liu , Bo-Hao Chen

Few-shot learning aims to generalize unseen classes that appear during testing but are unavailable during training. Prototypical networks incorporate few-shot metric learning, by constructing a class prototype in the form of a mean vector…

Sound · Computer Science 2021-02-17 Swapnil Bhosale , Rupayan Chakraborty , Sunil Kumar Kopparapu

Exemplar-Free Class Incremental Learning is a highly challenging setting where replay memory is unavailable. Methods relying on frozen feature extractors have drawn attention recently in this setting due to their impressive performances and…

Machine Learning · Computer Science 2025-02-28 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Training a robust system, e.g.,Speech to Text (STT), requires large datasets. Variability present in the dataset such as unwanted nuisances and biases are the reason for the need of large datasets to learn general representations. In this…

Sound · Computer Science 2021-10-19 Hemant Yadav , Atul Anshuman Singh , Rachit Mittal , Sunayana Sitaram , Yi Yu , Rajiv Ratn Shah

Recently, data-driven based Automatic Speech Recognition (ASR) systems have achieved state-of-the-art results. And transfer learning is often used when those existing systems are adapted to the target domain, e.g., fine-tuning, retraining.…

Sound · Computer Science 2019-04-18 Jiabin Xue , Jiqing Han , Tieran Zheng , Xiang Gao , Jiaxing Guo

Tabular learning transforms raw features into optimized spaces for downstream tasks, but its effectiveness deteriorates under distribution shifts between training and testing data. We formalize this challenge as the Distribution Shift…

Machine Learning · Computer Science 2025-08-28 Wangyang Ying , Nanxu Gong , Dongjie Wang , Xinyuan Wang , Arun Vignesh Malarkkan , Vivek Gupta , Chandan K. Reddy , Yanjie Fu

Class Incremental Semantic Segmentation~(CISS), within Incremental Learning for semantic segmentation, targets segmenting new categories while reducing the catastrophic forgetting on the old categories.Besides, background shifting, where…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Anqi Zhang , Guangyu Gao

Noisy label Facial Expression Recognition (FER) is more challenging than traditional noisy label classification tasks due to the inter-class similarity and the annotation ambiguity. Recent works mainly tackle this problem by filtering out…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Yuhang Zhang , Chengrui Wang , Xu Ling , Weihong Deng

It's assumed that training data is sufficient in base session of few-shot class-incremental audio classification. However, it's difficult to collect abundant samples for model training in base session in some practical scenarios due to the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yongjie Si , Yanxiong Li , Jialong Li , Jiaxin Tan , Qianhua He

A major challenge to out-of-distribution generalization is reliance on spurious features -- patterns that are predictive of the class label in the training data distribution, but not causally related to the target. Standard methods for…

Machine Learning · Computer Science 2023-06-21 Shikai Qiu , Andres Potapczynski , Pavel Izmailov , Andrew Gordon Wilson

The current state-of-the-art defense methods against adversarial examples typically focus on improving either empirical or certified robustness. Among them, adversarially trained (AT) models produce empirical state-of-the-art defense…

Machine Learning · Computer Science 2022-08-02 Jay Nandy , Sudipan Saha , Wynne Hsu , Mong Li Lee , Xiao Xiang Zhu