English
Related papers

Related papers: Forget Less, Count Better: A Domain-Incremental Se…

200 papers

Modern big-data systems generate massive, heterogeneous, and geographically dispersed streams that are large-scale and privacy-sensitive, making centralization challenging. While federated learning (FL) provides a privacy-enhancing training…

Machine Learning · Computer Science 2026-02-20 Obaidullah Zaland , Zulfiqar Ahmad Khan , Monowar Bhuyan

This paper focuses on an under-explored yet important problem: Federated Class-Continual Learning (FCCL), where new classes are dynamically added in federated learning. Existing FCCL works suffer from various limitations, such as requiring…

Machine Learning · Computer Science 2023-08-21 Jie Zhang , Chen Chen , Weiming Zhuang , Lingjuan Lv

Multidomain crowd counting aims to learn a general model for multiple diverse datasets. However, deep networks prefer modeling distributions of the dominant domains instead of all domains, which is known as domain bias. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Mingyue Guo , Binghui Chen , Zhaoyi Yan , Yaowei Wang , Qixiang Ye

The field of Continual Learning (CL) has inspired numerous researchers over the years, leading to increasingly advanced countermeasures to the issue of catastrophic forgetting. Most studies have focused on the single-class scenario, where…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Martin Menabue , Emanuele Frascaroli , Matteo Boschini , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Significant advancements have been made in single label incremental learning (SLCIL),yet the more practical and challenging multi label class incremental learning (MLCIL) remains understudied. Recently,visual language models such as CLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Haifeng Zhao , Yuguang Jin , Leilei Ma

Accurate classification of white blood cells in peripheral blood is essential for diagnosing hematological diseases. Due to constantly evolving clinical settings, data sources, and disease classifications, it is necessary to update machine…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Ario Sadafi , Raheleh Salehi , Armin Gruber , Sayedali Shetab Boushehri , Pascal Giehr , Nassir Navab , Carsten Marr

Deep metric learning aims to transform input data into an embedding space, where similar samples are close while dissimilar samples are far apart from each other. In practice, samples of new categories arrive incrementally, which requires…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Gao-Dong Liu , Wan-Lei Zhao , Jie Zhao

Catastrophic forgetting is a significant challenge in continual learning, in which a model loses prior knowledge when it is fine-tuned on new tasks. This problem is particularly critical for large language models (LLMs) undergoing continual…

Computation and Language · Computer Science 2025-09-03 Ege Süalp , Mina Rezaei

When an agent acquires new information, ideally it would immediately be capable of using that information to understand its environment. This is not possible using conventional deep neural networks, which suffer from catastrophic forgetting…

Machine Learning · Computer Science 2020-04-20 Tyler L. Hayes , Christopher Kanan

Deep learning approaches are nowadays ubiquitously used to tackle computer vision tasks such as semantic segmentation, requiring large datasets and substantial computational power. Continual learning for semantic segmentation (CSS) is an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Arthur Douillard , Yifu Chen , Arnaud Dapogny , Matthieu Cord

Large language models (LLMs) have attracted significant attention due to their impressive general capabilities across diverse downstream tasks. However, without domain-specific optimization, they often underperform on specialized knowledge…

Computation and Language · Computer Science 2025-09-25 Kangtao Lv , Haibin Chen , Yujin Yuan , Langming Liu , Shilei Liu , Yongwei Wang , Wenbo Su , Bo Zheng

The creation of large-scale open domain reading comprehension data sets in recent years has enabled the development of end-to-end neural comprehension models with promising results. To use these models for domains with limited training…

Computation and Language · Computer Science 2020-11-23 Y. Xu , X. Zhong , A. J. J. Yepes , J. H. Lau

Continual learning on sequential data is critical for many machine learning (ML) deployments. Unfortunately, LSTM networks, which are commonly used to learn on sequential data, suffer from catastrophic forgetting and are limited in their…

Machine Learning · Computer Science 2023-05-30 Ketaki Joshi , Raghavendra Pradyumna Pothukuchi , Andre Wibisono , Abhishek Bhattacharjee

Rehearsal is a critical component for class-incremental continual learning, yet it requires a substantial memory budget. Our work investigates whether we can significantly reduce this memory budget by leveraging unlabeled data from an…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 James Smith , Jonathan Balloch , Yen-Chang Hsu , Zsolt Kira

A common challenge in continual learning (CL) is catastrophic forgetting, where the performance on old tasks drops after new, additional tasks are learned. In this paper, we propose a novel framework called ReCL to slow down forgetting in…

Machine Learning · Computer Science 2025-03-04 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

Federated learning (FL) has emerged as a powerful paradigm for learning from decentralized data, and federated domain generalization further considers the test dataset (target domain) is absent from the decentralized training data (source…

Machine Learning · Computer Science 2024-03-14 Sikai Bai , Jie Zhang , Shuaicheng Li , Song Guo , Jingcai Guo , Jun Hou , Tao Han , Xiaocheng Lu

Crowdsourcing has become a popular method for collecting labeled training data. However, in many practical scenarios traditional labeling can be difficult for crowdworkers (for example, if the data is high-dimensional or unintuitive, or the…

Machine Learning · Statistics 2017-12-14 Tom Hope , Dafna Shahaf

Since COVID-19, crowd-counting tasks have gained wide applications. While supervised methods are reliable, annotation is more challenging in high-density scenes due to small head sizes and severe occlusion, whereas it's simpler in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Guoliang Xu , Jianqin Yin , Ren Zhang , Yonghao Dang , Feng Zhou , Bo Yu

To alleviate the heavy annotation burden for training a reliable crowd counting model and thus make the model more practicable and accurate by being able to benefit from more data, this paper presents a new semi-supervised method based on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yifei Qian , Xiaopeng Hong , Zhongliang Guo , Ognjen Arandjelović , Carl R. Donovan

Tremendous variation in the scale of people/head size is a critical problem for crowd counting. To improve the scale invariance of feature representation, recent works extensively employ Convolutional Neural Networks with multi-column…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Zhi-Qi Cheng , Jun-Xiu Li , Qi Dai , Xiao Wu , Jun-Yan He , Alexander Hauptmann