English
Related papers

Related papers: Class-wise Balancing Data Replay for Federated Cla…

200 papers

Traditional Incremental Learning (IL) targets to handle sequential fully-supervised learning problems where novel classes emerge from time to time. However, due to inherent annotation uncertainty and ambiguity, collecting high-quality…

Machine Learning · Computer Science 2025-05-08 Rui Wang , Mingxuan Xia , Chang Yao , Lei Feng , Junbo Zhao , Gang Chen , Haobo Wang

Few-shot class-incremental learning (FSCIL) faces challenges of memorizing old class distributions and estimating new class distributions given few training samples. In this study, we propose a learnable distribution calibration (LDC)…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Binghao Liu , Boyu Yang , Lingxi Xie , Ren Wang , Qi Tian , Qixiang Ye

The dynamic expansion architecture is becoming popular in class incremental learning, mainly due to its advantages in alleviating catastrophic forgetting. However, task confusion is not well assessed within this framework, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Bingchen Huang , Zhineng Chen , Peng Zhou , Jiayin Chen , Zuxuan Wu

New classes arise frequently in our ever-changing world, e.g., emerging topics in social media and new types of products in e-commerce. A model should recognize new classes and meanwhile maintain discriminability over old classes. Under…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Da-Wei Zhou , Han-Jia Ye , Liang Ma , Di Xie , Shiliang Pu , De-Chuan Zhan

Continual learning -- accumulating knowledge from a sequence of learning experiences -- is an important yet challenging problem. In this paradigm, the model's performance for previously encountered instances may substantially drop as…

Machine Learning · Computer Science 2022-07-14 Yasin Findik , Farhad Pourkamali-Anaraki

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

This paper focuses on an under-explored yet important problem: Federated Class-Continual Learning (FCCL), where new classes are dynamically added in federated learning. Existing FCCL works suffer from various limitations, such as requiring…

Machine Learning · Computer Science 2023-08-21 Jie Zhang , Chen Chen , Weiming Zhuang , Lingjuan Lv

Class-incremental learning (CIL) aims to continually learn a sequence of tasks, with each task consisting of a set of unique classes. Graph CIL (GCIL) follows the same setting but needs to deal with graph tasks (e.g., node classification in…

Machine Learning · Computer Science 2024-10-29 Chaoxi Niu , Guansong Pang , Ling Chen , Bing Liu

Batch Normalization (BN) and its variants has been extensively studied for neural nets in various computer vision tasks, but relatively little work has been dedicated to studying the effect of BN in continual learning. To that end, we…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Sungmin Cha , Sungjun Cho , Dasol Hwang , Sunwon Hong , Moontae Lee , Taesup Moon

Class-incremental learning (CIL) aims to develop a learning system that can continually learn new classes from a data stream without forgetting previously learned classes. When learning classes incrementally, the classifier must be…

Computation and Language · Computer Science 2023-05-29 Minqian Liu , Lifu Huang

Continual Federated Learning (CFL) combines Federated Learning (FL), the decentralized learning of a central model on a number of client devices that may not communicate their data, and Continual Learning (CL), the learning of a model from…

Machine Learning · Computer Science 2023-10-24 Jack Good , Jimit Majmudar , Christophe Dupuy , Jixuan Wang , Charith Peris , Clement Chung , Richard Zemel , Rahul Gupta

Few-Shot Class-Incremental Learning has shown remarkable efficacy in efficient learning new concepts with limited annotations. Nevertheless, the heuristic few-shot annotations may not always cover the most informative samples, which largely…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zitong Huang , Ze Chen , Yuanze Li , Bowen Dong , Erjin Zhou , Yong Liu , Rick Siow Mong Goh , Chun-Mei Feng , Wangmeng Zuo

The Federated Learning setting has a central server coordinating the training of a model on a network of devices. One of the challenges is variable training performance when the dataset has a class imbalance. In this paper, we address this…

Machine Learning · Computer Science 2020-11-13 Dipankar Sarkar , Ankur Narang , Sumit Rai

Federated Learning (FL) trains a machine learning model on distributed clients without exposing individual data. Unlike centralized training that is usually based on carefully-organized data, FL deals with on-device data that are often…

Machine Learning · Computer Science 2022-05-27 Jaemin Shin , Yuanchun Li , Yunxin Liu , Sung-Ju Lee

Class-Incremental Learning (CIL) struggles with catastrophic forgetting when learning new knowledge, and Data-Free CIL (DFCIL) is even more challenging without access to the training data of previously learned classes. Though recent DFCIL…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Qiankun Gao , Chen Zhao , Bernard Ghanem , Jian Zhang

Federated learning (FL) is a promising approach for training decentralized data located on local client devices while improving efficiency and privacy. However, the distribution and quantity of the training data on the clients' side may…

Machine Learning · Computer Science 2020-12-16 Lixu Wang , Shichao Xu , Xiao Wang , Qi Zhu

Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare new training samples…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Mingli Zhu , Zihao Zhu , Sihong Chen , Chen Chen , Baoyuan Wu

In Federated Learning (FL), the data in each client is typically assumed fixed or static. However, data often comes in an incremental manner in real-world applications, where the data domain may increase dynamically. In this work, we study…

Machine Learning · Computer Science 2024-06-04 Yichen Li , Qunwei Li , Haozhao Wang , Ruixuan Li , Wenliang Zhong , Guannan Zhang

Class Incremental Learning (CIL) aims to handle the scenario where data of novel classes occur continuously and sequentially. The model should recognize the sequential novel classes while alleviating the catastrophic forgetting. In the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Xiaoshuang Chen , Zhongyi Sun , Ke Yan , Shouhong Ding , Hongtao Lu

Most existing federated learning methods assume that clients have fully labeled data to train on, while in reality, it is hard for the clients to get task-specific labels due to users' privacy concerns, high labeling costs, or lack of…

Machine Learning · Computer Science 2023-02-24 Nan Yang , Dong Yuan , Charles Z Liu , Yongkun Deng , Wei Bao