English
Related papers

Related papers: Neural Collapse Inspired Federated Learning with N…

200 papers

Neural Collapse (NC) is a recently observed phenomenon in neural networks that characterises the solution space of the final classifier layer when trained until zero training loss. Specifically, NC suggests that the final classifier layer…

Machine Learning · Computer Science 2024-11-05 Evan Markou , Thalaiyasingam Ajanthan , Stephen Gould

Federated learning (FL) facilitates a privacy-preserving neural network training paradigm through collaboration between edge clients and a central server. One significant challenge is that the distributed data is not independently and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yu Qiao , Huy Q. Le , Mengchun Zhang , Apurba Adhikary , Chaoning Zhang , Choong Seon Hong

Few-shot class-incremental learning (FSCIL) has been a challenging problem as only a few training samples are accessible for each novel class in the new sessions. Finetuning the backbone or adjusting the classifier prototypes trained in the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Yibo Yang , Haobo Yuan , Xiangtai Li , Zhouchen Lin , Philip Torr , Dacheng Tao

Federated learning aims to collaboratively train models without accessing their client's local private data. The data may be Non-IID for different clients and thus resulting in poor performance. Recently, personalized federated learning…

Machine Learning · Computer Science 2023-02-16 Dui Wang , Li Shen , Yong Luo , Han Hu , Kehua Su , Yonggang Wen , Dacheng Tao

Federated learning (FL) has emerged as a key paradigm for collaborative model training across multiple clients without sharing raw data, enabling privacy-preserving applications in areas such as radiology and pathology. However, works on…

Machine Learning · Computer Science 2025-10-31 Furkan Pala , Islem Rekik

We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem…

Federated learning allows clients to collaboratively learn statistical models while keeping their data local. Federated learning was originally used to train a unique global model to be served to all clients, but this approach might be…

Machine Learning · Computer Science 2022-06-20 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated learning achieves effective performance in modeling decentralized data. In practice, client data are not well-labeled, which makes it potential for federated unsupervised learning (FUSL) with non-IID data. However, the performance…

Machine Learning · Computer Science 2024-03-26 Xinting Liao , Weiming Liu , Chaochao Chen , Pengyang Zhou , Fengyuan Yu , Huabin Zhu , Binhui Yao , Tao Wang , Xiaolin Zheng , Yanchao Tan

With an increasing number of smart devices like internet of things (IoT) devices deployed in the field, offloadingtraining of neural networks (NNs) to a central server becomes more and more infeasible. Recent efforts toimprove users'…

Machine Learning · Computer Science 2023-07-19 Kilian Pfeiffer , Martin Rapp , Ramin Khalili , Jörg Henkel

Federated learning is a paradigm of distributed machine learning in which multiple clients coordinate with a central server to learn a model, without sharing their own training data. Standard federated optimization methods such as Federated…

Machine Learning · Computer Science 2024-05-15 Sohom Mukherjee , Nicolas Loizou , Sebastian U. Stich

Federated learning (FL) is a distributed machine learning paradigm where multiple clients conduct local training based on their private data, then the updated models are sent to a central server for global aggregation. The practical…

Machine Learning · Computer Science 2025-04-03 Harsh Vardhan , Xiaofan Yu , Tajana Rosing , Arya Mazumdar

Federated learning (FL) has emerged as the predominant approach for collaborative training of neural network models across multiple users, without the need to gather the data at a central location. One of the important challenges in this…

Machine Learning · Computer Science 2021-07-15 Matthias Reisser , Christos Louizos , Efstratios Gavves , Max Welling

There is a recently discovered and intriguing phenomenon called Neural Collapse: at the terminal phase of training a deep neural network for classification, the within-class penultimate feature means and the associated classifier vectors of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Tong Liang , Jim Davis

Federated learning is an emerging distributed machine learning framework for privacy preservation. However, models trained in federated learning usually have worse performance than those trained in the standard centralized learning mode,…

Machine Learning · Computer Science 2021-06-15 Hangyu Zhu , Jinjin Xu , Shiqing Liu , Yaochu Jin

Federated learning (FL) is an appealing concept to perform distributed training of Neural Networks (NN) while keeping data private. With the industrialization of the FL framework, we identify several problems hampering its successful…

Machine Learning · Computer Science 2020-11-13 Lixuan Yang , Cedric Beliard , Dario Rossi

Federated Long-Tailed Learning (Fed-LT), a paradigm wherein data collected from decentralized local clients manifests a globally prevalent long-tailed distribution, has garnered considerable attention in recent times. In the context of…

Machine Learning · Computer Science 2024-03-11 Zikai Xiao , Zihan Chen , Liyinglan Liu , Yang Feng , Jian Wu , Wanlu Liu , Joey Tianyi Zhou , Howard Hao Yang , Zuozhu Liu

The proliferation of edge devices has brought Federated Learning (FL) to the forefront as a promising paradigm for decentralized and collaborative model training while preserving the privacy of clients' data. However, FL struggles with a…

Machine Learning · Computer Science 2024-05-14 Mahdi Morafah , Matthias Reisser , Bill Lin , Christos Louizos

Federated learning is a paradigm that enables local devices to jointly train a server model while keeping the data decentralized and private. In federated learning, since local data are collected by clients, it is hardly guaranteed that the…

Machine Learning · Computer Science 2022-03-01 Seunghan Yang , Hyoungseob Park , Junyoung Byun , Changick Kim

Federated learning (FL) allows collaborative machine learning (ML) model training among decentralized clients' information, ensuring data privacy. The decentralized nature of FL deals with non-independent and identically distributed…

Federated Learning (FL) applied to real world data may suffer from several idiosyncrasies. One such idiosyncrasy is the data distribution across devices. Data across devices could be distributed such that there are some "heavy devices" with…

Machine Learning · Computer Science 2022-02-09 Christophe Dupuy , Tanya G. Roosta , Leo Long , Clement Chung , Rahul Gupta , Salman Avestimehr