English
Related papers

Related papers: Sparse Uncertainty-Informed Sampling from Federate…

200 papers

Federated ensemble distillation addresses client heterogeneity by generating pseudo-labels for an unlabeled server dataset based on client predictions and training the server model using the pseudo-labeled dataset. The unlabeled server…

Machine Learning · Computer Science 2025-05-20 Won-Jun Jang , Hyeon-Seo Park , Si-Hyeon Lee

The performance of a machine learning system is usually evaluated by using i.i.d.\ observations with true labels. However, acquiring ground truth labels is expensive, while obtaining unlabeled samples may be cheaper. Stratified sampling can…

Machine Learning · Computer Science 2019-07-29 Tiancheng Yu , Xiyu Zhai , Suvrit Sra

Federated learning (FL) is a machine learning paradigm where multiple clients collaborate to optimize a single global model using their private data. The global model is maintained by a central server that orchestrates the FL training…

Machine Learning · Computer Science 2024-02-14 Waqwoya Abebe , Pablo Munoz , Ali Jannesari

Federated Learning (FL) algorithms commonly sample a random subset of clients to address the straggler issue and improve communication efficiency. While recent works have proposed various client sampling methods, they have limitations in…

Machine Learning · Computer Science 2024-05-15 Jiaxiang Geng , Yanzhao Hou , Xiaofeng Tao , Juncheng Wang , Bing Luo

Many image and vision applications require a large amount of data for model training. Collecting all such data at a central location can be challenging due to data privacy and communication bandwidth restrictions. Federated learning is an…

Machine Learning · Computer Science 2020-06-24 Tiffany Tuor , Shiqiang Wang , Bong Jun Ko , Changchang Liu , Kin K. Leung

We propose a simple and efficient algorithm for learning sparse invariant representations from unlabeled data with fast inference. When trained on short movies sequences, the learned features are selective to a range of orientations and…

Computer Vision and Pattern Recognition · Computer Science 2011-05-27 Karol Gregor , Yann LeCun

The proliferation of automated data collection schemes and the advances in sensorics are increasing the amount of data we are able to monitor in real-time. However, given the high annotation costs and the time required by quality…

Machine Learning · Statistics 2023-07-17 Davide Cacciarelli , Murat Kulahci , John Sølve Tyssedal

Federated learning has recently gained popularity as a framework for distributed clients to collaboratively train a machine learning model using local data. While traditional federated learning relies on a central server for model…

Machine Learning · Computer Science 2025-09-03 I-Cheng Lin , Osman Yagan , Carlee Joe-Wong

Federated learning (FL) is a machine learning methodology that involves the collaborative training of a global model across multiple decentralized clients in a privacy-preserving way. Several FL methods are introduced to tackle…

Machine Learning · Computer Science 2024-12-31 Jordan Slessor , Dezheng Kong , Xiaofen Tang , Zheng En Than , Linglong Kong

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

One of the most challenging issues in federated learning is that the data is often not independent and identically distributed (nonIID). Clients are expected to contribute the same type of data and drawn from one global distribution.…

Machine Learning · Computer Science 2024-01-08 Hung Nguyen , Peiyuan Wu , Morris Chang

Federated learning (FL) is a distributed framework for collaboratively training with privacy guarantees. In real-world scenarios, clients may have Non-IID data (local class imbalance) with poor annotation quality (label noise). The…

Machine Learning · Computer Science 2023-04-07 Chenrui Wu , Zexi Li , Fangxin Wang , Chao Wu

Federated learning paradigm to utilize datasets across multiple data providers. In FL, cross-silo data providers often hesitate to share their high-quality dataset unless their data value can be fairly assessed. Shapley value (SV) has been…

Machine Learning · Computer Science 2025-04-24 Shuyue Wei , Yongxin Tong , Zimu Zhou , Tianran He , Yi Xu

Federated learning (FL) is an effective solution to train machine learning models on the increasing amount of data generated by IoT devices and smartphones while keeping such data localized. Most previous work on federated learning assumes…

Machine Learning · Computer Science 2023-01-05 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

Federated Learning (FL) has emerged as a means of distributed learning using local data stored at clients with a coordinating server. Recent studies showed that FL can suffer from poor performance and slower convergence when training data…

Machine Learning · Computer Science 2023-08-17 Van Sy Mai , Richard J. La , Tao Zhang

Uncertainty Sampling is an Active Learning strategy that aims to improve the data efficiency of machine learning models by iteratively acquiring labels of data points with the highest uncertainty. While it has proven effective for…

Machine Learning · Computer Science 2025-02-28 Dominik Fuchsgruber , Tom Wollschläger , Bertrand Charpentier , Antonio Oroz , Stephan Günnemann

Federated Learning (FL) represents a paradigm shift in the field of machine learning, offering an approach for a decentralized training of models across a multitude of devices while maintaining the privacy of local data. However, the…

Machine Learning · Computer Science 2024-08-21 Tatjana Legler , Vinit Hegiste , Martin Ruskowski

Machine learning in medical research, by nature, needs careful attention on obeying the regulations of data privacy, making it difficult to train a machine learning model over gathered data from different medical centers. Failure of…

Machine Learning · Computer Science 2021-10-19 Jun Luo , Shandong Wu

The sampling of graph signals has recently drawn much attention due to the wide applications of graph signal processing. While a lot of efficient methods and interesting results have been reported to the sampling of band-limited or smooth…

Signal Processing · Electrical Eng. & Systems 2025-01-01 Yingcheng Lai , Li Chai , Jinming Xu