English
Related papers

Related papers: Federated PAC-Bayesian Learning on Non-IID data

200 papers

As a promising method of central model training on decentralized device data while securing user privacy, Federated Learning (FL)is becoming popular in Internet of Things (IoT) design. However, when the data collected by IoT devices are…

Machine Learning · Computer Science 2022-02-01 Tian Liu , Jiahao Ding , Ting Wang , Miao Pan , Mingsong Chen

Federated Learning (FL) has emerged as a prominent privacy-preserving technique for enabling use cases like confidential clinical machine learning. FL operates by aggregating models trained by remote devices which owns the data. Thus, FL…

Machine Learning · Computer Science 2024-04-23 Michael Duchesne , Kaiwen Zhang , Chamseddine Talhi

We propose a general framework for studying adaptive regret bounds in the online learning framework, including model selection bounds and data-dependent bounds. Given a data- or model-dependent bound we ask, "Does there exist some algorithm…

Machine Learning · Computer Science 2020-02-14 Dylan J. Foster , Alexander Rakhlin , Karthik Sridharan

A learning method is self-certified if it uses all available data to simultaneously learn a predictor and certify its quality with a tight statistical certificate that is valid on unseen data. Recent work has shown that neural network…

Machine Learning · Computer Science 2021-12-13 Maria Perez-Ortiz , Omar Rivasplata , Emilio Parrado-Hernandez , Benjamin Guedj , John Shawe-Taylor

Federated Learning (FL) is a novel distributed machine learning approach to leverage data from Internet of Things (IoT) devices while maintaining data privacy. However, the current FL algorithms face the challenges of non-independent and…

Machine Learning · Computer Science 2023-12-20 Gang Hu , Yinglei Teng , Nan Wang , F. Richard Yu

We develop a unified Data Processing Inequality PAC-Bayesian framework -- abbreviated DPI-PAC-Bayesian -- for deriving generalization error bounds in the supervised learning setting. By embedding the Data Processing Inequality (DPI) into…

Information Theory · Computer Science 2025-08-26 Muhan Guan , Farhad Farokhi , Jingge Zhu

Federated learning (FL) is an approach to training machine learning models that takes advantage of multiple distributed datasets while maintaining data privacy and reducing communication costs associated with sharing local datasets.…

Machine Learning · Computer Science 2024-12-06 John Fischer , Marko Orescanin , Justin Loomis , Patrick McClure

We are motivated by the problem of providing strong generalization guarantees in the context of meta-learning. Existing generalization bounds are either challenging to evaluate or provide vacuous guarantees in even relatively simple…

Machine Learning · Computer Science 2021-10-27 Alec Farid , Anirudha Majumdar

A novel approximate Bayesian filter based on backward stochastic differential equations is introduced. It uses a nonlinear Feynman--Kac representation of the filtering problem and the approximation of an unnormalized filtering density using…

Numerical Analysis · Mathematics 2026-04-21 Kasper Bågmark , Adam Andersson , Stig Larsson

Federated Learning has emerged as a promising approach to train machine learning models on decentralized data sources while preserving data privacy. This paper proposes a new federated approach for Naive Bayes (NB) classification, assuming…

Machine Learning · Computer Science 2025-02-04 Pablo Torrijos , Juan C. Alfaro , José A. Gámez , José M. Puerta

PAC-Bayesian bounds have proven to be a valuable tool for deriving generalization bounds and for designing new learning algorithms in machine learning. However, it typically focus on providing generalization bounds with respect to a chosen…

Machine Learning · Statistics 2024-08-19 The Tien Mai

Federated Learning (FL) provides a privacy-preserving mechanism for distributed training of machine learning models on networked devices (e.g., mobile devices, IoT edge nodes). It enables Artificial Intelligence (AI) at the edge by creating…

Machine Learning · Computer Science 2024-04-03 Paul Joe Maliakel , Shashikant Ilager , Ivona Brandic

We demonstrate that Bayesian machine learning can be used to treat the vast amount of experimental fission data which are noisy, incomplete, discrepant, and correlated. As an example, the two-dimensional cumulative fission yields (CFY) of…

Nuclear Theory · Physics 2022-09-14 Z. A. Wang , J. C. Pei , Y. J. Chen , C. Y. Qiao , F. R. Xu , Z. G. Ge , N. C. Shu

Federated learning (FL) is an emerging distributed machine learning paradigm enabling collaborative model training on decentralized devices without exposing their local data. A key challenge in FL is the uneven data distribution across…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-08 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

We present a federated learning approach for learning a client adaptable, robust model when data is non-identically and non-independently distributed (non-IID) across clients. By simulating heterogeneous clients, we show that adding learned…

Machine Learning · Computer Science 2020-07-10 Laura Rieger , Rasmus M. Th. Høegh , Lars K. Hansen

Personalized Federated Learning (PFL) enables a collection of agents to collaboratively learn individual models without sharing raw data. We propose a new PFL approach in which each agent optimizes a weighted combination of all agents'…

Machine Learning · Computer Science 2026-03-04 Jean-Baptiste Fermanian , Batiste Le Bars , Aurélien Bellet

Federated Learning (FL) is a distributed learning scheme to train a shared model across clients. One common and fundamental challenge in FL is that the sets of data across clients could be non-identically distributed and have different…

Machine Learning · Computer Science 2023-05-23 Junyi Zhu , Xingchen Ma , Matthew B. Blaschko

Bayesian Federated Learning (FL) has been recently introduced to provide well-calibrated Machine Learning (ML) models quantifying the uncertainty of their predictions. Despite their advantages compared to frequentist FL setups, Bayesian FL…

Machine Learning · Computer Science 2024-05-12 Luca Barbieri , Stefano Savazzi , Monica Nicoli

Personalized Bayesian federated learning (PBFL) handles non-i.i.d. client data and quantifies uncertainty by combining personalization with Bayesian inference. However, existing PBFL methods face two limitations: restrictive parametric…

Machine Learning · Computer Science 2025-10-14 Ting Wei , Biao Mei , Junliang Lyu , Renquan Zhang , Feng Zhou , Yifan Sun

To satisfy the broad applications and insatiable hunger for deploying low latency multimedia data classification and data privacy in a cloud-based setting, federated learning (FL) has emerged as an important learning paradigm. For the…

Machine Learning · Computer Science 2023-08-14 Achintha Wijesinghe , Songyang Zhang , Siyu Qi , Zhi Ding