English
Related papers

Related papers: High Dimensional Restrictive Federated Model Selec…

200 papers

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits…

Machine Learning · Computer Science 2023-12-05 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

We consider distributed statistical optimization in one-shot setting, where there are $m$ machines each observing $n$ i.i.d. samples. Based on its observed samples, each machine sends a $B$-bit-long message to a server. The server then…

Machine Learning · Computer Science 2020-01-01 Saber Salehkaleybar , Arsalan Sharifnassab , S. Jamaloddin Golestani

Statistical heterogeneity of clients' local data is an important characteristic in federated learning, motivating personalized algorithms tailored to the local data statistics. Though there has been a plethora of algorithms proposed for…

Machine Learning · Computer Science 2025-01-27 Kaan Ozkara , Bruce Huang , Ruida Zhou , Suhas Diggavi

In the social sciences, it is often necessary to debias studies and surveys before valid conclusions can be drawn. Debiasing algorithms enable the computational removal of bias using sample weights. However, an issue arises when only a…

Machine Learning · Computer Science 2026-03-03 Tony Hauptmann , Stefan Kramer

Federated learning (FL) is a distributed machine learning technique that enables collaborative model training while avoiding explicit data sharing. The inherent privacy-preserving property of FL algorithms makes them especially attractive…

Acquiring a substantial number of data points for training accurate machine learning (ML) models is a big challenge in scientific fields where data collection is resource-intensive. Here, we propose a novel approach for constructing a…

Machine Learning · Computer Science 2025-05-07 M. R. Mahani , Igor A. Nechepurenko , Yasmin Rahimof , Andreas Wicht

Federated Learning is a recent approach to train statistical models on distributed datasets without violating privacy constraints. The data locality principle is preserved by sharing the model instead of the data between clients and the…

Machine Learning · Statistics 2022-08-30 Mohamad Mohamad , Julian Neubert , Juan Segundo Argayo

Machine learning methods for estimating heterogeneous treatment effects (HTE) facilitate large-scale personalized decision-making across various domains such as healthcare, policy making, education, and more. Current machine learning…

Machine Learning · Computer Science 2024-06-25 Disha Makhija , Joydeep Ghosh , Yejin Kim

Dimensionality Reduction is a commonly used element in a machine learning pipeline that helps to extract important features from high-dimensional data. In this work, we explore an alternative federated learning system that enables…

Machine Learning · Computer Science 2020-11-16 Anna Bogdanova , Akie Nakai , Yukihiko Okada , Akira Imakura , Tetsuya Sakurai

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

Machine Learning · Computer Science 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Conditional stochastic optimization has found applications in a wide range of machine learning tasks, such as invariant learning, AUPRC maximization, and meta-learning. As the demand for training models with large-scale distributed data…

Machine Learning · Computer Science 2023-10-05 Xidong Wu , Jianhui Sun , Zhengmian Hu , Junyi Li , Aidong Zhang , Heng Huang

We consider Decision-Focused Federated Learning (DFFL), a predict-then-optimize setting in which multiple clients collaboratively train predictive models for downstream linear optimization problems without exchanging raw data. Besides the…

Optimization and Control · Mathematics 2026-05-19 Konstantinos Ziliaskopoulos , Alexander Vinel

Federated learning (FL) is a promising framework that models distributed machine learning while protecting the privacy of clients. However, FL suffers performance degradation from heterogeneous and limited data. To alleviate the…

Machine Learning · Computer Science 2023-03-09 Xu Zhang , Wenpeng Li , Yunfeng Shao , Yinchuan Li

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

Machine Learning · Computer Science 2022-11-28 Mann Patel

Federated learning (FL) is an approach to training machine learning models that takes advantage of multiple distributed datasets while maintaining data privacy and reducing communication costs associated with sharing local datasets.…

Machine Learning · Computer Science 2024-12-06 John Fischer , Marko Orescanin , Justin Loomis , Patrick McClure

Data-driven optimization has found many successful applications in the real world and received increased attention in the field of evolutionary optimization. Most existing algorithms assume that the data used for optimization is always…

Neural and Evolutionary Computing · Computer Science 2021-06-24 Jinjin Xu , Yaochu Jin , Wenli Du

We propose an asymptotic framework to analyze the performance of (personalized) federated learning algorithms. In this new framework, we formulate federated learning as a multi-criterion objective, where the goal is to minimize each…

Machine Learning · Computer Science 2022-02-21 Gary Cheng , Karan Chadha , John Duchi

Federated learning is a paradigm of distributed machine learning in which multiple clients coordinate with a central server to learn a model, without sharing their own training data. Standard federated optimization methods such as Federated…

Machine Learning · Computer Science 2024-05-15 Sohom Mukherjee , Nicolas Loizou , Sebastian U. Stich