English
Related papers

Related papers: Federated Empirical Risk Minimization via Second-O…

200 papers

We propose a federated learning method with weighted nodes in which the weights can be modified to optimize the model's performance on a separate validation set. The problem is formulated as a bilevel optimization where the inner problem is…

Machine Learning · Computer Science 2022-10-11 Yankun Huang , Qihang Lin , Nick Street , Stephen Baek

Recommender systems play a pivotal role across practical scenarios, showcasing remarkable capabilities in user preference modeling. However, the centralized learning paradigm predominantly used raises serious privacy concerns. The federated…

Information Retrieval · Computer Science 2024-11-05 Langming Liu , Wanyu Wang , Xiangyu Zhao , Zijian Zhang , Chunxu Zhang , Shanru Lin , Yiqi Wang , Lixin Zou , Zitao Liu , Xuetao Wei , Hongzhi Yin , Qing Li

Federated Learning (FL) is an increasingly popular machine learning paradigm in which multiple nodes try to collaboratively learn under privacy, communication and multiple heterogeneity constraints. A persistent problem in federated…

Machine Learning · Computer Science 2022-02-24 Elnur Gasanov , Ahmed Khaled , Samuel Horváth , Peter Richtárik

In today's world, the rapid expansion of IoT networks and the proliferation of smart devices in our daily lives, have resulted in the generation of substantial amounts of heterogeneous data. These data forms a stream which requires special…

Machine Learning · Computer Science 2023-12-27 Sofia Zahri , Hajar Bennouri , Ahmed M. Abdelmoniem

Federated Learning (FL) is an approach to conduct machine learning without centralizing training data in a single place, for reasons of privacy, confidentiality or data volume. However, solving federated machine learning problems raises…

Dimensionality Reduction is a commonly used element in a machine learning pipeline that helps to extract important features from high-dimensional data. In this work, we explore an alternative federated learning system that enables…

Machine Learning · Computer Science 2020-11-16 Anna Bogdanova , Akie Nakai , Yukihiko Okada , Akira Imakura , Tetsuya Sakurai

Federated Learning (FL) is an emerging framework for distributed processing of large data volumes by edge devices subject to limited communication bandwidths, heterogeneity in data distributions and computational resources, as well as…

Machine Learning · Computer Science 2022-04-11 Yonghai Gong , Yichuan Li , Nikolaos M. Freris

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

Federated Learning is a leading framework for training ML and AI models collaboratively across numerous user devices or databases. We study the trade-offs among estimation accuracy, privacy constraints, and communication cost for…

Machine Learning · Statistics 2026-05-19 Arnab Auddy , Xiangni Peng , Subhadeep Paul

Consider two data providers, each maintaining private records of different feature sets about common entities. They aim to learn a linear model jointly in a federated setting, namely, data is local and a shared model is trained from locally…

Machine Learning · Computer Science 2017-11-30 Stephen Hardy , Wilko Henecka , Hamish Ivey-Law , Richard Nock , Giorgio Patrini , Guillaume Smith , Brian Thorne

Federated learning (FL) has gained a lot of attention in recent years for building privacy-preserving collaborative learning systems. However, FL algorithms for constrained machine learning problems are still limited, particularly when the…

Machine Learning · Computer Science 2024-08-20 Ali Dadras , Sourasekhar Banerjee , Karthik Prakhya , Alp Yurtsever

Traditional approaches to differential privacy assume a fixed privacy requirement $\epsilon$ for a computation, and attempt to maximize the accuracy of the computation subject to the privacy constraint. As differential privacy is…

Machine Learning · Computer Science 2017-06-01 Katrina Ligett , Seth Neel , Aaron Roth , Bo Waggoner , Z. Steven Wu

Federated Learning (FL) has emerged as a powerful paradigm for collaborative machine learning across decentralized data sources, preserving privacy by keeping data local. However, increasing legal and ethical demands, such as the "right to…

Machine Learning · Computer Science 2026-02-09 Radmehr Karimian , Amirhossein Bagheri , Meghdad Kurmanji , Nicholas D. Lane , Gholamali Aminian

Industrial chemical plants often operate under strict data confidentiality constraints, making centralized data-driven process modeling difficult. Federated learning (FL) provides a promising solution by enabling collaborative model…

Machine Learning · Computer Science 2026-04-30 Teetat Pipattaratonchai , Aueaphum Aueawatthanaphisut

Recently, invariant risk minimization (IRM) was proposed as a promising solution to address out-of-distribution (OOD) generalization. However, it is unclear when IRM should be preferred over the widely-employed empirical risk minimization…

Machine Learning · Computer Science 2022-08-22 Kartik Ahuja , Jun Wang , Amit Dhurandhar , Karthikeyan Shanmugam , Kush R. Varshney

The field of Machine Learning has changed significantly since the 1970s. However, its most basic principle, Empirical Risk Minimization (ERM), remains unchanged. We propose Functional Risk Minimization~(FRM), a general framework where…

Federated learning has attracted significant attention as a privacy-preserving framework for training personalised models on multi-source heterogeneous data. However, most existing approaches are unable to handle scenarios where subgroup…

Methodology · Statistics 2025-10-14 Changxin Yang , Zhongyi Zhu , Heng Lian

Federated learning (FL), as a collaborative distributed training paradigm with several edge computing devices under the coordination of a centralized server, is plagued by inconsistent local stationary points due to the heterogeneity of the…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Yixing Liu , Yan Sun , Zhengtao Ding , Li Shen , Bo Liu , Dacheng Tao

Anomaly and missing data constitute a thorny problem in industrial applications. In recent years, deep learning enabled anomaly detection has emerged as a critical direction, however the improved detection accuracy is achieved with the…

Machine Learning · Computer Science 2024-11-07 Alexandros Gkillas , Aris Lalos

Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces…

Machine Learning · Computer Science 2022-04-19 Bingzhe Wu , Zhipeng Liang , Yuxuan Han , Yatao Bian , Peilin Zhao , Junzhou Huang