English
Related papers

Related papers: Taming the Instability: A Robust Second-Order Opti…

200 papers

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Recommender systems play a pivotal role across practical scenarios, showcasing remarkable capabilities in user preference modeling. However, the centralized learning paradigm predominantly used raises serious privacy concerns. The federated…

Information Retrieval · Computer Science 2024-11-05 Langming Liu , Wanyu Wang , Xiangyu Zhao , Zijian Zhang , Chunxu Zhang , Shanru Lin , Yiqi Wang , Lixin Zou , Zitao Liu , Xuetao Wei , Hongzhi Yin , Qing Li

Noisy labels in distributed datasets induce severe local overfitting and consequently compromise the global model in federated learning (FL). Most existing solutions rely on selecting clean devices or aligning with public clean datasets,…

Machine Learning · Computer Science 2026-03-05 Xiangyu Zhong , Xiaojun Yuan , Ying-Jun Angela Zhang

Federated learning with heterogeneous clients remains a significant challenge for deep learning, primarily due to client drift arising from inconsistent local updates. Existing federated optimization methods typically address this issue…

Machine Learning · Computer Science 2026-05-08 Junye Du , Zhenghao Li , Yushi Feng , Long Feng

Federated learning (FL) enables a set of distributed clients to jointly train machine learning models while preserving their local data privacy, making it attractive for applications in healthcare, finance, mobility, and smart-city systems.…

Machine Learning · Computer Science 2026-03-26 Eman M. AbouNassar , Amr Elshall , Sameh Abdulah

Federated learning is a new distributed machine learning framework, where a bunch of heterogeneous clients collaboratively train a model without sharing training data. In this work, we consider a practical and ubiquitous issue when…

Machine Learning · Statistics 2023-09-06 Yikai Yan , Chaoyue Niu , Yucheng Ding , Zhenzhe Zheng , Fan Wu , Guihai Chen , Shaojie Tang , Zhihua Wu

Federated Learning (FL) confronts a significant challenge known as data heterogeneity, which impairs model performance and convergence. Existing methods have made notable progress in addressing this issue. However, improving performance in…

Machine Learning · Computer Science 2025-10-24 Zhiqin Yang , Yonggang Zhang , Chenxin Li , Yiu-ming Cheung , Bo Han , Yixuan Yuan

Federated learning is an emerging data-private distributed learning framework, which, however, is vulnerable to adversarial attacks. Although several heuristic defenses are proposed to enhance the robustness of federated learning, they do…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Bhavya Kailkhura , Ryan Goldhahn , Yi Zhou

A novel distributed algorithm is proposed for finite-time converging to a feasible consensus solution satisfying global optimality to a certain accuracy of the distributed robust convex optimization problem (DRCO) subject to bounded…

Optimization and Control · Mathematics 2023-09-06 Xunhao Wu , Jun Fu

Federated learning is a communication-efficient training process that alternates between local training at the edge devices and averaging the updated local model at the central server. Nevertheless, it is impractical to achieve a perfect…

Machine Learning · Computer Science 2019-11-04 Fan Ang , Li Chen , Nan Zhao , Yunfei Chen , Weidong Wang , F. Richard Yu

Adaptive optimization has achieved notable success for distributed learning while extending adaptive optimizer to federated Learning (FL) suffers from severe inefficiency, including (i) rugged convergence due to inaccurate gradient…

Machine Learning · Computer Science 2023-08-02 Yan Sun , Li Shen , Hao Sun , Liang Ding , Dacheng Tao

Robust optimization is an established framework for modeling optimization problems with uncertain parameters. While static robust optimization is often criticized for being too conservative, two-stage (or adjustable) robust optimization…

Optimization and Control · Mathematics 2024-11-05 Justin Dumouchelle , Esther Julien , Jannis Kurtz , Elias B. Khalil

Federated learning faces challenges due to the heterogeneity in data volumes and distributions at different clients, which can compromise model generalization ability to various distributions. Existing approaches to address this issue based…

Machine Learning · Computer Science 2024-11-13 Zhishuai Guo , Tianbao Yang

We present a class of methods for robust, personalized federated learning, called Fed+, that unifies many federated learning algorithms. The principal advantage of this class of methods is to better accommodate the real-world…

Machine Learning · Computer Science 2022-07-13 Achintya Kundu , Pengqian Yu , Laura Wynter , Shiau Hong Lim

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables neural network training across devices without centralizing data. While this addresses issues of information sharing and data privacy, challenges…

Machine Learning · Computer Science 2024-12-09 Jiayu Liu , Yong Wang , Nianbin Wang , Jing Yang , Xiaohui Tao

In this paper we envision a federated learning (FL) scenario in service of amending the performance of autonomous road vehicles, through a drone traffic monitor (DTM), that also acts as an orchestrator. Expecting non-IID data distribution,…

Machine Learning · Computer Science 2021-08-06 Igor Donevski , Jimmy Jessen Nielsen , Petar Popovski

Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and memory…

Machine Learning · Computer Science 2026-04-30 Yutong He , Zhengyang Huang , Jiahe Geng

Robust trajectory optimization enables autonomous systems to operate safely under uncertainty by computing control policies that satisfy the constraints for all bounded disturbances. However, these problems often lead to large Second Order…

Robotics · Computer Science 2026-05-19 Jiawei Wang , Arshiya Taj Abdul , Evangelos A. Theodorou

Federated bilevel optimization (FBO) has shown great potential recently in machine learning and edge computing due to the emerging nested optimization structure in meta-learning, fine-tuning, hyperparameter tuning, etc. However, existing…

Machine Learning · Computer Science 2023-12-29 Yifan Yang , Peiyao Xiao , Kaiyi Ji

Federated Learning (FL) is a promising paradigm for realizing edge intelligence, allowing collaborative learning among distributed edge devices by sharing models instead of raw data. However, the shared models are often assumed to be ideal,…

Machine Learning · Computer Science 2025-06-02 Dongzi Jin , Yong Xiao , Yingyu Li