English
Related papers

Related papers: Taming the Instability: A Robust Second-Order Opti…

200 papers

Federated Learning (FL) provides decentralised model training, which effectively tackles problems such as distributed data and privacy preservation. However, the generalisation of global models frequently faces challenges from data…

Machine Learning · Computer Science 2025-09-05 Ozgu Goksu , Nicolas Pugeault

Iterative steady-state solvers are widely used in computational fluid dynamics. Unfortunately, it is difficult to obtain steady-state solution for unstable problem caused by physical instability and numerical instability. Optimization is a…

Computational Engineering, Finance, and Science · Computer Science 2023-11-21 Wenbo Cao , Yilang Liu , Xianglin Shan , Chuanqiang Gao , Weiwei Zhang

Federated learning (FL) has emerged as a solution to deal with the risk of privacy leaks in machine learning training. This approach allows a variety of mobile devices to collaboratively train a machine learning model without sharing the…

Machine Learning · Computer Science 2022-12-01 Young Geun Kim , Carole-Jean Wu

Federated Learning (FL) enables collaborative training of autonomous driving (AD) models across distributed vehicles while preserving data privacy. However, FL encounters critical challenges such as poor generalization and slow convergence…

Robotics · Computer Science 2025-12-09 Wei-Bin Kou , Guangxu Zhu , Bingyang Cheng , Chen Zhang , Yik-Chung Wu , Jianping Wang

Decision-focused learning integrates predictive modeling and combinatorial optimization by training models to directly improve decision quality rather than prediction accuracy alone. Differentiating through combinatorial optimization…

Machine Learning · Computer Science 2026-01-30 Victor Spitzer , Francois Sanson

Federated Learning (FL) has emerged as a powerful paradigm for training machine learning models in a decentralized manner, preserving data privacy by keeping local data on clients. However, evaluating the robustness of these models against…

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

Federated learning allows loads of edge computing devices to collaboratively learn a global model without data sharing. The analysis with partial device participation under non-IID and unbalanced data reflects more reality. In this work, we…

Machine Learning · Computer Science 2020-12-23 Qianqian Tong , Guannan Liang , Jinbo Bi

Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which…

Machine Learning · Computer Science 2023-12-25 Tiejin Chen , Yuanpu Cao , Yujia Wang , Cho-Jui Hsieh , Jinghui Chen

Federated Learning (FL) is an emerging framework for distributed processing of large data volumes by edge devices subject to limited communication bandwidths, heterogeneity in data distributions and computational resources, as well as…

Machine Learning · Computer Science 2022-04-11 Yonghai Gong , Yichuan Li , Nikolaos M. Freris

Federated learning is a privacy-preserving machine learning technique that learns a shared model across decentralized clients. It can alleviate privacy concerns of personal re-identification, an important computer vision task. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Weiming Zhuang , Yonggang Wen , Xuesen Zhang , Xin Gan , Daiying Yin , Dongzhan Zhou , Shuai Zhang , Shuai Yi

Adaptive optimization is critical in federated learning, where enabling adaptivity on both the server and client sides has proven essential for achieving optimal performance. However, the scalability of such jointly adaptive systems is…

Machine Learning · Computer Science 2025-10-28 Su Hyeong Lee , Sidharth Sharma , Manzil Zaheer , Tian Li

We study a hierarchical federated learning (FL) problem, where clients cooperatively seek to select among multiple optimal solutions of a primary distributed learning problem, a solution that minimizes a secondary loss function. This…

Optimization and Control · Mathematics 2026-05-26 Mohammadjavad Ebrahimi , Yuyang Qiu , Shisheng Cui , Farzad Yousefian

Federated Learning (FL), a distributed machine learning technique has recently experienced tremendous growth in popularity due to its emphasis on user data privacy. However, the distributed computations of FL can result in constrained…

Machine Learning · Computer Science 2023-12-12 Md Zarif Hossain , Ahmed Imteaj

We propose Federated Preconditioned Mixing (FedPM), a novel Federated Learning (FL) method that leverages second-order optimization. Prior methods--such as LocalNewton, LTDA, and FedSophia--have incorporated second-order optimization in FL…

Machine Learning · Computer Science 2025-11-13 Hiro Ishii , Kenta Niwa , Hiroshi Sawada , Akinori Fujino , Noboru Harada , Rio Yokota

Federated learning aims to protect users' privacy while performing data analysis from different participants. However, it is challenging to guarantee the training efficiency on heterogeneous systems due to the various computational…

Machine Learning · Computer Science 2021-08-23 Junyu Luo , Jianlei Yang , Xucheng Ye , Xin Guo , Weisheng Zhao

Robust topology optimization (RTO), as a class of topology optimization problems, identifies a design with the best average performance while reducing the response sensitivity to input uncertainties, e.g. load uncertainty. Solving RTO is…

Machine Learning · Computer Science 2024-08-22 Rini Jasmine Gladstone , Mohammad Amin Nabian , Vahid Keshavarzzadeh , Hadi Meidani

In federated learning (FL), a cluster of local clients are chaired under the coordination of the global server and cooperatively train one model with privacy protection. Due to the multiple local updates and the isolated non-iid dataset,…

Machine Learning · Computer Science 2024-04-02 Yan Sun , Li Shen , Shixiang Chen , Liang Ding , Dacheng Tao

Federated optimization studies the problem of collaborative function optimization among multiple clients (e.g. mobile devices or organizations) under the coordination of a central server. Since the data is collected separately by each…

Machine Learning · Computer Science 2023-11-06 Chuanhao Li , Chong Liu , Yu-Xiang Wang

Federated learning is a popular distributed and privacy-preserving learning paradigm in machine learning. Recently, some federated learning algorithms have been proposed to solve the distributed minimax problems. However, these federated…

Machine Learning · Computer Science 2024-03-01 Feihu Huang , Xinrui Wang , Junyi Li , Songcan Chen