English
Related papers

Related papers: FedHPO-B: A Benchmark Suite for Federated Hyperpar…

200 papers

Federated Learning (FL) is a decentralized collaborative Machine Learning framework for training models without collecting data in a centralized location. It has seen application across various disciplines, from helping medical diagnoses in…

Machine Learning · Computer Science 2025-06-26 Arno Geimer , Karthick Panner Selvam , Beltran Fiz Pontiveros

Bayesian Optimization (BO) is a common approach for hyperparameter optimization (HPO) in automated machine learning. Although it is well-accepted that HPO is crucial to obtain well-performing machine learning models, tuning BO's own…

Machine Learning · Computer Science 2019-08-20 Marius Lindauer , Matthias Feurer , Katharina Eggensperger , André Biedenkapp , Frank Hutter

Federated learning (FL) is a promising technique for addressing the rising privacy and security issues. Its main ingredient is to cooperatively learn the model among the distributed clients without uploading any sensitive data. In this…

Artificial Intelligence · Computer Science 2023-03-07 Huiming Chen , Huandong Wang , Qingyue Long , Depeng Jin , Yong Li

Hyperparameters are a critical factor in reliably training well-performing reinforcement learning (RL) agents. Unfortunately, developing and evaluating automated approaches for tuning such hyperparameters is both costly and time-consuming.…

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

Federated learning (FL) is a distributed machine learning technique that enables collaborative model training while avoiding explicit data sharing. The inherent privacy-preserving property of FL algorithms makes them especially attractive…

Tuning machine learning models at scale, especially finding the right hyperparameter values, can be difficult and time-consuming. In addition to the computational effort required, this process also requires some ancillary efforts including…

Machine Learning · Computer Science 2019-11-07 Jiayi Liu , Samarth Tripathi , Unmesh Kurup , Mohak Shah

The emergence of federated learning (FL) presents a promising approach to leverage decentralized data while preserving privacy. Furthermore, the combination of FL and anomaly detection is particularly compelling because it allows for…

Machine Learning · Computer Science 2024-08-09 Ahmed Anwar , Brian Moser , Dayananda Herurkar , Federico Raue , Vinit Hegiste , Tatjana Legler , Andreas Dengel

Bayesian optimization (BO) has recently been extended to the federated learning (FL) setting by the federated Thompson sampling (FTS) algorithm, which has promising applications such as federated hyperparameter tuning. However, FTS is not…

Machine Learning · Computer Science 2021-10-28 Zhongxiang Dai , Bryan Kian Hsiang Low , Patrick Jaillet

Federated Learning (FL) is a distributed learning paradigm that can learn a global or personalized model from decentralized datasets on edge devices. However, in the computer vision domain, model performance in FL is far behind centralized…

Federated Learning (FL) has emerged as a significant paradigm for training machine learning models. This is due to its data-privacy-preserving property and its efficient exploitation of distributed computational resources. This is achieved…

Machine Learning · Computer Science 2025-01-22 Mustafa Ghaleb , Mohanad Obeed , Muhamad Felemban , Anas Chaaban , Halim Yanikomeroglu

In continual learning (CL) -- where a learner trains on a stream of data -- standard hyperparameter optimisation (HPO) cannot be applied, as a learner does not have access to all of the data at the same time. This has prompted the…

Machine Learning · Computer Science 2025-03-17 Thomas L. Lee , Sigrid Passano Hellan , Linus Ericsson , Elliot J. Crowley , Amos Storkey

Personalized Federated Learning (PFL) is widely employed in IoT applications to handle high-volume, non-iid client data while ensuring data privacy. However, heterogeneous edge devices owned by clients may impose varying degrees of resource…

Machine Learning · Computer Science 2025-04-15 Ziru Niu , Hai Dong , A. K. Qin

Federated Learning (FL) is a decentralized machine learning protocol that allows a set of participating agents to collaboratively train a model without sharing their data. This makes FL particularly suitable for settings where data privacy…

Machine Learning · Computer Science 2020-10-30 Mustafa Safa Ozdayi , Murat Kantarcioglu , Rishabh Iyer

Personalized Federated Learning (PFL) enables clients to collaboratively train personalized models tailored to their individual objectives, addressing the challenge of model generalization in traditional Federated Learning (FL) due to high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-10 Mrinmay Sen , Chalavadi Krishna Mohan

Federated Learning (FL) facilitates collaborative model training while keeping raw data decentralized, making it a conduit for leveraging the power of IoT devices while maintaining privacy of the locally collected data. However, existing…

Cryptography and Security · Computer Science 2025-09-26 Amr Akmal Abouelmagd , Amr Hilal

Federated Learning (FL) enables decentralized, privacy-preserving model training but struggles to balance global generalization and local personalization due to non-identical data distributions across clients. Personalized Fine-Tuning…

Machine Learning · Computer Science 2025-12-30 Minghui Chen , Hrad Ghoukasian , Ruinan Jin , Zehua Wang , Sai Praneeth Karimireddy , Xiaoxiao Li

We propose Federated Preconditioned Mixing (FedPM), a novel Federated Learning (FL) method that leverages second-order optimization. Prior methods--such as LocalNewton, LTDA, and FedSophia--have incorporated second-order optimization in FL…

Machine Learning · Computer Science 2025-11-13 Hiro Ishii , Kenta Niwa , Hiroshi Sawada , Akinori Fujino , Noboru Harada , Rio Yokota

Model-based Reinforcement Learning (MBRL) is a promising framework for learning control in a data-efficient manner. MBRL algorithms can be fairly complex due to the separate dynamics modeling and the subsequent planning algorithm, and as a…

Machine Learning · Computer Science 2021-03-01 Baohe Zhang , Raghu Rajan , Luis Pineda , Nathan Lambert , André Biedenkapp , Kurtland Chua , Frank Hutter , Roberto Calandra

As the demand grows for scalable and privacy-aware AI systems, Federated Learning (FL) has emerged as a promising solution, allowing decentralized model training without moving raw data. At the same time, the combination of high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-26 Sangam Ghimire , Paribartan Timalsina , Nirjal Bhurtel , Bishal Neupane , Bigyan Byanju Shrestha , Subarna Bhattarai , Prajwal Gaire , Jessica Thapa , Sudan Jha