English
Related papers

Related papers: Fast convergence of a Federated Expectation-Maximi…

200 papers

We propose a novel algorithm for solving the composite Federated Learning (FL) problem. This algorithm manages non-smooth regularization by strategically decoupling the proximal operator and communication, and addresses client drift without…

Machine Learning · Computer Science 2023-09-06 Jiaojiao Zhang , Jiang Hu , Mikael Johansson

We develop a nested EM routine for latent class models with covariates which allows maximization of the full-model log-likelihood and, differently from current methods, guarantees monotone log-likelihood sequences along with improved…

Computation · Statistics 2019-11-19 Daniele Durante , Antonio Canale , Tommaso Rigon

The recent trend towards Personalized Federated Learning (PFL) has garnered significant attention as it allows for the training of models that are tailored to each client while maintaining data privacy. However, current PFL techniques…

Machine Learning · Computer Science 2023-05-03 Yue Wu , Shuaicheng Zhang , Wenchao Yu , Yanchi Liu , Quanquan Gu , Dawei Zhou , Haifeng Chen , Wei Cheng

While fairness-aware machine learning algorithms have been receiving increasing attention, the focus has been on centralized machine learning, leaving decentralized methods underexplored. Federated Learning is a decentralized form of…

Machine Learning · Computer Science 2023-07-04 Teresa Salazar , Miguel Fernandes , Helder Araujo , Pedro Henriques Abreu

We explore a Federated Reinforcement Learning (FRL) problem where $N$ agents collaboratively learn a common policy without sharing their trajectory data. To date, existing FRL work has primarily focused on agents operating in the same or…

Machine Learning · Computer Science 2024-06-03 Han Wang , Sihong He , Zhili Zhang , Fei Miao , James Anderson

Federated learning (FL) enables collaborative model training across distributed edge devices while preserving data privacy, and typically operates in a round-based synchronous manner. However, synchronous FL suffers from latency bottlenecks…

Machine Learning · Computer Science 2026-03-17 Asaf Goren , Natalie Lang , Nir Shlezinger , Alejandro Cohen

We introduce a novel hybrid methodology combining classical finite element methods (FEM) with neural networks to create a well-performing and generalizable surrogate model for forward and inverse problems. The residual from finite element…

Computational Engineering, Finance, and Science · Computer Science 2022-05-18 Rishith Ellath Meethal , Birgit Obst , Mohamed Khalil , Aditya Ghantasala , Anoop Kodakkal , Kai-Uwe Bletzinger , Roland Wüchner

Extreme Learning Machine (ELM) is an efficient and effective least-square-based learning algorithm for classification, regression problems based on single hidden layer feed-forward neural network (SLFN). It has been shown in the literature…

Machine Learning · Computer Science 2020-11-05 Ramesh Ragala , Bharadwaja kumar

Federated learning has emerged as an umbrella term for centralized coordination strategies in multi-agent environments. While many federated learning architectures process data in an online manner, and are hence adaptive by nature, most…

Machine Learning · Computer Science 2020-05-06 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

Federated Learning (FL) is a distributed machine learning approach where multiple clients work together to solve a machine learning task. One of the key challenges in FL is the issue of partial participation, which occurs when a large…

Machine Learning · Computer Science 2023-03-01 Grigory Malinovsky , Samuel Horváth , Konstantin Burlachenko , Peter Richtárik

Federated meta-learning (FML) has emerged as a promising paradigm to cope with the data limitation and heterogeneity challenges in today's edge learning arena. However, its performance is often limited by slow convergence and corresponding…

Machine Learning · Computer Science 2021-11-12 Sheng Yue , Ju Ren , Jiang Xin , Deyu Zhang , Yaoxue Zhang , Weihua Zhuang

Federated learning (FL) algorithms usually sample a fraction of clients in each round (partial participation) when the number of participants is large and the server's communication bandwidth is limited. Recent works on the convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Bing Luo , Wenli Xiao , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Any clustering algorithm must synchronously learn to model the clusters and allocate data to those clusters in the absence of labels. Mixture model-based methods model clusters with pre-defined statistical distributions and allocate data to…

Machine Learning · Computer Science 2022-10-04 Dumindu Tissera , Kasun Vithanage , Rukshan Wijesinghe , Alex Xavier , Sanath Jayasena , Subha Fernando , Ranga Rodrigo

Federated Learning (FL) has become a viable technique for realizing privacy-enhancing distributed deep learning on the network edge. Heterogeneous hardware, unreliable client devices, and energy constraints often characterize edge computing…

Machine Learning · Computer Science 2024-11-05 Herbert Woisetschläger , Alexander Erben , Ruben Mayer , Shiqiang Wang , Hans-Arno Jacobsen

The expectation-maximization (EM) algorithm is an iterative computational method to calculate the maximum likelihood estimators (MLEs) from the sample data. It converts a complicated one-time calculation for the MLE of the incomplete data…

Computation · Statistics 2016-08-08 Lingyao Meng

Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy…

Machine Learning · Computer Science 2021-07-21 Jonatan Reyes , Lisa Di Jorio , Cecile Low-Kam , Marta Kersten-Oertel

Federated learning (FL) is a distributed machine learning technology for next-generation AI systems that allows a number of workers, i.e., edge devices, collaboratively learn a shared global model while keeping their data locally to prevent…

Networking and Internet Architecture · Computer Science 2022-06-01 Pinyarash Pinyoanuntapong , Prabhu Janakaraj , Ravikumar Balakrishnan , Minwoo Lee , Chen Chen , Pu Wang

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Federated learning has received great attention for its capability to train a large-scale model in a decentralized manner without needing to access user data directly. It helps protect the users' private data from centralized collecting.…

Machine Learning · Computer Science 2023-02-07 Guodong Long , Ming Xie , Tao Shen , Tianyi Zhou , Xianzhi Wang , Jing Jiang , Chengqi Zhang

Classical Mixtures of Experts (MoE) are Machine Learning models that involve partitioning the input space, with a separate "expert" model trained on each partition. Recently, MoE-based model architectures have become popular as a means to…

Machine Learning · Computer Science 2025-10-14 Quentin Fruytier , Aryan Mokhtari , Sujay Sanghavi