中文
相关论文

相关论文: Federated Nonconvex Sparse Learning

200 篇论文

State-of-the-art federated learning methods can perform far worse than their centralized counterparts when clients have dissimilar data distributions. For neural networks, even when centralized SGD easily finds a solution that is…

机器学习 · 计算机科学 2022-10-06 Yaodong Yu , Alexander Wei , Sai Praneeth Karimireddy , Yi Ma , Michael I. Jordan

High-altitude platform stations (HAPS) enable large-scale federated learning (FL) in non-terrestrial networks (NTN) by providing wide-area coverage and predominantly line-of-sight (LoS) connectivity to many ground users. However, practical…

网络与互联网体系结构 · 计算机科学 2026-04-03 Amin Farajzadeh , Animesh Yadav , Halim Yanikomeroglu

Federated learning has become a promising solution for collaboration among medical institutions. However, data owned by each institution would be highly heterogeneous and the distribution is always non-independent and identical distribution…

机器学习 · 计算机科学 2024-12-25 Guochen Yan , Luyuan Xie , Xinyi Gao , Wentao Zhang , Qingni Shen , Yuejian Fang , Zhonghai Wu

We propose a simple modification to the iterative hard thresholding (IHT) algorithm, which recovers asymptotically sparser solutions as a function of the condition number. When aiming to minimize a convex function $f(x)$ with condition…

最优化与控制 · 数学 2022-04-19 Kyriakos Axiotis , Maxim Sviridenko

Joint sparsity has attracted considerable attention in recent years in many fields including sparse signal recovery in compressed sensing (CS), statistics, and machine learning. Traditional convex models suffer from the suboptimal…

数值分析 · 计算机科学 2017-06-27 Yaru Fan , Yilun Wang , Tingzhu Huang

There is a growing interest in the distributed optimization framework that goes under the name of Federated Learning (FL). In particular, much attention is being turned to FL scenarios where the network is strongly heterogeneous in terms of…

机器学习 · 计算机科学 2022-09-14 Nicolò Dal Fabbro , Subhrakanti Dey , Michele Rossi , Luca Schenato

Federated learning is an emerging distributed machine learning framework for privacy preservation. However, models trained in federated learning usually have worse performance than those trained in the standard centralized learning mode,…

机器学习 · 计算机科学 2021-06-15 Hangyu Zhu , Jinjin Xu , Shiqing Liu , Yaochu Jin

Federated learning has emerged as a popular technique for distributing machine learning (ML) model training across the wireless edge. In this paper, we propose two timescale hybrid federated learning (TT-HF), a semi-decentralized learning…

In this paper, we analyze the generalization performance of the Iterative Hard Thresholding (IHT) algorithm widely used for sparse recovery problems. The parameter estimation and sparsity recovery consistency of IHT has long been known in…

机器学习 · 统计学 2022-03-18 Xiao-Tong Yuan , Ping Li

Federated learning refers to the task of machine learning based on decentralized data from multiple clients with secured data privacy. Recent studies show that quantum algorithms can be exploited to boost its performance. However, when the…

量子物理 · 物理学 2023-01-19 Haimeng Zhao

Federated learning (FL) is a distributed machine learning architecture that leverages a large number of workers to jointly learn a model with decentralized data. FL has received increasing attention in recent years thanks to its data…

机器学习 · 计算机科学 2021-05-05 Haibo Yang , Minghong Fang , Jia Liu

We consider the problem of in-network compressed sensing from distributed measurements. Every agent has a set of measurements of a signal $x$, and the objective is for the agents to recover $x$ from their collective measurements using only…

信息论 · 计算机科学 2015-06-17 Stacy Patterson , Yonina C. Eldar , Idit Keidar

Federated Learning (FL) plays a critical role in distributed systems. In these systems, data privacy and confidentiality hold paramount importance, particularly within edge-based data processing systems such as IoT devices deployed in smart…

机器学习 · 计算机科学 2024-03-08 Humaid Ahmed Desai , Amr Hilal , Hoda Eldardiry

Federated learning has emerged as a new paradigm of collaborative machine learning; however, it has also faced several challenges such as non-independent and identically distributed(IID) data and high communication cost. To this end, we…

机器学习 · 计算机科学 2020-12-10 Jin-woo Lee , Jaehoon Oh , Yooju Shin , Jae-Gil Lee , Se-Young Yoon

Federated Learning (FL) is a promising distributed machine learning approach that enables collaborative training of a global model using multiple edge devices. The data distributed among the edge devices is highly heterogeneous. Thus, FL…

分布式、并行与集群计算 · 计算机科学 2025-07-16 Ji Liu , Beichen Ma , Qiaolin Yu , Ruoming Jin , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Haixun Wang , Dejing Dou , Patrick Valduriez

Federated learning enables a large amount of edge computing devices to jointly learn a model without data sharing. As a leading algorithm in this setting, Federated Averaging (\texttt{FedAvg}) runs Stochastic Gradient Descent (SGD) in…

机器学习 · 统计学 2020-06-26 Xiang Li , Kaixuan Huang , Wenhao Yang , Shusen Wang , Zhihua Zhang

Federated learning has emerged as a popular technique for distributing model training across the network edge. Its learning architecture is conventionally a star topology between the devices and a central server. In this paper, we propose…

Federated Learning (FL) is a distributed machine learning framework in communication network systems. However, the systems' Non-Independent and Identically Distributed (Non-IID) data negatively affect the convergence efficiency of the…

机器学习 · 计算机科学 2025-07-04 Ping Luo , Xiaoge Deng , Ziqing Wen , Tao Sun , Dongsheng Li

This paper investigates federated learning (FL) in a multi-hop communication setup, such as in constellations with inter-satellite links. In this setup, part of the FL clients are responsible for forwarding other client's results to the…

分布式、并行与集群计算 · 计算机科学 2025-11-12 Sourav Mukherjee , Nasrin Razmi , Armin Dekorsy , Petar Popovski , Bho Matthiesen

Federated Learning is a novel framework that allows multiple devices or institutions to train a machine learning model collaboratively while preserving their data private. This decentralized approach is prone to suffer the consequences of…

机器学习 · 计算机科学 2021-11-29 Marcos F. Criado , Fernando E. Casado , Roberto Iglesias , Carlos V. Regueiro , Senén Barro