English
Related papers

Related papers: On Sampling Strategies for Spectral Model Sharding

200 papers

Federated Learning aims at training a global model from multiple decentralized devices (i.e. clients) without exchanging their private local data. A key challenge is the handling of non-i.i.d. (independent identically distributed) data…

Machine Learning · Computer Science 2022-07-20 Xin Dong , Sai Qian Zhang , Ang Li , H. T. Kung

While federated learning traditionally aims to train a single global model across decentralized local datasets, one model may not always be ideal for all participating clients. Here we propose an alternative, where each client only…

Machine Learning · Computer Science 2021-03-30 Michael Zhang , Karan Sapra , Sanja Fidler , Serena Yeung , Jose M. Alvarez

Clustered federated Multitask learning is introduced as an efficient technique when data is unbalanced and distributed amongst clients in a non-independent and identically distributed manner. While a similarity metric can provide client…

Networking and Internet Architecture · Computer Science 2023-05-02 Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Abegaz Mohammed , Aiman Erbad , Octavia A. Dobre

We propose clustered federated multitask learning to address statistical challenges in non-independent and identically distributed data across clients. Our approach tackles complexities in hierarchical wireless networks by clustering…

Networking and Internet Architecture · Computer Science 2024-07-15 Moqbel Hamood , Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Amr Mohamed

Graph Convolutional Networks (GCNs) have achieved impressive empirical advancement across a wide variety of semi-supervised node classification tasks. Despite their great success, training GCNs on large graphs suffers from computational and…

Machine Learning · Computer Science 2021-11-02 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective…

Machine Learning · Computer Science 2022-09-15 Rongmei Lin , Yonghui Xiao , Tien-Ju Yang , Ding Zhao , Li Xiong , Giovanni Motta , Françoise Beaufays

Sampling methods (e.g., node-wise, layer-wise, or subgraph) has become an indispensable strategy to speed up training large-scale Graph Neural Networks (GNNs). However, existing sampling methods are mostly based on the graph structural…

Machine Learning · Computer Science 2021-09-07 Weilin Cong , Rana Forsati , Mahmut Kandemir , Mehrdad Mahdavi

Collaborative learning through latent shared feature representations enables heterogeneous clients to train personalized models with improved performance and reduced sample complexity. Despite empirical success and extensive study, the…

Machine Learning · Computer Science 2025-11-25 Xiaochun Niu , Lili Su , Jiaming Xu , Pengkun Yang

Federated learning has drawn widespread interest from researchers, yet the data heterogeneity across edge clients remains a key challenge, often degrading model performance. Existing methods enhance model compatibility with data…

Machine Learning · Computer Science 2026-01-06 Qiantao Yang , Liquan Chen , Mingfu Xue , Songze Li

We consider a distributed estimation method in a setting with heterogeneous streams of correlated data distributed across nodes in a network. In the considered approach, linear models are estimated locally (i.e., with only local data)…

Machine Learning · Computer Science 2021-02-11 Lingzhou Hong , Alfredo Garcia , Ceyhun Eksin

Subsequence-based time series classification algorithms provide accurate and interpretable models, but training these models is extremely computation intensive. The asymptotic time complexity of subsequence-based algorithms remains a…

Machine Learning · Computer Science 2021-02-18 Atif Raza , Stefan Kramer

Federated Learning (FL) marks a transformative approach to distributed model training by combining locally optimized models from various clients into a unified global model. While FL preserves data privacy by eliminating centralized…

Machine Learning · Computer Science 2026-01-08 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

Federated learning enables multiple institutions to collaboratively train machine learning models on their local data in a privacy-preserving way. However, its distributed nature often leads to significant heterogeneity in data…

Machine Learning · Computer Science 2021-07-20 Liangqiong Qu , Niranjan Balachandar , Daniel L Rubin

Spectral-spatial processing has been increasingly explored in remote sensing hyperspectral image classification. While extensive studies have focused on developing methods to improve the classification accuracy, experimental setting and…

Computer Vision and Pattern Recognition · Computer Science 2017-03-08 Jie Liang , Jun Zhou , Yuntao Qian , Lian Wen , Xiao Bai , Yongsheng Gao

Learning from the collective knowledge of data dispersed across private sources can provide neural networks with enhanced generalization capabilities. Federated learning, a method for collaboratively training a machine learning model across…

Machine Learning · Computer Science 2024-05-20 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

Spectral clustering is a celebrated algorithm that partitions objects based on pairwise similarity information. While this approach has been successfully applied to a variety of domains, it comes with limitations. The reason is that there…

Statistics Theory · Mathematics 2018-05-24 Kwangjun Ahn , Kangwook Lee , Changho Suh

Federated learning (FL) has been widely employed for medical image analysis to facilitate multi-client collaborative learning without sharing raw data. Despite great success, FL's performance is limited for multiple sclerosis (MS) lesion…

Federated learning (FL) enables collaborative machine learning across distributed data owners, but data heterogeneity poses a challenge for model calibration. While prior work focused on improving accuracy for non-iid data, calibration…

Machine Learning · Computer Science 2024-06-05 Hongyi Peng , Han Yu , Xiaoli Tang , Xiaoxiao Li

Federated learning (FL) enables edge devices to collaboratively train a machine learning model without sharing their raw data. Due to its privacy-protecting benefits, FL has been deployed in many real-world applications. However, deploying…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-16 Zhidong Gao , Zhenxiao Zhang , Yu Zhang , Tongnian Wang , Yanmin Gong , Yuanxiong Guo

Federated Learning has emerged as a dominant computational paradigm for distributed machine learning. Its unique data privacy properties allow us to collaboratively train models while offering participating clients certain…

Machine Learning · Computer Science 2022-05-04 Dimitris Stripelis , Marcin Abram , Jose Luis Ambite