English
Related papers

Related papers: Addressing Data Heterogeneity in Decentralized Lea…

200 papers

In recent years, Federated Graph Learning (FGL) has gained significant attention for its distributed training capabilities in graph-based machine intelligence applications, mitigating data silos while offering a new perspective for…

Machine Learning · Computer Science 2025-04-15 Zhengyu Wu , Xunkai Li , Yinlin Zhu , Rong-Hua Li , Guoren Wang , Chenghu Zhou

We study the problem of training personalized deep learning models in a decentralized peer-to-peer setting, focusing on the setting where data distributions differ between the clients and where different clients have different local…

Machine Learning · Computer Science 2022-11-01 Edvin Listo Zec , Ebba Ekblom , Martin Willbo , Olof Mogren , Sarunas Girdzijauskas

Heterogeneous graph neural network has unleashed great potential on graph representation learning and shown superior performance on downstream tasks such as node classification and clustering. Existing heterogeneous graph learning networks…

Machine Learning · Computer Science 2022-11-01 Tiehua Zhang , Yuze Liu , Yao Yao , Youhua Xia , Xin Chen , Xiaowei Huang , Jiong Jin

Standard Federated Learning (FL) techniques are limited to clients with identical network architectures. This restricts potential use-cases like cross-platform training or inter-organizational collaboration when both data privacy and…

Machine Learning · Computer Science 2022-01-24 Or Litany , Haggai Maron , David Acuna , Jan Kautz , Gal Chechik , Sanja Fidler

Consensus-based distributed optimization methods have recently been advocated as alternatives to parameter server and ring all-reduce paradigms for large scale training of machine learning models. In this case, each worker maintains a local…

Machine Learning · Computer Science 2020-03-02 Giovanni Neglia , Chuan Xu , Don Towsley , Gianmarco Calbi

We consider load balancing in large-scale heterogeneous server systems in the presence of data locality that imposes constraints on which tasks can be assigned to which servers. The constraints are naturally captured by a bipartite graph…

Probability · Mathematics 2022-12-01 Zhisheng Zhao , Debankur Mukherjee , Ruoyu Wu

We consider the fully decentralized machine learning scenario where many users with personal datasets collaborate to learn models through local peer-to-peer exchanges, without a central coordinator. We propose to train personalized models…

Machine Learning · Computer Science 2024-12-20 Valentina Zantedeschi , Aurélien Bellet , Marc Tommasi

We propose a decentralized learning algorithm over a general social network. The algorithm leaves the training data distributed on the mobile devices while utilizing a peer to peer model aggregation method. The proposed algorithm allows…

Machine Learning · Statistics 2019-05-28 Anusha Lalitha , Xinghan Wang , Osman Kilinc , Yongxi Lu , Tara Javidi , Farinaz Koushanfar

Data generated at the network edge can be processed locally by leveraging the paradigm of edge computing (EC). Aided by EC, decentralized federated learning (DFL), which overcomes the single-point-of-failure problem in the parameter server…

Networking and Internet Architecture · Computer Science 2022-12-06 Yunming Liao , Yang Xu , Hongli Xu , Lun Wang , Chen Qian

Personalized federated learning is proposed to handle the data heterogeneity problem amongst clients by learning dedicated tailored local models for each user. However, existing works are often built in a centralized way, leading to high…

Machine Learning · Computer Science 2022-06-02 Rong Dai , Li Shen , Fengxiang He , Xinmei Tian , Dacheng Tao

Statistical heterogeneity of clients' local data is an important characteristic in federated learning, motivating personalized algorithms tailored to the local data statistics. Though there has been a plethora of algorithms proposed for…

Machine Learning · Computer Science 2025-01-27 Kaan Ozkara , Bruce Huang , Ruida Zhou , Suhas Diggavi

Deep learning (DL) approaches are achieving extraordinary results in a wide range of domains, but often require a massive collection of private data. Hence, methods for training neural networks on the joint data of different data owners,…

Cryptography and Security · Computer Science 2021-10-27 Derian Boer , Stefan Kramer

Despite the tremendous success of graph-based learning systems in handling structural data, it has been widely investigated that they are fragile to adversarial attacks on homophilic graph data, where adversaries maliciously modify the…

Machine Learning · Computer Science 2025-09-05 Yulin Zhu , Yuni Lai , Xing Ai , Wai Lun LO , Gaolei Li , Jianhua Li , Di Tang , Xingxing Zhang , Mengpei Yang , Kai Zhou

(Hyper)Graph decomposition is a family of problems that aim to break down large (hyper)graphs into smaller sub(hyper)graphs for easier analysis. The importance of this lies in its ability to enable efficient computation on large and complex…

Data Structures and Algorithms · Computer Science 2023-08-31 Marcelo Fonseca Faraj

Federated learning ensures the privacy of clients by conducting distributed training on individual client devices and sharing only the model weights with a central server. However, in real-world scenarios, the heterogeneity of data among…

Machine Learning · Computer Science 2024-04-30 Jaewon Jang , Bonjun Choi

Graphs have become increasingly popular in modeling structures and interactions in a wide variety of problems during the last decade. Graph-based clustering and semi-supervised classification techniques have shown impressive performance.…

Machine Learning · Computer Science 2020-09-01 Zhao Kang , Chong Peng , Qiang Cheng , Xinwang Liu , Xi Peng , Zenglin Xu , Ling Tian

Federated Graph Learning (FGL) enables privacy-preserving, distributed training of graph neural networks without sharing raw data. Among its approaches, subgraph-FL has become the dominant paradigm, with most work focused on improving…

Machine Learning · Computer Science 2025-04-15 Zhengyu Wu , Boyang Pang , Xunkai Li , Yinlin Zhu , Daohan Su , Bowen Fan , Rong-Hua Li , Guoren Wang , Chenghu Zhou

Graph neural networks have attracted wide attentions to enable representation learning of graph data in recent works. In complement to graph convolution operators, graph pooling is crucial for extracting hierarchical representation of graph…

Machine Learning · Computer Science 2020-06-22 Xing Gao , Wenrui Dai , Chenglin Li , Hongkai Xiong , Pascal Frossard

Federated Learning (FL) enables edge devices to collaboratively learn a global model, but it may not perform well when clients have high data heterogeneity. In this paper, we propose a dynamic clustering algorithm for personalized federated…

Machine Learning · Computer Science 2025-08-05 Heting Liu , Junzhe Huang , Fang He , Guohong Cao

Hypergraph-based machine learning methods are now widely recognized as important for modeling and using higher-order and multiway relationships between data objects. Local hypergraph clustering and semi-supervised learning specifically…

Social and Information Networks · Computer Science 2021-03-22 Meng Liu , Nate Veldt , Haoyu Song , Pan Li , David F. Gleich