English
Related papers

Related papers: Data-centric Federated Graph Learning with Large L…

200 papers

Graphs are widely used to represent the relations among entities. When one owns the complete data, an entire graph can be easily built, therefore performing analysis on the graph is straightforward. However, in many scenarios, it is…

Machine Learning · Computer Science 2023-01-27 Runze Lei , Pinghui Wang , Junzhou Zhao , Lin Lan , Jing Tao , Chao Deng , Junlan Feng , Xidian Wang , Xiaohong Guan

Federated learning (FL) is an emerging machine learning paradigm that allows multiple parties to train a shared model collaboratively in a privacy-preserving manner. Existing horizontal FL methods generally assume that the FL server and…

Machine Learning · Computer Science 2023-08-02 Liping Yi , Gang Wang , Xiaoguang Liu , Zhuan Shi , Han Yu

Learning from large heterogeneous graphs presents significant challenges due to the scale of networks, heterogeneity in node and edge types, variations in nodal features, and complex local neighborhood structures. This paper advocates for…

Machine Learning · Computer Science 2025-10-07 Jiajun Shen , Yufei Jin , Yi He , Xingquan Zhu

Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node embeddings through shallow embedding learning using GNNs,…

Artificial Intelligence · Computer Science 2025-02-13 Chuanqi Shi , Yiyi Tao , Hang Zhang , Lun Wang , Shaoshuai Du , Yixian Shen , Yanxin Shen

The reliance of language model training on massive amounts of computation and vast datasets scraped from potentially low-quality, copyrighted, or sensitive data has come into question practically, legally, and ethically. Federated learning…

Machine Learning · Computer Science 2024-05-28 Alex Iacob , Lorenzo Sani , Bill Marino , Preslav Aleksandrov , William F. Shen , Nicholas Donald Lane

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

The incredible development of federated learning (FL) has benefited various tasks in the domains of computer vision and natural language processing, and the existing frameworks such as TFF and FATE has made the deployment easy in real-world…

Machine Learning · Computer Science 2022-08-02 Zhen Wang , Weirui Kuang , Yuexiang Xie , Liuyi Yao , Yaliang Li , Bolin Ding , Jingren Zhou

Learning on Graphs has attracted immense attention due to its wide real-world applications. The most popular pipeline for learning on graphs with textual node attributes primarily relies on Graph Neural Networks (GNNs), and utilizes shallow…

Machine Learning · Computer Science 2024-01-17 Zhikai Chen , Haitao Mao , Hang Li , Wei Jin , Hongzhi Wen , Xiaochi Wei , Shuaiqiang Wang , Dawei Yin , Wenqi Fan , Hui Liu , Jiliang Tang

Multimodal-attributed graphs (MMAGs) provide a unified framework for modeling complex relational data by integrating heterogeneous modalities with graph structures. While centralized learning has shown promising performance, MMAGs in…

Machine Learning · Computer Science 2026-02-02 Xunkai Li , Yuming Ai , Yinlin Zhu , Haodong Lu , Yi Zhang , Guohao Fu , Bowen Fan , Qiangqiang Dai , Rong-Hua Li , Guoren Wang

Graph Neural Network (GNN) research is rapidly advancing due to GNNs' capacity to learn distributed representations from graph-structured data. However, centralizing large volumes of real-world graph data for GNN training is often…

Machine Learning · Computer Science 2025-04-17 Kishan Gurumurthy , Himanshu Pal , Charu Sharma

Convolutional neural networks (CNNs) have achieved great success on grid-like data such as images, but face tremendous challenges in learning from more generic data such as graphs. In CNNs, the trainable local filters enable the automatic…

Machine Learning · Computer Science 2018-09-05 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

Knowledge sharing and model personalization are two key components in the conceptual framework of personalized federated learning (PFL). Existing PFL methods focus on proposing new model personalization mechanisms while simply implementing…

Machine Learning · Computer Science 2022-05-03 Fengwen Chen , Guodong Long , Zonghan Wu , Tianyi Zhou , Jing Jiang

Federated learning, as a promising distributed learning paradigm, enables collaborative training of a global model across multiple network edge clients without the need for central data collecting. However, the heterogeneity of edge data…

Machine Learning · Computer Science 2024-03-06 Xingyan Chen , Tian Du , Mu Wang , Tiancheng Gu , Yu Zhao , Gang Kou , Changqiao Xu , Dapeng Oliver Wu

The increasing demand for deep learning-based foundation models has highlighted the importance of efficient data retrieval mechanisms. Neural graph databases (NGDBs) offer a compelling solution, leveraging neural spaces to store and query…

Machine Learning · Computer Science 2025-07-09 Qi Hu , Weifeng Jiang , Haoran Li , Zihao Wang , Jiaxin Bai , Qianren Mao , Yangqiu Song , Lixin Fan , Jianxin Li

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Federated training of Graph Neural Networks (GNN) has become popular in recent years due to its ability to perform graph-related tasks under data isolation scenarios while preserving data privacy. However, graph heterogeneity issues in…

Machine Learning · Computer Science 2023-09-22 Qiying Pan , Ruofan Wu , Tengfei Liu , Tianyi Zhang , Yifei Zhu , Weiqiang Wang

Federated Learning (FL) is a recent model training paradigm in which client devices collaboratively train a model without ever aggregating their data. Crucially, this scheme offers users potential privacy and security benefits by only ever…

Machine Learning · Computer Science 2024-11-11 Raja Vavekanand , Kira Sam

Knowledge graph completion (KGC) aims to predict missing facts in knowledge graphs (KGs), which is crucial as modern KGs remain largely incomplete. While training KGC models on multiple aligned KGs can improve performance, previous methods…

Computation and Language · Computer Science 2023-12-19 Wei Tang , Zhiqian Wu , Yixin Cao , Yong Liao , Pengyuan Zhou

Federated Graph Learning (FGL) has emerged as a powerful paradigm for decentralized training of graph neural networks while preserving data privacy. However, existing FGL methods are predominantly designed for static graphs and rely on…

Machine Learning · Computer Science 2026-04-01 Yuxuan Liu , Wenchao Xu , Haozhao Wang , Zhiming He , Zhaofeng Shi , Chongyang Xu , Peichao Wang , Boyuan Zhang

Large language models (LLMs) have demonstrated remarkable in-context reasoning capabilities across a wide range of tasks, particularly with unstructured inputs such as language or images. However, LLMs struggle to handle structured data,…

Machine Learning · Computer Science 2025-02-20 Jintang Li , Ruofan Wu , Yuchang Zhu , Huizhe Zhang , Liang Chen , Zibin Zheng