English
Related papers

Related papers: DHIL-GT: Scalable Graph Transformer with Decoupled…

200 papers

In this work, we address semi-supervised classification of graph data, where the categories of those unlabeled nodes are inferred from labeled nodes as well as graph structures. Recent works often solve this problem via advanced graph…

Machine Learning · Computer Science 2020-01-20 Chunyan Xu , Zhen Cui , Xiaobin Hong , Tong Zhang , Jian Yang , Wei Liu

Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real-world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed…

Machine Learning · Computer Science 2021-05-18 Lu Wang , Xiaofu Chang , Shuang Li , Yunfei Chu , Hui Li , Wei Zhang , Xiaofeng He , Le Song , Jingren Zhou , Hongxia Yang

Despite that going deep has proven successful in many neural architectures, the existing graph transformers are relatively shallow. In this work, we explore whether more layers are beneficial to graph transformers, and find that current…

Machine Learning · Computer Science 2023-03-02 Haiteng Zhao , Shuming Ma , Dongdong Zhang , Zhi-Hong Deng , Furu Wei

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

The progress in hyperbolic neural networks (HNNs) research is hindered by their absence of inductive bias mechanisms, which are essential for generalizing to new tasks and facilitating scalable learning over large datasets. In this paper,…

Machine Learning · Computer Science 2023-10-31 Nurendra Choudhary , Nikhil Rao , Chandan K. Reddy

Graph Domain Adaptation (GDA) transfers knowledge from labeled source graphs to unlabeled target graphs, addressing the challenge of label scarcity. In this paper, we highlight the significance of graph homophily, a pivotal factor for graph…

Social and Information Networks · Computer Science 2025-06-03 Ruiyi Fang , Bingheng Li , Jingyu Zhao , Ruizhi Pu , Qiuhao Zeng , Gezheng Xu , Charles Ling , Boyu Wang

Scene graph generation (SGG) aims to detect objects and predict their pairwise relationships within an image. Current SGG methods typically utilize graph neural networks (GNNs) to acquire context information between objects/relationships.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Xin Lin , Changxing Ding , Yibing Zhan , Zijian Li , Dacheng Tao

Graph Neural Networks (GNNs) excel at analyzing graph-structured data but struggle on heterophilic graphs, where connected nodes often belong to different classes. While this challenge is commonly addressed with specialized GNN…

Machine Learning · Computer Science 2025-05-20 Harel Mendelman , Haggai Maron , Ronen Talmon

Transformers have achieved great success in several domains, including Natural Language Processing and Computer Vision. However, its application to real-world graphs is less explored, mainly due to its high computation cost and its poor…

Machine Learning · Computer Science 2023-01-31 Weilin Cong , Yanhong Wu , Yuandong Tian , Mengting Gu , Yinglong Xia , Chun-cheng Jason Chen , Mehrdad Mahdavi

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Graph partitioning (GP) is a classic problem that divides the node set of a graph into densely-connected blocks. Following the IEEE HPEC Graph Challenge and recent advances in pre-training techniques (e.g., large-language models), we…

Machine Learning · Computer Science 2024-09-04 Meng Qin , Chaorui Zhang , Yu Gao , Yibin Ding , Weipeng Jiang , Weixi Zhang , Wei Han , Bo Bai

Graph Transformers (GTs) have demonstrated their advantages across a wide range of tasks. However, the self-attention mechanism in GTs overlooks the graph's inductive biases, particularly biases related to structure, which are crucial for…

Machine Learning · Computer Science 2024-04-25 Chuang Liu , Zelin Yao , Yibing Zhan , Xueqi Ma , Shirui Pan , Wenbin Hu

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving…

Machine Learning · Computer Science 2024-10-10 Lianghao Xia , Ben Kao , Chao Huang

Graph Domain Adaptation (GDA) transfers knowledge from labeled source graphs to unlabeled target graphs, addressing the challenge of label scarcity. However, existing GDA methods typically assume that both source and target graphs exhibit…

Social and Information Networks · Computer Science 2026-02-10 Ruiyi Fang , Shuo Wang , Ruizhi Pu , Qiuhao Zeng , Hao Zheng , Ziyan Wang , Jiale Cai , Zhimin Mei , Song Tang , Charles Ling , Boyu Wang

Homophily principle, \ie{} nodes with the same labels or similar attributes are more likely to be connected, has been commonly believed to be the main reason for the superiority of Graph Neural Networks (GNNs) over traditional Neural…

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

Graph Neural Networks (GNNs) have emerged as powerful tools for supervised machine learning over graph-structured data, while sampling-based node representation learning is widely utilized in unsupervised learning. However, scalability…

Machine Learning · Computer Science 2024-07-23 Vipul Gupta , Xin Chen , Ruoyun Huang , Fanlong Meng , Jianjun Chen , Yujun Yan

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Out-of-distribution (OOD) generalization has emerged as a critical challenge in graph learning, as real-world graph data often exhibit diverse and shifting environments that traditional models fail to generalize across. A promising solution…

Machine Learning · Computer Science 2025-08-05 Xu Shen , Yixin Liu , Yili Wang , Rui Miao , Yiwei Dai , Shirui Pan , Yi Chang , Xin Wang

Graph Neural Networks (GNNs) have shown impressive performance in graph representation learning, but they face challenges in capturing long-range dependencies due to their limited expressive power. To address this, Graph Transformers (GTs)…

Machine Learning · Computer Science 2024-06-19 Kaan Sancak , Zhigang Hua , Jin Fang , Yan Xie , Andrey Malevich , Bo Long , Muhammed Fatih Balin , Ümit V. Çatalyürek