English
Related papers

Related papers: G5: A Universal GRAPH-BERT for Graph-to-Graph Tran…

200 papers

Multi-sourced datasets are common in studies of variable interactions, for example, individual-level fMRI integration, cross-domain recommendation, etc, where each source induces a related but distinct dependency structure. Joint learning…

Methodology · Statistics 2025-12-08 Shixiang Liu , Yanhang Zhang , Zhifan Li , Jianxin Yin

Graph Transformers (GTs) have demonstrated their advantages across a wide range of tasks. However, the self-attention mechanism in GTs overlooks the graph's inductive biases, particularly biases related to structure, which are crucial for…

Machine Learning · Computer Science 2024-04-25 Chuang Liu , Zelin Yao , Yibing Zhan , Xueqi Ma , Shirui Pan , Wenbin Hu

Recent progress in cross-lingual relation and event extraction use graph convolutional networks (GCNs) with universal dependency parses to learn language-agnostic sentence representations such that models trained on one language can be…

Computation and Language · Computer Science 2021-02-19 Wasi Uddin Ahmad , Nanyun Peng , Kai-Wei Chang

Recent works show that mean-teaching is an effective framework for unsupervised domain adaptive person re-identification. However, existing methods perform contrastive learning on selected samples between teacher and student networks, which…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Xiaobin Liu , Shiliang Zhang

Transformers have achieved remarkable performance in a myriad of fields including natural language processing and computer vision. However, when it comes to the graph mining area, where graph neural network (GNN) has been the dominant…

Machine Learning · Computer Science 2021-10-26 Jianan Zhao , Chaozhuo Li , Qianlong Wen , Yiqi Wang , Yuming Liu , Hao Sun , Xing Xie , Yanfang Ye

Graph Neural Networks (GNNs) have recently received significant research attention due to their superior performance on a variety of graph-related learning tasks. Most of the current works focus on either static or dynamic graph settings,…

Machine Learning · Computer Science 2021-02-09 Fan Zhou , Chengtai Cao

Graphs are able to model interconnected entities in many online services, supporting a wide range of applications on the Web. This raises an important question: How can we train a graph foundational model on multiple source domains and…

Computation and Language · Computer Science 2025-04-15 Xingtong Yu , Zechuan Gong , Chang Zhou , Yuan Fang , Hui Zhang

Graph Transformer is gaining increasing attention in the field of machine learning and has demonstrated state-of-the-art performance on benchmarks for graph representation learning. However, as current implementations of Graph Transformer…

Machine Learning · Computer Science 2023-05-08 Wenhao Zhu , Tianyu Wen , Guojie Song , Xiaojun Ma , Liang Wang

Graph neural networks (GNN) are powerful models for many graph-structured tasks. Existing models often assume that the complete structure of the graph is available during training. In practice, however, graph-structured data is usually…

Machine Learning · Computer Science 2022-03-29 Chen Wang , Yuheng Qiu , Dasong Gao , Sebastian Scherer

An increasing number of machine learning tasks require dealing with large graph datasets, which capture rich and complex relationship among potentially billions of elements. Graph Neural Network (GNN) becomes an effective way to address the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-26 Rong Zhu , Kun Zhao , Hongxia Yang , Wei Lin , Chang Zhou , Baole Ai , Yong Li , Jingren Zhou

Graph data completion is a fundamentally important issue as data generally has a graph structure, e.g., social networks, recommendation systems, and the Internet of Things. We consider a graph where each node has a data matrix, represented…

Machine Learning · Computer Science 2023-03-03 Xiao-Yang Liu , Ming Zhu

Graph Representation Learning (GRL) is an influential methodology, enabling a more profound understanding of graph-structured data and aiding graph clustering, a critical task across various domains. The recent incursion of attention…

Machine Learning · Computer Science 2023-08-15 Shuo Han , Jiacheng Liu , Jiayun Wu , Yinan Chen , Li Tao

Numerous code changes are made by developers in their daily work, and a superior representation of code changes is desired for effective code change analysis. Recently, Hoang et al. proposed CC2Vec, a neural network-based approach that…

Software Engineering · Computer Science 2023-09-28 Xin Zhou , Bowen Xu , DongGyun Han , Zhou Yang , Junda He , David Lo

Graph Neural Networks (GNNs) are widely used for graph representation learning. Despite its prevalence, GNN suffers from two drawbacks in the graph classification task, the neglect of graph-level relationships, and the generalization issue.…

Machine Learning · Computer Science 2024-06-07 Jiaxing Xu , Jinjie Ni , Yiping Ke

Semi-supervised learning (SSL) is effectively used for numerous classification problems, thanks to its ability to make use of abundant unlabeled data. The main assumption of various SSL algorithms is that the nearby points on the data…

Machine Learning · Computer Science 2019-09-30 Xuan Wu , Lingxiao Zhao , Leman Akoglu

Inferring properties of graph-structured data, e.g., the solubility of molecules, essentially involves learning the implicit mapping from graphs to their properties. This learning process is often costly for graph property learners like…

Machine Learning · Computer Science 2025-05-22 Chen Zhang , Weixin Bu , Zeyi Ren , Zhengwu Liu , Yik-Chung Wu , Ngai Wong

Graph Transformers (GTs) have demonstrated great effectiveness across various graph analytical tasks. However, the existing GTs focus on training and testing graph data originated from the same distribution, but fail to generalize under…

Machine Learning · Computer Science 2026-03-16 Tianyin Liao , Ziwei Zhang , Yufei Sun , Chunyu Hu , Jianxin Li

Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their…

Machine Learning · Computer Science 2021-10-29 Rajat Talak , Siyi Hu , Lisa Peng , Luca Carlone

We present an approach to modifying Transformer architectures by integrating graph-aware relational reasoning into the attention mechanism, merging concepts from graph neural networks and language modeling. Building on the inherent…

Machine Learning · Computer Science 2025-03-06 Markus J. Buehler

We propose the Interferometric Graph Transform (IGT), which is a new class of deep unsupervised graph convolutional neural network for building graph representations. Our first contribution is to propose a generic, complex-valued spectral…

Machine Learning · Computer Science 2020-06-11 Edouard Oyallon