English
Related papers

Related papers: Fast-and-Frugal Text-Graph Transformers are Effect…

200 papers

We present a framework of Training Free Graph Matching (TFGM) to boost the performance of Graph Neural Networks (GNNs) based graph matching, providing a fast promising solution without training (training-free). TFGM provides four widely…

Machine Learning · Computer Science 2022-02-15 Zhiyuan Liu , Yixin Cao , Fuli Feng , Xiang Wang , Jie Tang , Kenji Kawaguchi , Tat-Seng Chua

Contextual embeddings derived from transformer-based neural language models have shown state-of-the-art performance for various tasks such as question answering, sentiment analysis, and textual similarity in recent years. Extensive work…

Computation and Language · Computer Science 2020-11-03 Brihi Joshi , Neil Shah , Francesco Barbieri , Leonardo Neves

Link prediction is a fundamental task in graph machine learning with widespread applications such as recommendation systems, drug discovery, knowledge graphs, etc. In the foundation model era, how to develop universal link prediction…

Machine Learning · Computer Science 2026-02-10 Tianyin Liao , Chunyu Hu , Yicheng Sui , Xingxuan Zhang , Peng Cui , Jianxin Li , Ziwei Zhang

Graphs have become a crucial way to represent large, complex and often temporal datasets across a wide range of scientific disciplines. However, when graphs are used as input to machine learning models, this rich temporal information is…

Temporal Knowledge Graphs (TKGs) store temporal facts with quadruple formats (s, p, o, t). Existing Temporal Knowledge Graph Embedding (TKGE) models perform link prediction tasks in transductive or semi-inductive settings, which means the…

Artificial Intelligence · Computer Science 2025-06-10 Jiaxin Pan , Mojtaba Nayyeri , Osama Mohammed , Daniel Hernandez , Rongchuan Zhang , Cheng Cheng , Steffen Staab

Textual Attributed Graphs (TAGs) are crucial for modeling complex real-world systems, yet leveraging large language models (LLMs) for TAGs presents unique challenges due to the gap between sequential text processing and graph-structured…

Machine Learning · Computer Science 2025-05-09 Zhengyu Hu , Yichuan Li , Zhengyu Chen , Jingang Wang , Han Liu , Kyumin Lee , Kaize Ding

The Transformer model is widely used in natural language processing for sentence representation. However, the previous Transformer-based models focus on function words that have limited meaning in most cases and could merely extract…

Computation and Language · Computer Science 2021-07-05 Yu Shi

Graph Transformers (GTs) facilitate the comprehension of graph-structured data by calculating the self-attention of node pairs without considering node position information. To address this limitation, we introduce an innovative and…

Machine Learning · Computer Science 2023-12-12 Kushal Bose , Swagatam Das

Representation learning on networks aims to derive a meaningful vector representation for each node, thereby facilitating downstream tasks such as link prediction, node classification, and node clustering. In heterogeneous text-rich…

Computation and Language · Computer Science 2023-06-06 Bowen Jin , Yu Zhang , Qi Zhu , Jiawei Han

Neural Architecture Representation Learning aims to transform network models into feature representations for predicting network attributes, playing a crucial role in deploying and designing networks for real-world applications. Recently,…

Machine Learning · Computer Science 2025-06-10 Haizhao Jing , Haokui Zhang , Zhenhao Shang , Rong Xiao , Peng Wang , Yanning Zhang

We show that standard Transformers without graph-specific modifications can lead to promising results in graph learning both in theory and practice. Given a graph, we simply treat all nodes and edges as independent tokens, augment them with…

Machine Learning · Computer Science 2022-10-25 Jinwoo Kim , Tien Dat Nguyen , Seonwoo Min , Sungjun Cho , Moontae Lee , Honglak Lee , Seunghoon Hong

Reliable and interpretable traffic crash modeling is essential for understanding causality and improving road safety. This study introduces a novel approach to predicting collision types by utilizing a comprehensive dataset fused from…

Machine Learning · Computer Science 2025-01-14 Oscar Lares , Hao Zhen , Jidong J. Yang

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

Graph neural networks (GNNs) for link prediction can loosely be divided into two broad categories. First, \emph{node-wise} architectures pre-compute individual embeddings for each node that are later combined by a simple decoder to make…

Machine Learning · Computer Science 2024-12-31 Yuxin Wang , Xiannian Hu , Quan Gan , Xuanjing Huang , Xipeng Qiu , David Wipf

Federated learning offers a privacy-preserving framework for recommendation systems by enabling local data processing; however, data localization introduces substantial obstacles. Traditional federated recommendation approaches treat each…

Machine Learning · Computer Science 2026-03-10 Xudong Wang , Qingbo Hao , Yingyuan Xiao

Text-attributed graphs (TAGs) have emerged as a powerful representation for modeling complex relationships across diverse domains. With the rise of large language models (LLMs), there is growing interest in leveraging their capabilities for…

Machine Learning · Computer Science 2025-07-29 Jianyuan Bo , Hao Wu , Yuan Fang

Graph neural networks (GNNs) have shown promising performance for knowledge graph reasoning. A recent variant of GNN called progressive relational graph neural network (PRGNN), utilizes relational rules to infer missing knowledge in…

Computation and Language · Computer Science 2023-10-23 Shuhan Wu , Huaiyu Wan , Wei Chen , Yuting Wu , Junfeng Shen , Youfang Lin

As opposed to natural languages, source code understanding is influenced by grammatical relationships between tokens regardless of their identifier name. Graph representations of source code such as Abstract Syntax Tree (AST) can capture…

Machine Learning · Computer Science 2021-11-18 Junyan Cheng , Iordanis Fostiropoulos , Barry Boehm

Endowing robots with human-like physical reasoning abilities remains challenging. We argue that existing methods often disregard spatio-temporal relations and by using Graph Neural Networks (GNNs) that incorporate a relational inductive…

Machine Learning · Computer Science 2019-10-24 Fabio Ferreira , Lin Shao , Tamim Asfour , Jeannette Bohg

Dynamic graph learning plays a pivotal role in modeling evolving relationships over time, especially for temporal link prediction tasks in domains such as traffic systems, social networks, and recommendation platforms. While…

Machine Learning · Computer Science 2025-11-18 Tao Zou , Chengfeng Wu , Tianxi Liao , Junchen Ye , Bowen Du