English
Related papers

Related papers: Fast-and-Frugal Text-Graph Transformers are Effect…

200 papers

Edges in many real-world social/information networks are associated with rich text information (e.g., user-user communications or user-product reviews). However, mainstream network representation learning models focus on propagating and…

Machine Learning · Computer Science 2023-02-23 Bowen Jin , Yu Zhang , Yu Meng , Jiawei Han

Graph neural networks (GNNs) have achieved remarkable success as a framework for deep learning on graph-structured data. However, GNNs are fundamentally limited by their tree-structured inductive bias: the WL-subtree kernel formulation…

Machine Learning · Computer Science 2021-07-26 Dylan Sandfelder , Priyesh Vijayan , William L. Hamilton

Representation learning on text-attributed graphs (TAGs) integrates structural connectivity with rich textual semantics, enabling applications in diverse domains. Current methods largely rely on contrastive learning to maximize cross-modal…

Graphics · Computer Science 2025-10-15 Heng Zhang , Tianyi Zhang , Yuling Shi , Xiaodong Gu , Yaomin Shen , Zijian Zhang , Yilei Yuan , Hao Zhang , Jin Huang

Text-attributed graphs (TAGs) are prevalent on the web and research over TAGs such as citation networks, e-commerce networks and social networks has attracted considerable attention in the web community. Recently, large language models…

Computation and Language · Computer Science 2024-03-12 Yijian Qin , Xin Wang , Ziwei Zhang , Wenwu Zhu

Recently, knowledge graph embedding, which projects symbolic entities and relations into continuous vector space, has become a new, hot topic in artificial intelligence. This paper addresses a new issue of multiple relation semantics that a…

Computation and Language · Computer Science 2017-09-11 Han Xiao , Minlie Huang , Yu Hao , Xiaoyan Zhu

Textual graphs (TGs) are graphs whose nodes correspond to text (sentences or documents), which are widely prevalent. The representation learning of TGs involves two stages: (i) unsupervised feature extraction and (ii) supervised graph…

Computation and Language · Computer Science 2023-08-08 Keyu Duan , Qian Liu , Tat-Seng Chua , Shuicheng Yan , Wei Tsang Ooi , Qizhe Xie , Junxian He

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Inspired by the immense success of deep learning, graph neural networks (GNNs) are widely used to learn powerful node representations and have demonstrated promising performance on different graph learning tasks. However, most real-world…

Machine Learning · Computer Science 2020-01-24 Kaize Ding , Yichuan Li , Jundong Li , Chenghao Liu , Huan Liu

The extraction of a scene graph with objects as nodes and mutual relationships as edges is the basis for a deep understanding of image content. Despite recent advances, such as message passing and joint classification, the detection of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Rajat Koner , Suprosanna Shit , Volker Tresp

Recent works on personalized text-to-image generation usually learn to bind a special token with specific subjects or styles of a few given images by tuning its embedding through gradient descent. It is natural to question whether we can…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Zhengcong Fei , Mingyuan Fan , Junshi Huang

Graphs are essential for modeling complex relationships and capturing structured interactions in data. Graph Neural Networks (GNNs) are particularly effective when such relational structure is explicitly available, but many real-world…

Graphics · Computer Science 2026-03-02 Haozhe Chen , Soheila Farokhi , Kelvyn Bladen , Hamid Karimi , Kevin R. Moon

Learning knowledge graph (KG) embeddings has received increasing attention in recent years. Most embedding models in literature interpret relations as linear or bilinear mapping functions to operate on entity embeddings. However, we find…

Artificial Intelligence · Computer Science 2020-04-29 Zequn Sun , Jiacheng Huang , Wei Hu , Muchao Chen , Lingbing Guo , Yuzhong Qu

We show that viewing graphs as sets of node features and incorporating structural and positional information into a transformer architecture is able to outperform representations learned with classical graph neural networks (GNNs). Our…

Machine Learning · Computer Science 2021-06-11 Grégoire Mialon , Dexiong Chen , Margot Selosse , Julien Mairal

Federated learning has been predominantly concerned with collaborative training of deep networks from scratch, and especially the many challenges that arise, such as communication cost, robustness to heterogeneous data, and support for…

For many years, link prediction on knowledge graphs (KGs) has been a purely transductive task, not allowing for reasoning on unseen entities. Recently, increasing efforts are put into exploring semi- and fully inductive scenarios, enabling…

Machine Learning · Computer Science 2021-07-13 Mehdi Ali , Max Berrendorf , Mikhail Galkin , Veronika Thost , Tengfei Ma , Volker Tresp , Jens Lehmann

Signed Graph Neural Networks (SGNNs) have been shown to be effective in analyzing complex patterns in real-world situations where positive and negative links coexist. However, SGNN models suffer from poor explainability, which limit their…

Machine Learning · Computer Science 2024-12-13 Lu Li , Jiale Liu , Xingyu Ji , Maojun Wang , Zeyu Zhang

Text classification plays an important role in various downstream text-related tasks, such as sentiment analysis, fake news detection, and public opinion analysis. Recently, text classification based on Graph Neural Networks (GNNs) has made…

Computation and Language · Computer Science 2025-12-24 Zuo Wang , Ye Yuan

How to obtain informative representations of transactions and then perform the identification of fraudulent transactions is a crucial part of ensuring financial security. Recent studies apply Graph Neural Networks (GNNs) to the transaction…

Machine Learning · Computer Science 2023-07-12 Yue Tian , Guanjun Liu

Integrating non-Euclidean brain imaging data with Euclidean tabular data, such as clinical and demographic information, poses a substantial challenge for medical imaging analysis, particularly in forecasting future outcomes. While machine…

Machine Learning · Computer Science 2025-12-30 Runzhi Zhou , Xi Luo

Accurate predictions rely on the expressiveness power of graph deep learning frameworks like graph neural networks and graph transformers, where a positional encoding mechanism has become much more indispensable in recent state-of-the-art…

Machine Learning · Computer Science 2025-06-12 Katherine Tieu , Dongqi Fu , Zihao Li , Ross Maciejewski , Jingrui He