English
Related papers

Related papers: Integrating Structural and Semantic Signals in Tex…

200 papers

Learning from Text-Attributed Graphs (TAGs) has attracted significant attention due to its wide range of real-world applications. The rapid evolution of language models (LMs) has revolutionized the way we process textual data, which…

Machine Learning · Computer Science 2024-10-25 Rui Xue , Xipeng Shen , Ruozhou Yu , Xiaorui Liu

The rapid rise of large language models (LLMs) and their ability to capture semantic relationships has led to their adoption in a wide range of applications. Text-attributed graphs (TAGs) are a notable example where LLMs can be combined…

Machine Learning · Computer Science 2026-03-12 Mayur Choudhary , Saptarshi Sengupta , Katerina Potika

Text-Attributed Graphs (TAGs), where each node is associated with text descriptions, are ubiquitous in real-world scenarios. They typically exhibit distinctive structure and domain-specific knowledge, motivating the development of a Graph…

Machine Learning · Computer Science 2025-10-21 Xi Zhu , Haochen Xue , Ziwei Zhao , Wujiang Xu , Jingyuan Huang , Minghao Guo , Qifan Wang , Kaixiong Zhou , Imran Razzak , Yongfeng Zhang

Textual graphs (TGs) are graphs whose nodes correspond to text (sentences or documents), which are widely prevalent. The representation learning of TGs involves two stages: (i) unsupervised feature extraction and (ii) supervised graph…

Computation and Language · Computer Science 2023-08-08 Keyu Duan , Qian Liu , Tat-Seng Chua , Shuicheng Yan , Wei Tsang Ooi , Qizhe Xie , Junxian He

The latest advancements in large language models (LLMs) have revolutionized the field of natural language processing (NLP). Inspired by the success of LLMs in NLP tasks, some recent work has begun investigating the potential of applying…

Artificial Intelligence · Computer Science 2025-02-25 Shengyin Sun , Yuxiang Ren , Jiehao Chen , Chen Ma

Recent efforts leverage Large Language Models (LLMs) for modeling text-attributed graph structures in node classification tasks. These approaches describe graph structures for LLMs to understand or aggregate LLM-generated textual attribute…

Computation and Language · Computer Science 2025-05-27 Huachi Zhou , Jiahe Du , Chuang Zhou , Chang Yang , Yilin Xiao , Yuxuan Xie , Xiao Huang

This work studies self-supervised graph learning for text-attributed graphs (TAGs) where nodes are represented by textual attributes. Unlike traditional graph contrastive methods that perturb the numerical feature space and alter the…

Machine Learning · Computer Science 2024-06-19 Yi Fang , Dongzhe Fan , Daochen Zha , Qiaoyu Tan

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

Text-attributed graphs (TAGs) enhance graph learning by integrating rich textual semantics and topological context for each node. While boosting expressiveness, they also expose new vulnerabilities in graph learning through text-based…

Artificial Intelligence · Computer Science 2026-03-24 Zihui Chen , Yuling Wang , Pengfei Jiao , Kai Wu , Xiao Wang , Xiang Ao , Dalin Zhang

Recently, large language models (LLMs) have demonstrated superior capabilities in understanding and zero-shot learning on textual data, promising significant advances for many text-related domains. In the graph domain, various real-world…

Computation and Language · Computer Science 2024-02-21 Xuanwen Huang , Kaiqiao Han , Yang Yang , Dezheng Bao , Quanjin Tao , Ziwei Chai , Qi Zhu

Graphs are data structures used to represent irregular networks and are prevalent in numerous real-world applications. Previous methods directly model graph structures and achieve significant success. However, these methods encounter…

Machine Learning · Computer Science 2025-01-03 Shuo Yu , Yingbo Wang , Ruolin Li , Guchun Liu , Yanming Shen , Shaoxiong Ji , Bowen Li , Fengling Han , Xiuzhen Zhang , Feng Xia

The integration of Large Language Models (LLMs) with Graph Neural Networks (GNNs) has recently been explored to enhance the capabilities of Text Attribute Graphs (TAGs). Most existing methods feed textual descriptions of the graph structure…

Computation and Language · Computer Science 2025-04-03 Zhaoxing Li , Xiaoming Zhang , Haifeng Zhang , Chengxiang Liu

Representation learning on text-attributed graphs (TAGs) has attracted significant interest due to its wide-ranging real-world applications, particularly through Graph Neural Networks (GNNs). Traditional GNN methods focus on encoding the…

Machine Learning · Computer Science 2024-10-07 Xingyu Ji , Jiale Liu , Lu Li , Maojun Wang , Zeyu Zhang

Recently, the emergence of large language models (LLMs) has motivated integrating language descriptions into graphs, forming text-attributed graphs (TAGs) that enhance model encoding capabilities from a data-centric perspective. A review of…

Machine Learning · Computer Science 2026-02-03 Zhihan Zhang , Xunkai Li , Lei Zhu , Guang Zeng , Bowen Fan , Yanzhe Wen , Hongchao Qin , Rong-Hua Li , Guoren Wang

Representation learning on text-attributed graphs (TAGs) is vital for real-world applications, as they combine semantic textual and contextual structural information. Research in this field generally consist of two main perspectives:…

Computation and Language · Computer Science 2024-10-15 Yaoke Wang , Yun Zhu , Wenqiao Zhang , Yueting Zhuang , Yunfei Li , Siliang Tang

Recent advancements in text-attributed graphs (TAGs) have significantly improved the quality of node features by using the textual modeling capabilities of language models. Despite this success, utilizing text attributes to enhance the…

Artificial Intelligence · Computer Science 2024-05-30 Hyunjin Seo , Taewon Kim , June Yong Yang , Eunho Yang

Text-attributed graphs require models to effectively integrate both structural topology and semantic content. Recent approaches apply large language models to graphs by linearizing structures into token sequences through random walks. These…

Graphics · Computer Science 2025-12-23 Heng Zheng , Haochen You , Zijun Liu , Zijian Zhang , Lubin Gan , Hao Zhang , Wenjun Huang , Jin Huang

We present Simplified Text-Attributed Graph Embeddings (STAGE), a straightforward yet effective method for enhancing node features in Graph Neural Network (GNN) models that encode Text-Attributed Graphs (TAGs). Our approach leverages…

Computation and Language · Computer Science 2024-07-19 Aaron Zolnai-Lucas , Jack Boylan , Chris Hokamp , Parsa Ghaffari

Hypergraphs, with their capacity to depict high-order relationships, have emerged as a significant extension of traditional graphs. Although Graph Neural Networks (GNNs) have remarkable performance in graph representation learning, their…

Machine Learning · Computer Science 2024-11-07 Khaled Mohammed Saifuddin , Mehmet Emin Aktas , Esra Akbas

Graph Transformers have recently attracted attention for molecular property prediction by combining the inductive biases of graph neural networks (GNNs) with the global receptive field of Transformers. However, many existing hybrid…

Machine Learning · Computer Science 2026-04-09 Yi Yang , Ovidiu Daescu