English
Related papers

Related papers: Quantizing Text-attributed Graphs for Semantic-Str…

200 papers

Pre-training on text-attributed graphs (TAGs) is central to building transferable graph foundation models, where LLM-as-Aligner methods align graph and text representations through the semantic knowledge of large language models. However,…

Machine Learning · Computer Science 2026-05-21 Yuhan Wang , Haopeng Zhang , Yibo Ding , Jiaqi Yu , Xinyu Zhao , Yuhang Liu , Ziwei Zhang , Xiao Wang , Ruijie Wang

This paper studies learning on text-attributed graphs (TAGs), where each node is associated with a text description. An ideal solution for such a problem would be integrating both the text and graph structure information with large language…

Machine Learning · Computer Science 2023-03-02 Jianan Zhao , Meng Qu , Chaozhuo Li , Hao Yan , Qian Liu , Rui Li , Xing Xie , Jian Tang

Recently, research on Text-Attributed Graphs (TAGs) has gained significant attention due to the prevalence of free-text node features in real-world applications and the advancements in Large Language Models (LLMs) that bolster TAG…

Machine Learning · Computer Science 2025-02-25 Yun Zhu , Haizhou Shi , Xiaotang Wang , Yongchao Liu , Yaoke Wang , Boci Peng , Chuntao Hong , Siliang Tang

With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models…

Machine Learning · Computer Science 2024-12-18 Xunkai Li , Zhengyu Wu , Jiayi Wu , Hanwen Cui , Jishuo Jia , Rong-Hua Li , Guoren Wang

In the realm of Text-attributed Graphs (TAGs), traditional graph neural networks (GNNs) often fall short due to the complex textual information associated with each node. Recent methods have improved node representations by leveraging large…

Machine Learning · Computer Science 2025-06-10 Huanyi Xie , Lijie Hu , Lu Yu , Tianhao Huang , Longfei Li , Meng Li , Jun Zhou , Huan Wang , Di Wang

Text-attributed graphs (TAGs) enhance graph learning by integrating rich textual semantics and topological context for each node. While boosting expressiveness, they also expose new vulnerabilities in graph learning through text-based…

Artificial Intelligence · Computer Science 2026-03-24 Zihui Chen , Yuling Wang , Pengfei Jiao , Kai Wu , Xiao Wang , Xiang Ao , Dalin Zhang

Graphs are essential for modeling complex interactions across domains such as social networks, biology, and recommendation systems. Traditional Graph Neural Networks, particularly Message Passing Neural Networks (MPNNs), rely heavily on…

Machine Learning · Computer Science 2025-06-13 Wei Li , Mengcheng Lan , Jiaxing Xu , Yiping Ke

Recently, large language models (LLMs) have significantly advanced text-attributed graph (TAG) learning. However, existing methods inadequately handle data uncertainty in open-world scenarios, especially concerning limited labeling and…

Machine Learning · Computer Science 2025-05-22 Yanzhe Wen , Xunkai Li , Qi Zhang , Zhu Lei , Guang Zeng , Rong-Hua Li , Guoren Wang

Representation learning on text-attributed graphs (TAGs) is vital for real-world applications, as they combine semantic textual and contextual structural information. Research in this field generally consist of two main perspectives:…

Computation and Language · Computer Science 2024-10-15 Yaoke Wang , Yun Zhu , Wenqiao Zhang , Yueting Zhuang , Yunfei Li , Siliang Tang

Recently, the emergence of large language models (LLMs) has motivated integrating language descriptions into graphs, forming text-attributed graphs (TAGs) that enhance model encoding capabilities from a data-centric perspective. A review of…

Machine Learning · Computer Science 2026-02-03 Zhihan Zhang , Xunkai Li , Lei Zhu , Guang Zeng , Bowen Fan , Yanzhe Wen , Hongchao Qin , Rong-Hua Li , Guoren Wang

Real-world graph data often follows long-tailed distributions, making it difficult for Graph Neural Networks (GNNs) to generalize well across both head and tail classes. Recent advances in Vicinal Risk Minimization (VRM) have shown promise…

Artificial Intelligence · Computer Science 2026-02-16 Leyao Wang , Yu Wang , Bo Ni , Yuying Zhao , Hanyu Wang , Yao Ma , Tyler Derr

This work studies self-supervised graph learning for text-attributed graphs (TAGs) where nodes are represented by textual attributes. Unlike traditional graph contrastive methods that perturb the numerical feature space and alter the…

Machine Learning · Computer Science 2024-06-19 Yi Fang , Dongzhe Fan , Daochen Zha , Qiaoyu Tan

The latest advancements in large language models (LLMs) have revolutionized the field of natural language processing (NLP). Inspired by the success of LLMs in NLP tasks, some recent work has begun investigating the potential of applying…

Artificial Intelligence · Computer Science 2025-02-25 Shengyin Sun , Yuxiang Ren , Jiehao Chen , Chen Ma

The growing importance of textual and relational systems has driven interest in enhancing large language models (LLMs) for graph-structured data, particularly Text-Attributed Graphs (TAGs), where samples are represented by textual…

Machine Learning · Computer Science 2025-01-28 Yuanfu Sun , Zhengnan Ma , Yi Fang , Jing Ma , Qiaoyu Tan

Anomaly detection on attributed graphs plays an essential role in applications such as fraud detection, intrusion monitoring, and misinformation analysis. However, text-attributed graphs (TAGs), in which node information is expressed in…

Large language models show great potential in unstructured data understanding, but still face significant challenges with graphs due to their structural hallucination. Existing approaches mainly either verbalize graphs into natural…

Computation and Language · Computer Science 2026-02-03 Jingyao Wu , Bin Lu , Zijun Di , Xiaoying Gan , Meng Jin , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Circuit representation learning has shown promise in advancing Electronic Design Automation (EDA) by capturing structural and functional circuit properties for various tasks. Existing pre-trained solutions rely on graph learning with…

Hardware Architecture · Computer Science 2025-04-15 Wenji Fang , Wenkai Li , Shang Liu , Yao Lu , Hongce Zhang , Zhiyao Xie

While Graph Neural Networks (GNNs) and Large Language Models (LLMs) are powerful approaches for learning on Text-Attributed Graphs (TAGs), a comprehensive understanding of their robustness remains elusive. Current evaluations are…

Machine Learning · Computer Science 2025-10-21 Runlin Lei , Lu Yi , Mingguo He , Pengyu Qiu , Zhewei Wei , Yongchao Liu , Chuntao Hong

Prevailing methods for integrating graphs into Language Models (LMs) typically rely on a segregated architecture: external Graph Neural Networks (GNNs) encode structural topology, while LMs process textual semantics. We argue this approach…

Computation and Language · Computer Science 2026-02-02 Haisong Gong , Zhibo Liu , Qiang Liu , Shu Wu , Liang Wang

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang