English
Related papers

Related papers: Distilling Large Language Models for Text-Attribut…

200 papers

Large language models (LLMs) have been used in many zero-shot learning problems, with their strong generalization ability. Recently, adopting LLMs in text-attributed graphs (TAGs) has drawn increasing attention. However, the adoption of…

Machine Learning · Computer Science 2025-10-03 Yusheng Zhao , Qixin Zhang , Xiao Luo , Weizhi Zhang , Zhiping Xiao , Wei Ju , Philip S. Yu , Ming Zhang

Despite the superior performance of large language models to generate natural language texts, it is hard to generate texts with correct logic according to a given task, due to the difficulties for neural models to capture implied rules from…

Computation and Language · Computer Science 2024-07-08 Fan Zhang , Kebing Jin , Hankz Hankui Zhuo

With the rapid advancement of large language models (LLMs), classic graph learning tasks have greatly benefited from LLMs, including improved encoding of textual features, more efficient construction of graphs from text, and enhanced…

Artificial Intelligence · Computer Science 2026-05-05 Xiyuan Wang , Yi Hu , Yanbo Wang , Chuan Shi , Muhan Zhang

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

Text-attributed graphs (TAGs) integrate textual data with graph structures, providing valuable insights in applications such as social network analysis and recommendation systems. Graph Neural Networks (GNNs) effectively capture both…

Artificial Intelligence · Computer Science 2025-06-17 Yuefei Lyu , Chaozhuo Li , Xi Zhang , Tianle Zhang

Large language models (LLMs) such as GPT-4 have emerged as frontrunners, showcasing unparalleled prowess in diverse applications, including answering queries, code generation, and more. Parallelly, graph-structured data, an intrinsic data…

Artificial Intelligence · Computer Science 2023-11-14 Shirui Pan , Yizhen Zheng , Yixin Liu

Graphs provide a unified representation of semantic content and relational structure, making them a natural fit for domains such as molecular modeling, citation networks, and social graphs. Meanwhile, large language models (LLMs) have…

Machine Learning · Computer Science 2026-05-04 Haotian Xu , Yuning You , Tengfei Ma

Recent advancements in text-attributed graphs (TAGs) have significantly improved the quality of node features by using the textual modeling capabilities of language models. Despite this success, utilizing text attributes to enhance the…

Artificial Intelligence · Computer Science 2024-05-30 Hyunjin Seo , Taewon Kim , June Yong Yang , Eunho Yang

While Graph Neural Networks (GNNs) and Large Language Models (LLMs) are powerful approaches for learning on Text-Attributed Graphs (TAGs), a comprehensive understanding of their robustness remains elusive. Current evaluations are…

Machine Learning · Computer Science 2025-10-21 Runlin Lei , Lu Yi , Mingguo He , Pengyu Qiu , Zhewei Wei , Yongchao Liu , Chuntao Hong

Graph Neural Networks (GNNs) have emerged as powerful tools for learning over structured data, including text-attributed graphs (TAGs), which are common in domains such as citation networks, social platforms, and knowledge graphs. GNNs are…

Machine Learning · Computer Science 2026-04-23 Peyman Baghershahi , Gregoire Fournier , Pranav Nyati , Sourav Medya

Recently, research on Text-Attributed Graphs (TAGs) has gained significant attention due to the prevalence of free-text node features in real-world applications and the advancements in Large Language Models (LLMs) that bolster TAG…

Machine Learning · Computer Science 2025-02-25 Yun Zhu , Haizhou Shi , Xiaotang Wang , Yongchao Liu , Yaoke Wang , Boci Peng , Chuntao Hong , Siliang Tang

Large Language Models (LLMs) have demonstrated remarkable proficiency in understanding and generating natural language. However, their capabilities wane in highly specialized domains underrepresented in the pretraining corpus, such as…

Machine Learning · Computer Science 2024-07-29 Junhong Shen , Neil Tenenholtz , James Brian Hall , David Alvarez-Melis , Nicolo Fusi

Relation extraction represents a fundamental component in the process of creating knowledge graphs, among other applications. Large language models (LLMs) have been adopted as a promising tool for relation extraction, both in supervised and…

Computation and Language · Computer Science 2026-04-13 Paolo Gajo , Domenic Rosati , Hassan Sajjad , Alberto Barrón-Cedeño

Graph representation learning, involving both node features and graph structures, is crucial for real-world applications but often encounters pervasive noise. State-of-the-art methods typically address noise by focusing separately on node…

Machine Learning · Computer Science 2024-10-17 Guangxin Su , Yifan Zhu , Wenjie Zhang , Hanchen Wang , Ying Zhang

Large language models (LLMs) are increasingly used for text-rich graph machine learning tasks such as node classification in high-impact domains like fraud detection and recommendation systems. Yet, despite a surge of interest, the field…

Computation and Language · Computer Science 2026-03-03 Ben Finkelshtein , Silviu Cucerzan , Sujay Kumar Jauhar , Ryen White

Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep learning, Graph Neural Networks (GNNs) have emerged as a…

Machine Learning · Computer Science 2024-06-05 Wenqi Fan , Shijie Wang , Jiani Huang , Zhikai Chen , Yu Song , Wenzhuo Tang , Haitao Mao , Hui Liu , Xiaorui Liu , Dawei Yin , Qing Li

Developing generalizable models that can effectively learn from limited data and with minimal reliance on human supervision is a significant objective within the machine learning community, particularly in the era of deep neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Wenxuan Ma , Shuang Li , Lincan Cai , Jingxuan Kang

The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to…

Computation and Language · Computer Science 2023-10-10 Ziwei Chai , Tianjie Zhang , Liang Wu , Kaiqiao Han , Xiaohai Hu , Xuanwen Huang , Yang Yang

A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, and financial networks. Recently, large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-08 Wenbo Shang , Xin Huang

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu