English
Related papers

Related papers: Disentangled Representation Learning with Large La…

200 papers

Disentangled representation learning (DRL) aims to identify and decompose underlying factors behind observations, thus facilitating data perception and generation. However, current DRL approaches often rely on the unrealistic assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Baao Xie , Qiuyu Chen , Yunnan Wang , Zequn Zhang , Xin Jin , Wenjun Zeng

Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node embeddings through shallow embedding learning using GNNs,…

Artificial Intelligence · Computer Science 2025-02-13 Chuanqi Shi , Yiyi Tao , Hang Zhang , Lun Wang , Shaoshuai Du , Yixian Shen , Yanxin Shen

Graph Neural Networks (GNNs) have emerged as powerful tools for learning over structured data, including text-attributed graphs (TAGs), which are common in domains such as citation networks, social platforms, and knowledge graphs. GNNs are…

Machine Learning · Computer Science 2026-04-23 Peyman Baghershahi , Gregoire Fournier , Pranav Nyati , Sourav Medya

Recent efforts leverage Large Language Models (LLMs) for modeling text-attributed graph structures in node classification tasks. These approaches describe graph structures for LLMs to understand or aggregate LLM-generated textual attribute…

Computation and Language · Computer Science 2025-05-27 Huachi Zhou , Jiahe Du , Chuang Zhou , Chang Yang , Yilin Xiao , Yuxuan Xie , Xiao Huang

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

Learning on Graphs has attracted immense attention due to its wide real-world applications. The most popular pipeline for learning on graphs with textual node attributes primarily relies on Graph Neural Networks (GNNs), and utilizes shallow…

Machine Learning · Computer Science 2024-01-17 Zhikai Chen , Haitao Mao , Hang Li , Wei Jin , Hongzhi Wen , Xiaochi Wei , Shuaiqiang Wang , Dawei Yin , Wenqi Fan , Hui Liu , Jiliang Tang

Recently, large language models (LLMs) have demonstrated superior capabilities in understanding and zero-shot learning on textual data, promising significant advances for many text-related domains. In the graph domain, various real-world…

Computation and Language · Computer Science 2024-02-21 Xuanwen Huang , Kaiqiao Han , Yang Yang , Dezheng Bao , Quanjin Tao , Ziwei Chai , Qi Zhu

Recent advancements in text-attributed graphs (TAGs) have significantly improved the quality of node features by using the textual modeling capabilities of language models. Despite this success, utilizing text attributes to enhance the…

Artificial Intelligence · Computer Science 2024-05-30 Hyunjin Seo , Taewon Kim , June Yong Yang , Eunho Yang

Learning from Text-Attributed Graphs (TAGs) has attracted significant attention due to its wide range of real-world applications. The rapid evolution of language models (LMs) has revolutionized the way we process textual data, which…

Machine Learning · Computer Science 2024-10-25 Rui Xue , Xipeng Shen , Ruozhou Yu , Xiaorui Liu

Large Language Models (LLMs) have shown strong performance on text-attributed graphs (TAGs) due to their superior semantic understanding ability on textual node features. However, their effectiveness as predictors in the low-resource…

Machine Learning · Computer Science 2026-04-13 Ruiyao Xu , Kaize Ding

Graphs are an essential data structure utilized to represent relationships in real-world scenarios. Prior research has established that Graph Neural Networks (GNNs) deliver impressive outcomes in graph-centric tasks, such as link prediction…

Machine Learning · Computer Science 2024-09-12 Xubin Ren , Jiabin Tang , Dawei Yin , Nitesh Chawla , Chao Huang

Large language models (LLMs) have demonstrated remarkable in-context reasoning capabilities across a wide range of tasks, particularly with unstructured inputs such as language or images. However, LLMs struggle to handle structured data,…

Machine Learning · Computer Science 2025-02-20 Jintang Li , Ruofan Wu , Yuchang Zhu , Huizhe Zhang , Liang Chen , Zibin Zheng

Large Language Models (LLMs) have shown promising results on various language and vision tasks. Recently, there has been growing interest in applying LLMs to graph-based tasks, particularly on Text-Attributed Graphs (TAGs). However, most…

Machine Learning · Computer Science 2024-06-10 Zhongmou He , Jing Zhu , Shengyi Qian , Joyce Chai , Danai Koutra

Recent advancements in Large Language Models (LLMs) and the proliferation of Text-Attributed Graphs (TAGs) across various domains have positioned LLM-enhanced TAG learning as a critical research area. By utilizing rich graph descriptions,…

Machine Learning · Computer Science 2026-05-12 Zihao Zhang , Xunkai Li , Rong-Hua Li , Zhenjun Li , Bing Zhou , Guoren Wang

Text-attributed graphs (TAGs) integrate textual data with graph structures, providing valuable insights in applications such as social network analysis and recommendation systems. Graph Neural Networks (GNNs) effectively capture both…

Artificial Intelligence · Computer Science 2025-06-17 Yuefei Lyu , Chaozhuo Li , Xi Zhang , Tianle Zhang

Large language models (LLMs) have demonstrated remarkable capabilities across various domains, yet their application to relational deep learning (RDL) remains underexplored. Existing approaches adapt LLMs by traversing relational links…

Computation and Language · Computer Science 2025-06-09 Fang Wu , Vijay Prakash Dwivedi , Jure Leskovec

The (variational) graph auto-encoder is widely used to learn representations for graph-structured data. However, the formation of real-world graphs is a complicated and heterogeneous process influenced by latent factors. Existing encoders…

Machine Learning · Computer Science 2024-07-17 Di Fan , Chuanhou Gao

Large language models (LLMs) have recently been introduced to graph learning, aiming to extend their zero-shot generalization success to tasks where labeled graph data is scarce. Among these applications, inference over text-attributed…

Machine Learning · Computer Science 2025-06-10 Haoyu Wang , Shikun Liu , Rongzhe Wei , Pan Li

Foundation models like ChatGPT and GPT-4 have revolutionized artificial intelligence, exhibiting remarkable abilities to generalize across a wide array of tasks and applications beyond their initial training objectives. However, graph…

Machine Learning · Computer Science 2025-01-22 Yufei He , Yuan Sui , Xiaoxin He , Bryan Hooi

Dynamic text-attributed graphs (DyTAGs) are prevalent in various real-world scenarios, where each node and edge are associated with text descriptions, and both the graph structure and text descriptions evolve over time. Despite their broad…

Artificial Intelligence · Computer Science 2024-11-05 Jiasheng Zhang , Jialin Chen , Menglin Yang , Aosong Feng , Shuang Liang , Jie Shao , Rex Ying