English
Related papers

Related papers: Graph2text or Graph2token: A Perspective of Large …

200 papers

Multi-modal graphs, which integrate diverse multi-modal features and relations, are ubiquitous in real-world applications. However, existing multi-modal graph learning methods are typically trained from scratch for specific graph data and…

Machine Learning · Computer Science 2025-11-26 Xin Wang , Zeyang Zhang , Linxin Xiao , Haibo Chen , Chendi Ge , Wenwu Zhu

Motivated by interpretability and reliability, we investigate whether large language models (LLMs) deploy universal geometric structures to encode discrete, graph-structured knowledge. To this end, we present two complementary experimental…

Machine Learning · Computer Science 2025-11-25 David D. Baek , Yuxiao Li , Max Tegmark

Due to the advantages of hypergraphs in modeling high-order relationships in complex systems, they have been applied to higher-order clustering, hypergraph neural networks and computer vision. These applications rely heavily on access to…

Social and Information Networks · Computer Science 2025-10-15 Bingqiao Gu , Jiale Zeng , Xingqin Qi , Dong Li

Large models have emerged as the most recent groundbreaking achievements in artificial intelligence, and particularly machine learning. However, when it comes to graphs, large models have not achieved the same level of success as in other…

Machine Learning · Computer Science 2023-11-14 Ziwei Zhang , Haoyang Li , Zeyang Zhang , Yijian Qin , Xin Wang , Wenwu Zhu

Graph fraud detection has garnered significant attention as Graph Neural Networks (GNNs) have proven effective in modeling complex relationships within multimodal data. However, existing graph fraud detection methods typically use…

Machine Learning · Computer Science 2025-10-03 Tairan Huang , Yili Wang , Qiutong Li , Changlong He , Jianliang Gao

Graph Neural Architecture Search (GNAS) facilitates the automatic design of Graph Neural Networks (GNNs) tailored to specific downstream graph learning tasks. However, existing GNAS approaches often require manual adaptation to new graph…

Machine Learning · Computer Science 2025-02-18 Yang Gao , Hong Yang , Yizhi Chen , Junxian Wu , Peng Zhang , Haishuai Wang

Graph Transformers, leveraging the global attention to capture long-range dependencies in graph structures, have significantly advanced graph machine learning, but face prohibitive computational complexity. Tokenized Graph Learning Models…

Machine Learning · Computer Science 2025-05-23 Zhibiao Wang , Yunlong Zhou , Ziwei Zhang , Mengmei Zhang , Shirui Pan , Chunming Hu , Xiao Wang

Large Language Models (LLMs) have recently driven significant advancements in Natural Language Processing and various other applications. While a broad range of literature has explored the graph-reasoning capabilities of LLMs, including…

Computation and Language · Computer Science 2025-06-09 Shenyang Huang , Ali Parviz , Emma Kondrup , Zachary Yang , Zifeng Ding , Michael Bronstein , Reihaneh Rabbany , Guillaume Rabusseau

Graph Neural Networks (GNNs) have emerged as powerful tools for learning over structured data, including text-attributed graphs (TAGs), which are common in domains such as citation networks, social platforms, and knowledge graphs. GNNs are…

Machine Learning · Computer Science 2026-04-23 Peyman Baghershahi , Gregoire Fournier , Pranav Nyati , Sourav Medya

The integration of Large Language Models (LLMs) with Graph Neural Networks (GNNs) has recently been explored to enhance the capabilities of Text Attribute Graphs (TAGs). Most existing methods feed textual descriptions of the graph structure…

Computation and Language · Computer Science 2025-04-03 Zhaoxing Li , Xiaoming Zhang , Haifeng Zhang , Chengxiang Liu

Large language models (LLMs) have recently shown strong potential in modeling relational structures. However, existing approaches remain fundamentally graph-centric: they focus on processing pairwise graph structures into tokens that LLMs…

Computation and Language · Computer Science 2026-05-22 Mengqi Lei , Guohuan Xie , Shihui Ying , Shaoyi Du , Jun-Hai Yong , Siqi Li , Yue Gao

Task planning in language agents is emerging as an important research topic alongside the development of large language models (LLMs). It aims to break down complex user requests in natural language into solvable sub-tasks, thereby…

Machine Learning · Computer Science 2024-10-29 Xixi Wu , Yifei Shen , Caihua Shan , Kaitao Song , Siwei Wang , Bohang Zhang , Jiarui Feng , Hong Cheng , Wei Chen , Yun Xiong , Dongsheng Li

Pretrained Language Models (PLMs) such as BERT have revolutionized the landscape of Natural Language Processing (NLP). Inspired by their proliferation, tremendous efforts have been devoted to Pretrained Graph Models (PGMs). Owing to the…

Machine Learning · Computer Science 2022-03-22 Jun Xia , Yanqiao Zhu , Yuanqi Du , Stan Z. Li

Recently, the emergence of large language models (LLMs) has motivated integrating language descriptions into graphs, forming text-attributed graphs (TAGs) that enhance model encoding capabilities from a data-centric perspective. A review of…

Machine Learning · Computer Science 2026-02-03 Zhihan Zhang , Xunkai Li , Lei Zhu , Guang Zeng , Bowen Fan , Yanzhe Wen , Hongchao Qin , Rong-Hua Li , Guoren Wang

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Large Vision-Language…

Machine Learning · Computer Science 2024-11-05 Jinyoung Park , Minseong Bae , Dohwan Ko , Hyunwoo J. Kim

Do current large language models (LLMs) better solve graph reasoning and generation tasks with parameter updates? In this paper, we propose InstructGraph, a framework that empowers LLMs with the abilities of graph reasoning and generation…

Computation and Language · Computer Science 2024-02-15 Jianing Wang , Junda Wu , Yupeng Hou , Yao Liu , Ming Gao , Julian McAuley

We introduce G2T-LLM, a novel approach for molecule generation that uses graph-to-tree text encoding to transform graph-based molecular structures into a hierarchical text format optimized for large language models (LLMs). This encoding…

Machine Learning · Computer Science 2024-10-04 Zhaoning Yu , Xiangyang Xu , Hongyang Gao

Large language models (LLMs) demonstrate great potential for problems with implicit graphical structures, while recent works seek to enhance the graph reasoning capabilities of LLMs through specialized instruction tuning. The resulting…

Computation and Language · Computer Science 2024-10-14 Yizhuo Zhang , Heng Wang , Shangbin Feng , Zhaoxuan Tan , Xiaochuang Han , Tianxing He , Yulia Tsvetkov

With the increasing popularity of large language models (LLMs), reasoning on basic graph algorithm problems is an essential intermediate step in assessing their abilities to process and infer complex graph reasoning tasks. Existing methods…

Computation and Language · Computer Science 2024-08-27 Qiaolong Cai , Zhaowei Wang , Shizhe Diao , James Kwok , Yangqiu Song

Large language models (LLMs) process and predict sequences containing text to answer questions, and address tasks including document summarization, providing recommendations, writing software and solving quantitative problems. We provide a…

Numerical Analysis · Mathematics 2026-02-02 Ricardo Baptista , Andrew Stuart , Son Tran