English
Related papers

Related papers: GraphDC: A Divide-and-Conquer Multi-Agent System f…

200 papers

Long-context capabilities are essential for large language models (LLMs) to tackle complex and long-input tasks. Despite numerous efforts made to optimize LLMs for long contexts, challenges persist in robustly processing long inputs. In…

Computation and Language · Computer Science 2024-11-06 Shilong Li , Yancheng He , Hangyu Guo , Xingyuan Bu , Ge Bai , Jie Liu , Jiaheng Liu , Xingwei Qu , Yangguang Li , Wanli Ouyang , Wenbo Su , Bo Zheng

Various human-designed prompt engineering techniques have been proposed to improve problem solvers based on Large Language Models (LLMs), yielding many disparate code bases. We unify these approaches by describing LLM-based agents as…

Artificial Intelligence · Computer Science 2024-08-23 Mingchen Zhuge , Wenyi Wang , Louis Kirsch , Francesco Faccio , Dmitrii Khizbullin , Jürgen Schmidhuber

Graph embedding methods such as Graph Neural Networks (GNNs) and Graph Transformers have contributed to the development of graph reasoning algorithms for various tasks on knowledge graphs. However, the lack of interpretability and…

Artificial Intelligence · Computer Science 2023-10-26 Qinyong Wang , Zhenxiang Gao , Rong Xu

Large language models (LLMs) are increasingly used for text-rich graph machine learning tasks such as node classification in high-impact domains like fraud detection and recommendation systems. Yet, despite a surge of interest, the field…

Computation and Language · Computer Science 2026-03-03 Ben Finkelshtein , Silviu Cucerzan , Sujay Kumar Jauhar , Ryen White

Although Large Language Models (LLMs) have demonstrated potential in processing graphs, they struggle with comprehending graphical structure information through prompts of graph description sequences, especially as the graph size increases.…

Computation and Language · Computer Science 2024-12-17 Yukun Cao , Shuo Han , Zengyi Gao , Zezhong Ding , Xike Xie , S. Kevin Zhou

Large language models (LLMs) have demonstrated strong reasoning capabilities through step-by-step chain-of-thought (CoT) reasoning. Nevertheless, at the limits of model capability, CoT often proves insufficient, and its strictly sequential…

Computation and Language · Computer Science 2026-02-03 Xiao Liang , Zhong-Zhi Li , Zhenghao Lin , Eric Hancheng Jiang , Hengyuan Zhang , Yelong Shen , Kai-Wei Chang , Ying Nian Wu , Yeyun Gong , Weizhu Chen

Large language models (LLMs) increasingly rely on external knowledge to improve factuality, yet many real-world knowledge sources are organized as heterogeneous graphs rather than plain text. Reasoning over such graphs requires models to…

Machine Learning · Computer Science 2026-05-27 Yuyang Bai , Zhuofeng Li , Ping Nie , Jianwen Xie , Yu Zhang

Recent efforts leverage Large Language Models (LLMs) for modeling text-attributed graph structures in node classification tasks. These approaches describe graph structures for LLMs to understand or aggregate LLM-generated textual attribute…

Computation and Language · Computer Science 2025-05-27 Huachi Zhou , Jiahe Du , Chuang Zhou , Chang Yang , Yilin Xiao , Yuxuan Xie , Xiao Huang

Large language models (LLMs) have achieved great success in many fields, and recent works have studied exploring LLMs for graph discriminative tasks such as node classification. However, the abilities of LLMs for graph generation remain…

Machine Learning · Computer Science 2024-03-22 Yang Yao , Xin Wang , Zeyang Zhang , Yijian Qin , Ziwei Zhang , Xu Chu , Yuekui Yang , Wenwu Zhu , Hong Mei

Improving the general capabilities of large language models (LLMs) is an active research topic. As a common data structure in many real-world domains, understanding graph data is a crucial part of advancing general intelligence. To this…

Artificial Intelligence · Computer Science 2025-11-19 Zihan Luo , Xiran Song , Hong Huang , Jianxun Lian , Chenhao Zhang , Jinqi Jiang , Xing Xie , Hai Jin

Large Language Models (LLMs) have showcased impressive reasoning capabilities, particularly when guided by specifically designed prompts in complex reasoning tasks such as math word problems. These models typically solve tasks using a…

Artificial Intelligence · Computer Science 2024-04-23 Lang Cao

Large language models (LLMs) have achieved impressive performance on many natural language processing tasks. However, their capabilities on graph-structured data remain relatively unexplored. In this paper, we conduct a series of…

Machine Learning · Computer Science 2023-10-10 Yuntong Hu , Zheng Zhang , Liang Zhao

Handling graph data is one of the most difficult tasks. Traditional techniques, such as those based on geometry and matrix factorization, rely on assumptions about the data relations that become inadequate when handling large and complex…

Machine Learning · Computer Science 2024-04-15 Zhenyu Qian , Yiming Qian , Yuting Song , Fei Gao , Hai Jin , Chen Yu , Xia Xie

Large Language Models (LLMs) have achieved impressive performance in complex reasoning problems. Their effectiveness highly depends on the specific nature of the task, especially the required domain knowledge. Existing approaches, such as…

Multiagent Systems · Computer Science 2025-11-20 Jiangwen Dong , Zehui Lin , Wanyu Lin , Mingjin Zhang

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

Task planning in language agents is emerging as an important research topic alongside the development of large language models (LLMs). It aims to break down complex user requests in natural language into solvable sub-tasks, thereby…

Machine Learning · Computer Science 2024-10-29 Xixi Wu , Yifei Shen , Caihua Shan , Kaitao Song , Siwei Wang , Bohang Zhang , Jiarui Feng , Hong Cheng , Wei Chen , Yun Xiong , Dongsheng Li

A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, and financial networks. Recently, large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-08 Wenbo Shang , Xin Huang

Large Language Models (LLMs) have demonstrated strong capabilities in various natural language processing tasks; however, their application to graph-related problems remains limited, primarily due to scalability constraints and the absence…

Machine Learning · Computer Science 2025-05-08 Hyun Lee , Chris Yi , Maminur Islam , B. D. S. Aritra

With the rise of large language models (LLMs), there has been growing interest in Graph Foundation Models (GFMs) for graph-based tasks. By leveraging LLMs as predictors, GFMs have demonstrated impressive generalizability across various…

Machine Learning · Computer Science 2025-03-06 Runlin Lei , Jiarui Ji , Haipeng Ding , Lu Yi , Zhewei Wei , Yongchao Liu , Chuntao Hong

Large Language Models (LLMs) offer significant promise for intelligent traffic management; however, current chain-based systems like TrafficGPT are hindered by sequential task execution, high token usage, and poor scalability, making them…

Artificial Intelligence · Computer Science 2025-07-21 Nabil Abdelaziz Ferhat Taleb , Abdolazim Rezaei , Raj Atulkumar Patel , Mehdi Sookhak