English
Related papers

Related papers: Graph-O1 : Monte Carlo Tree Search with Reinforcem…

200 papers

Retrieval-Augmented Generation (RAG) has emerged as a dominant paradigm for mitigating hallucinations in Large Language Models (LLMs) by incorporating external knowledge. Nevertheless, effectively integrating and interpreting key evidence…

Computation and Language · Computer Science 2026-01-26 Zhenghao Liu , Mingyan Wu , Xinze Li , Yukun Yan , Shuo Wang , Cheng Yang , Minghe Yu , Zheni Zeng , Maosong Sun

Large language models (LLMs) have emerged as powerful tools for natural language table reasoning, where there are two main categories of methods. Prompt-based approaches rely on language-only inference or one-pass program generation without…

Databases · Computer Science 2026-02-17 Zhizhao Luo , Zhaojing Luo , Meihui Zhang , Rui Mao

Text-Attributed Graphs (TAGs) are graphs of connected textual documents. Graph models can efficiently learn TAGs, but their training heavily relies on human-annotated labels, which are scarce or even unavailable in many applications. Large…

Computation and Language · Computer Science 2024-08-07 Bo Pan , Zheng Zhang , Yifei Zhang , Yuntong Hu , Liang Zhao

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of language tasks, yet complex multi-step reasoning remains a fundamental challenge. While Large Reasoning Models (LRMs) equipped with extended…

Artificial Intelligence · Computer Science 2026-03-17 Guangfu Hao , Yuming Dai , Xianzhe Qin , Shan Yu

Extensive research has investigated the integration of large language models (LLMs) with knowledge graphs to enhance the reasoning process. However, understanding how models perform reasoning utilizing structured graph knowledge remains…

Computation and Language · Computer Science 2025-02-24 Han Zhang , Langshi Zhou , Hanfang Yang

Large Language Models (LLMs) gain substantial reasoning and decision-making capabilities from thought structures. However, existing methods such as Tree of Thought and Retrieval Augmented Thoughts often fall short in complex tasks due to…

Computation and Language · Computer Science 2024-12-24 Jinghan Zhang , Xiting Wang , Weijieying Ren , Lu Jiang , Dongjie Wang , Kunpeng Liu

Recent advancements in Large Vision Language Models (LVLMs) have significantly improved performance in Visual Question Answering (VQA) tasks through multimodal Retrieval-Augmented Generation (RAG). However, existing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qi Yang , Chenghao Zhang , Lubin Fan , Kun Ding , Jieping Ye , Shiming Xiang

Large Language Models (LLMs) increasingly rely on agentic capabilities-iterative retrieval, tool use, and decision-making-to overcome the limits of static, parametric knowledge. Yet existing agentic frameworks treat external information as…

Computation and Language · Computer Science 2026-04-24 Yuanfu Sun , Kang Li , Dongzhe Fan , Jiajin Liu , Qiaoyu Tan

Large Language Models (LLMs) show strong reasoning ability in open-domain question answering, yet their reasoning processes are typically linear and often logically inconsistent. In contrast, real-world reasoning requires integrating…

Computation and Language · Computer Science 2026-01-21 Yingjian Chen , Haoran Liu , Yinhong Liu , Sherry T. Tong , Aosong Feng , Jinghui Lu , Juntao Zhang , Yusuke Iwasawa , Yutaka Matsuo , Irene Li

Large Language Models (LLMs), constrained by limited context windows, often face significant performance degradation when reasoning over long contexts. To address this, Retrieval-Augmented Generation (RAG) retrieves and reasons over chunks…

Computation and Language · Computer Science 2025-11-04 Jiani Guo , Zuchao Li , Jie Wu , Qianren Wang , Yun Li , Lefei Zhang , Hai Zhao , Yujiu Yang

Research question answering requires accurate retrieval and contextual understanding of scientific literature. However, current Retrieval-Augmented Generation (RAG) methods often struggle to balance complex document relationships with…

Information Retrieval · Computer Science 2025-01-28 Yuntong Hu , Zhihan Lei , Zhongjie Dai , Allen Zhang , Abhinav Angirekula , Zheng Zhang , Liang Zhao

The advent of large language models (LLMs) has transformed information access and reasoning through open-ended natural language interaction. However, LLMs remain limited by static knowledge, factual hallucinations, and the inability to…

Artificial Intelligence · Computer Science 2025-10-29 Minhua Lin , Zongyu Wu , Zhichao Xu , Hui Liu , Xianfeng Tang , Qi He , Charu Aggarwal , Hui Liu , Xiang Zhang , Suhang Wang

Large language models demonstrate exceptional performance in simple code generation tasks but still face challenges in tackling complex problems. These challenges may stem from insufficient reasoning and problem decomposition capabilities.…

Computation and Language · Computer Science 2025-05-12 Bin Xu , Yiguan Lin , Yinghao Li , Yang Gao

Large Language Models (LLMs) have demonstrated strong potential for many mathematical problems. However, their performance on graph algorithmic tasks is still unsatisfying, since graphs are naturally more complex in topology and often…

Artificial Intelligence · Computer Science 2026-05-11 Wenjin Li , Jiaming Cui

Retrieval-augmented generation (RAG) improves the response quality of large language models (LLMs) by retrieving knowledge from external databases. Typical RAG approaches split the text database into chunks, organizing them in a flat…

Computation and Language · Computer Science 2025-11-18 Boyu Chen , Zirui Guo , Zidan Yang , Yuluo Chen , Junze Chen , Zhenghao Liu , Chuan Shi , Cheng Yang

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Text-attributed graphs (TAGs) are prevalent on the web and research over TAGs such as citation networks, e-commerce networks and social networks has attracted considerable attention in the web community. Recently, large language models…

Computation and Language · Computer Science 2024-03-12 Yijian Qin , Xin Wang , Ziwei Zhang , Wenwu Zhu

This study introduces a novel approach to sentence-level relation extraction (RE) that integrates Graph Neural Networks (GNNs) with Large Language Models (LLMs) to generate contextually enriched support documents. By harnessing the power of…

Computation and Language · Computer Science 2024-11-01 Vicky Dong , Hao Yu , Yao Chen

Efficiently acquiring external knowledge and up-to-date information is essential for effective reasoning and text generation in large language models (LLMs). Prompting advanced LLMs with reasoning capabilities to use search engines during…

Computation and Language · Computer Science 2025-08-07 Bowen Jin , Hansi Zeng , Zhenrui Yue , Jinsung Yoon , Sercan Arik , Dong Wang , Hamed Zamani , Jiawei Han

The success of Large Language Models (LLMs) in various domains has led researchers to apply them to graph-related problems by converting graph data into natural language text. However, unlike graph data, natural language inherently has…

Machine Learning · Computer Science 2025-02-13 Xu Chu , Hanlin Xue , Zhijie Tan , Bingce Wang , Tong Mo , Weiping Li