English
Related papers

Related papers: Plan Then Retrieve: Reinforcement Learning-Guided …

200 papers

Retrieve-augmented generation (RAG) frameworks have emerged as a promising solution to multi-hop question answering(QA) tasks since it enables large language models (LLMs) to incorporate external knowledge and mitigate their inherent…

Computation and Language · Computer Science 2024-12-20 Xiangsen Chen , Xuming Hu , Nan Tang

Despite initial successes and a variety of architectures, retrieval-augmented generation systems still struggle to reliably retrieve and connect the multi-step evidence required for complicated reasoning tasks. Most of the standard RAG…

Artificial Intelligence · Computer Science 2026-05-26 Jovan Pavlović , Miklós Krész , László Hajdu

Generative retrieval (GR) models encode a corpus within model parameters and generate relevant document identifiers directly for a given query. While this paradigm shows promise in retrieval tasks, existing GR models struggle with complex…

Information Retrieval · Computer Science 2026-03-16 Steven Dong , Yubao Tang , Maarten de Rijke

With the rise of LLMs, there is an increasing need for intelligent recommendation assistants that can handle complex queries and provide personalized, reasoning-driven recommendations. LLM-based recommenders show potential but face…

Information Retrieval · Computer Science 2026-04-10 Jiani Huang , Shijie Wang , Liangbo Ning , Wenqi Fan , Qing Li

This paper presents an exhaustive quantitative and qualitative evaluation of Large Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We engage in experiments across eight diverse datasets, focusing on four…

Computation and Language · Computer Science 2024-12-30 Yuqi Zhu , Xiaohan Wang , Jing Chen , Shuofei Qiao , Yixin Ou , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

Retrieval-Augmented Generation (RAG) mitigates hallucination in Large Language Models (LLMs) by incorporating external data, with Knowledge Graphs (KGs) offering crucial information for question answering. Traditional Knowledge Graph…

Computation and Language · Computer Science 2025-09-08 Yushi Sun , Kai Sun , Yifan Ethan Xu , Xiao Yang , Xin Luna Dong , Nan Tang , Lei Chen

Knowledge graph reasoning (KGR), aiming to deduce new facts from existing facts based on mined logic rules underlying knowledge graphs (KGs), has become a fast-growing research direction. It has been proven to significantly benefit the…

Artificial Intelligence · Computer Science 2024-10-28 Ke Liang , Lingyuan Meng , Meng Liu , Yue Liu , Wenxuan Tu , Siwei Wang , Sihang Zhou , Xinwang Liu , Fuchun Sun

Knowledge Base Question Answering (KBQA) aims to answer natural language questions over large-scale knowledge bases (KBs), which can be summarized into two crucial steps: knowledge retrieval and semantic parsing. However, three core…

Computation and Language · Computer Science 2024-10-31 Haoran Luo , Haihong E , Zichen Tang , Shiyao Peng , Yikai Guo , Wentai Zhang , Chenghao Ma , Guanting Dong , Meina Song , Wei Lin , Yifan Zhu , Luu Anh Tuan

Knowledge graph (KG) embeddings have been a mainstream approach for reasoning over incomplete KGs. However, limited by their inherently shallow and static architectures, they can hardly deal with the rising focus on complex logical queries,…

Machine Learning · Computer Science 2022-08-17 Xiao Liu , Shiyu Zhao , Kai Su , Yukuo Cen , Jiezhong Qiu , Mengdi Zhang , Wei Wu , Yuxiao Dong , Jie Tang

Previous study suggest that powerful Large Language Models (LLMs) trained with Reinforcement Learning with Verifiable Rewards (RLVR) only refines reasoning path without improving the reasoning capacity in math tasks while…

Computation and Language · Computer Science 2025-05-29 Ran Li , Shimin Di , Yuchen Liu , Chen Jing , Yu Qiu , Lei Chen

Retrieval-augmented generation (RAG) enables large language models (LLMs) to dynamically access external information, which is powerful for answering questions over previously unseen documents. Nonetheless, they struggle with high-level…

Artificial Intelligence · Computer Science 2026-04-21 Chi-Hsiang Hsiao , Yi-Cheng Wang , Tzung-Sheng Lin , Yi-Ren Yeh , Chu-Song Chen

LLMs have demonstrated remarkable capabilities in complex reasoning tasks, yet they often suffer from hallucinations and lack reliable factual grounding. Meanwhile, knowledge graphs (KGs) provide structured factual knowledge but lack the…

Computation and Language · Computer Science 2025-05-28 Xiangqing Shen , Fanfan Wang , Rui Xia

Graph-based RAG constructs a knowledge graph (KG) from text chunks to enhance retrieval in Large Language Model (LLM)-based question answering. It is especially beneficial in domains such as biomedicine, law, and political science, where…

Machine Learning · Computer Science 2025-10-29 Ziyu Liu , Yijing Liu , Jianfei Yuan , Minzhi Yan , Le Yue , Honghui Xiong , Yi Yang

Integrating Large Language Models (LLMs) in Intelligent Tutoring Systems (ITS) presents transformative opportunities for personalized education. However, current implementations face two critical challenges: maintaining factual accuracy and…

Computation and Language · Computer Science 2025-02-13 Chenxi Dong , Yimin Yuan , Kan Chen , Shupei Cheng , Chujie Wen

Planning is a fundamental property of human intelligence. Reasoning about asynchronous plans is challenging since it requires sequential and parallel planning to optimize time costs. Can large language models (LLMs) succeed at this task?…

Artificial Intelligence · Computer Science 2024-06-04 Fangru Lin , Emanuele La Malfa , Valentin Hofmann , Elle Michelle Yang , Anthony Cohn , Janet B. Pierrehumbert

Modern enterprises manage vast knowledge distributed across heterogeneous systems such as Jira, Git repositories, Confluence, and wikis. Conventional retrieval methods based on keyword search or static embeddings often fail to answer…

Artificial Intelligence · Computer Science 2025-10-14 Nilima Rao , Jagriti Srivastava , Pradeep Kumar Sharma , Hritvik Shrivastava

Knowledge Hypergraphs (KHs) have recently emerged as a knowledge representation for retrieval-augmented generation (RAG), offering a paradigm to model multi-entity relations into a structured form. However, existing KH-based RAG methods…

Computation and Language · Computer Science 2026-02-19 Xiangjun Zai , Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Wenjie Zhang

Graph generation is a fundamental task with broad applications, such as drug discovery. Recently, discrete flow matching-based graph generation, \aka, graph flow model (GFM), has emerged due to its superior performance and flexible…

Machine Learning · Computer Science 2026-03-12 Baoheng Zhu , Deyu Bo , Delvin Ce Zhang , Xiao Wang

Reinforcement learning (RL) for mathematical reasoning can suffer from reward sparsity: for challenging problems, LLM fails to sample any correct trajectories, preventing RL from receiving meaningful positive feedback. At the same time,…

Machine Learning · Computer Science 2026-03-06 Yangzhen Wu , Shanda Li , Zixin Wen , Xin Zhou , Ameet Talwalkar , Yiming Yang , Wenhao Huang , Tianle Cai

Large Language Models (LLMs) have achieved impressive results in various tasks but struggle with hallucination problems and lack of relevant knowledge, especially in deep complex reasoning and knowledge-intensive tasks. Knowledge Graphs…

Computation and Language · Computer Science 2025-03-14 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Wenjie Zhang