English
Related papers

Related papers: GIVE: Structured Reasoning of Large Language Model…

200 papers

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems.…

Machine Learning · Computer Science 2025-05-20 Hang Gao , Chenhao Zhang , Tie Wang , Junsuo Zhao , Fengge Wu , Changwen Zheng , Huaping Liu

Knowledge extrapolation is the process of inferring novel information by combining and extending existing knowledge that is explicitly available. It is essential for solving complex questions in specialized domains where retrieving…

Computation and Language · Computer Science 2026-04-03 Jiashu He , Jinxuan Fan , Bowen Jiang , Ignacio Houine , Dan Roth , Alejandro Ribeiro

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, they often struggle with complex reasoning tasks and are prone to hallucination. Recent research has shown…

Computation and Language · Computer Science 2024-12-17 Xue Wu , Kostas Tsioutsiouliklis

Large language models (LLMs) show promise for diagnostic reasoning but often lack reliable, knowledge grounded inference. Knowledge graphs (KGs), such as the Unified Medical Language System (UMLS), offer structured biomedical knowledge that…

Computation and Language · Computer Science 2025-09-24 Saksham Khatwani , He Cheng , Majid Afshar , Dmitriy Dligach , Yanjun Gao

Large Language Models (LLMs) integrated with Retrieval-Augmented Generation (RAG) techniques have exhibited remarkable performance across a wide range of domains. However, existing RAG approaches primarily operate on unstructured data and…

Artificial Intelligence · Computer Science 2026-04-22 Ge Chang , Jinbo Su , Jiacheng Liu , Pengfei Yang , Yuhao Shang , Huiwen Zheng , Hongli Ma , Yan Liang , Yuanchun Li , Yunxin Liu

We focus on a conversational question answering task which combines the challenges of understanding questions in context and reasoning over evidence gathered from heterogeneous sources like text, knowledge graphs, tables, and infoboxes. Our…

Computation and Language · Computer Science 2024-07-16 Parag Jain , Mirella Lapata

Large Language Models (LLMs) often struggle with inherent knowledge boundaries and hallucinations, limiting their reliability in knowledge-intensive tasks. While Retrieval-Augmented Generation (RAG) mitigates these issues, it frequently…

Artificial Intelligence · Computer Science 2026-02-25 Yuqi Huang , Ning Liao , Kai Yang , Anning Hu , Shengchao Hu , Xiaoxing Wang , Junchi Yan

Large Language Models (LLMs) have shown strong inductive reasoning ability across various domains, but their reliability is hindered by the outdated knowledge and hallucinations. Retrieval-Augmented Generation mitigates these issues by…

Computation and Language · Computer Science 2025-06-12 Tianjun Yao , Haoxuan Li , Zhiqiang Shen , Pan Li , Tongliang Liu , Kun Zhang

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Large Language Models (LLMs) have achieved strong performance across a wide range of natural language processing tasks in recent years, including machine translation, text generation, and question answering. As their applications extend to…

Computation and Language · Computer Science 2025-12-30 Xin Zhang , Yang Cao , Baoxing Wu , Xinyi Chen , Kai Song , Siying Li

Large language models (LLMs) often suffer from hallucination, generating factually incorrect statements when handling questions beyond their knowledge and perception. Retrieval-augmented generation (RAG) addresses this by retrieving…

Computation and Language · Computer Science 2025-11-18 Shengyuan Chen , Chuang Zhou , Zheng Yuan , Qinggang Zhang , Zeyang Cui , Hao Chen , Yilin Xiao , Jiannong Cao , Xiao Huang

Extensive research has investigated the integration of large language models (LLMs) with knowledge graphs to enhance the reasoning process. However, understanding how models perform reasoning utilizing structured graph knowledge remains…

Computation and Language · Computer Science 2025-02-24 Han Zhang , Langshi Zhou , Hanfang Yang

While large language models (LLMs) are proficient at question-answering (QA), it is not always clear how (or even if) an answer follows from their latent "beliefs". This lack of interpretability is a growing impediment to widespread use of…

Computation and Language · Computer Science 2023-10-31 Nora Kassner , Oyvind Tafjord , Ashish Sabharwal , Kyle Richardson , Hinrich Schuetze , Peter Clark

Large Language Models (LLMs) are adept at generating responses based on information within their context. While this ability is useful for interacting with structured data like code files, another popular method, Retrieval-Augmented…

Computation and Language · Computer Science 2025-10-22 Mihir Gupte , Paolo Giusto , Ramesh S

Although Large Language Models (LLMs) excel at addressing straightforward reasoning tasks, they frequently struggle with difficulties when confronted by more complex multi-step reasoning due to a range of factors. Firstly, natural language…

Computation and Language · Computer Science 2024-02-22 Kewei Cheng , Nesreen K. Ahmed , Theodore Willke , Yizhou Sun

Graph embedding methods such as Graph Neural Networks (GNNs) and Graph Transformers have contributed to the development of graph reasoning algorithms for various tasks on knowledge graphs. However, the lack of interpretability and…

Artificial Intelligence · Computer Science 2023-10-26 Qinyong Wang , Zhenxiang Gao , Rong Xu

Reasoning over knowledge graphs (KGs) is a challenging task that requires a deep understanding of the complex relationships between entities and the underlying logic of their relations. Current approaches rely on learning geometries to…

Logic in Computer Science · Computer Science 2024-04-02 Nurendra Choudhary , Chandan K. Reddy

Large Language Models (LLMs) have demonstrated remarkable capabilities in modeling sequential textual data and generalizing across diverse tasks. However, adapting LLMs to effectively handle structural data, such as knowledge graphs or web…

Computation and Language · Computer Science 2025-11-12 Jiarui Feng , Donghong Cai , Yixin Chen , Muhan Zhang

Recent advances in test-time scaling have enabled Large Language Models (LLMs) to display sophisticated reasoning abilities via extended Chain-of-Thought (CoT) generation. Despite their potential, these Reasoning LLMs (RLMs) often…

Computation and Language · Computer Science 2025-05-21 Zhen Xiong , Yujun Cai , Zhecheng Li , Yiwei Wang

Large Language Models (LLMs) often struggle with producing factually consistent answers due to limitations in their parametric memory. Retrieval-Augmented Generation (RAG) paradigms mitigate this issue by incorporating external knowledge at…

Computation and Language · Computer Science 2026-05-05 Shanglin Wu , Lihui Liu , Jinho D. Choi , Kai Shu