English
Related papers

Related papers: Follow the Path: Reasoning over Knowledge Graph Pa…

200 papers

The ability of large language models (LLMs) to follow user instructions is central to their reliability, safety, and usefulness. While prior studies assess instruction adherence in the model's main responses, we argue that it is also…

Machine Learning · Computer Science 2025-10-20 Yongchan Kwon , Shang Zhu , Federico Bianchi , Kaitlyn Zhou , James Zou

Due to the remarkable reasoning ability, Large language models (LLMs) have demonstrated impressive performance in knowledge graph question answering (KGQA) tasks, which find answers to natural language questions over knowledge graphs (KGs).…

Computation and Language · Computer Science 2025-02-25 Xiao Long , Liansheng Zhuang , Aodi Li , Minghong Yao , Shafei Wang

The advent of Large Language Models (LLMs) has significantly transformed the AI landscape, enhancing machine learning and AI capabilities. Factuality issue is a critical concern for LLMs, as they may generate factually incorrect responses.…

Computation and Language · Computer Science 2024-04-02 Xiaoze Liu , Feijie Wu , Tianyang Xu , Zhuo Chen , Yichi Zhang , Xiaoqian Wang , Jing Gao

Reasoning over knowledge graphs (KGs) with first-order logic (FOL) queries is challenging due to the inherent incompleteness of real-world KGs and the compositional complexity of logical query structures. Most existing methods rely on…

Computation and Language · Computer Science 2025-12-23 Ziyan Zhang , Chao Wang , Zhuo Chen , Lei Chen , Chiyi Li , Kai Song

Large language models like GPT-4, Gemini, and Claude have transformed natural language processing (NLP) tasks such as question answering, dialogue generation, summarization, and so forth; yet their susceptibility to hallucination stands as…

Computation and Language · Computer Science 2025-07-21 Nur A Zarin Nishat , Andrea Coletta , Luigi Bellomarini , Kossi Amouzouvi , Jens Lehmann , Sahar Vahdati

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

Computation and Language · Computer Science 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin

Large Language Models (LLMs) have showcased impressive reasoning capabilities, particularly when guided by specifically designed prompts in complex reasoning tasks such as math word problems. These models typically solve tasks using a…

Artificial Intelligence · Computer Science 2024-04-23 Lang Cao

In reasoning tasks, even a minor error can cascade into inaccurate results, leading to suboptimal performance of large language models in such domains. Earlier fine-tuning approaches sought to mitigate this by leveraging more precise…

Computation and Language · Computer Science 2024-07-12 Changyu Chen , Xiting Wang , Ting-En Lin , Ang Lv , Yuchuan Wu , Xin Gao , Ji-Rong Wen , Rui Yan , Yongbin Li

Large Language Models (LLMs) might hallucinate facts, while curated Knowledge Graph (KGs) are typically factually reliable especially with domain-specific knowledge. Measuring the alignment between KGs and LLMs can effectively probe the…

Artificial Intelligence · Computer Science 2024-08-02 Shangshang Zheng , He Bai , Yizhe Zhang , Yi Su , Xiaochuan Niu , Navdeep Jaitly

Although Large Language Models (LLMs) are effective in performing various NLP tasks, they still struggle to handle tasks that require extensive, real-world knowledge, especially when dealing with long-tail facts (facts related to long-tail…

Computation and Language · Computer Science 2024-05-13 Wenyu Huang , Guancheng Zhou , Mirella Lapata , Pavlos Vougiouklis , Sebastien Montella , Jeff Z. Pan

Confidence estimation is essential for the reliable deployment of large language models (LLMs). Existing methods are primarily designed for factual QA tasks and often fail to generalize to reasoning tasks. To address this gap, we propose a…

Computation and Language · Computer Science 2025-09-17 Caiqi Zhang , Chang Shu , Ehsan Shareghi , Nigel Collier

The reasoning process of Large Language Models (LLMs) is often plagued by hallucinations and missing facts in question-answering tasks. A promising solution is to ground LLMs' answers in verifiable knowledge sources, such as Knowledge…

Computation and Language · Computer Science 2026-02-26 Shiqi Yan , Yubo Chen , Ruiqi Zhou , Zhengxi Yao , Shuai Chen , Tianyi Zhang , Shijie Zhang , Wei Qiang Zhang , Yongfeng Huang , Haixin Duan , Yunqi Zhang

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

In recent years, large language models (LLMs) have demonstrated significant success in performing varied natural language tasks such as language translation, question-answering, summarizing, fact-checking, etc. Despite LLMs' impressive…

Computation and Language · Computer Science 2025-03-03 Bishwamittra Ghosh , Sarah Hasan , Naheed Anjum Arafat , Arijit Khan

Large language models (LLMs) have shown remarkable capabilities in various natural language processing tasks, yet they often struggle with maintaining factual accuracy, particularly in knowledge-intensive domains like healthcare. This study…

Computation and Language · Computer Science 2024-11-01 Hieu Tran , Junda Wang , Yujan Ting , Weijing Huang , Terrence Chen

Large Language Models (LLMs) demonstrate strong reasoning capabilities but struggle with hallucinations and limited transparency. Recently, KG-enhanced LLMs that integrate knowledge graphs (KGs) have been shown to improve reasoning…

Artificial Intelligence · Computer Science 2025-12-10 Minbae Park , Hyemin Yang , Jeonghyun Kim , Kunsoo Park , Hyunjoon Kim

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Large Language Models (LLMs) frequently hallucinate, impeding their reliability in mission-critical situations. One approach to address this issue is to provide citations to relevant sources alongside generated content, enhancing the…

Computation and Language · Computer Science 2024-07-16 Rami Aly , Zhiqiang Tang , Samson Tan , George Karypis

Although Large Language Models (LLMs) have demonstrated remarkable progress, their proficiency in graph-related tasks remains notably limited, hindering the development of truly general-purpose models. Previous attempts, including…

Machine Learning · Computer Science 2025-08-20 Xiaojun Guo , Ang Li , Yifei Wang , Stefanie Jegelka , Yisen Wang

Large language models (LLMs) have demonstrated remarkable performance across a wide range of tasks. Advances in prompt engineering and fine-tuning techniques have further enhanced their ability to address complex reasoning challenges.…

Computation and Language · Computer Science 2024-12-16 Jing Bi , Yuting Wu , Weiwei Xing , Zhenjie Wei