English
Related papers

Related papers: Bridging the Knowledge-Prediction Gap in LLMs on M…

200 papers

The integration of large language models (LLMs) and search engines represents a significant evolution in knowledge acquisition methodologies. However, determining the knowledge that an LLM already possesses and the knowledge that requires…

Computation and Language · Computer Science 2024-05-31 Jiejun Tan , Zhicheng Dou , Yutao Zhu , Peidong Guo , Kun Fang , Ji-Rong Wen

Large language models (LLMs) exhibit strikingly conflicting behaviors: they can appear steadfastly overconfident in their initial answers whilst at the same time being prone to excessive doubt when challenged. To investigate this apparent…

Although many large-scale knowledge bases (KBs) claim to contain multilingual information, their support for many non-English languages is often incomplete. This incompleteness gives birth to the task of cross-lingual question answering…

Computation and Language · Computer Science 2023-02-28 Chen Zhang , Yuxuan Lai , Yansong Feng , Xingyu Shen , Haowei Du , Dongyan Zhao

While large language models (LLMs) have demonstrated exceptional performance across various tasks following human alignment, they may still generate responses that sound plausible but contradict factual knowledge, a phenomenon known as…

Computation and Language · Computer Science 2024-09-24 Fanqi Wan , Xinting Huang , Leyang Cui , Xiaojun Quan , Wei Bi , Shuming Shi

Large Language Models (LLMs) have achieved significant success in open-domain question answering. However, they continue to face challenges such as hallucinations and knowledge cutoffs. These issues can be mitigated through in-context…

Computation and Language · Computer Science 2025-02-19 Zukang Yang , Zixuan Zhu , Xuan Zhu

Fine-tuning large language models (LLMs) with high-quality knowledge has been shown to enhance their performance effectively. However, there is a paucity of research on the depth of domain-specific knowledge comprehension by LLMs and the…

Computation and Language · Computer Science 2026-03-19 Haoxuan Yin , Bojian Liu , Chen Tang , Yangfan Wang , Lian Yan , Jingchi Jiang

Understanding the internal representations of large language models (LLMs) can help explain models' behavior and verify their alignment with human values. Given the capabilities of LLMs in generating human-understandable text, we propose…

Computation and Language · Computer Science 2024-06-10 Asma Ghandeharioun , Avi Caciularu , Adam Pearce , Lucas Dixon , Mor Geva

Large vision-language models (LVLMs) demonstrate strong visual question answering (VQA) capabilities but are shown to hallucinate. A reliable model should perceive its knowledge boundaries-knowing what it knows and what it does not. This…

Computation and Language · Computer Science 2025-08-27 Zhikai Ding , Shiyu Ni , Keping Bi

Large Language Models (LLMs) have acquired ubiquitous attention for their performances across diverse domains. Our study here searches through LLMs' cognitive abilities and confidence dynamics. We dive deep into understanding the alignment…

Computation and Language · Computer Science 2023-09-29 Aniket Kumar Singh , Suman Devkota , Bishal Lamichhane , Uttam Dhakal , Chandra Dhakal

As artificial intelligence (AI) systems, particularly large language models (LLMs), become increasingly integrated into decision-making processes, the ability to trust their outputs is crucial. To earn human trust, LLMs must be well…

Machine Learning · Computer Science 2025-02-14 Mark Steyvers , Heliodoro Tejeda , Aakriti Kumar , Catarina Belem , Sheer Karny , Xinyue Hu , Lukas Mayer , Padhraic Smyth

Large language models (LLMs) based on generative pre-trained Transformer have achieved remarkable performance on knowledge graph question-answering (KGQA) tasks. However, LLMs often produce ungrounded subgraph planning or reasoning results…

Computation and Language · Computer Science 2025-03-10 Mufan Xu , Kehai Chen , Xuefeng Bai , Muyun Yang , Tiejun Zhao , Min Zhang

Large Language Models (LLMs) have demonstrated strong performance across a wide range of tasks, yet they still struggle with complex mathematical reasoning, a challenge fundamentally rooted in deep structural dependencies. To address this…

Artificial Intelligence · Computer Science 2025-12-01 Lei Zan , Keli Zhang , Ruichu Cai , Lujia Pan

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge. In…

Computation and Language · Computer Science 2024-11-01 Neeladri Bhuiya , Viktor Schlegel , Stefan Winkler

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

Computation and Language · Computer Science 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Large language models (LLMs) have shown promise as parametric knowledge bases, but often underperform on question answering (QA) tasks due to hallucinations and uncertainty. While prior work attributes these failures to knowledge gaps in…

Computation and Language · Computer Science 2026-01-29 Xingjian Tao , Yiwei Wang , Yujun Cai , Zhicheng Yang , Jing Tang

During the pretraining phase, large language models (LLMs) acquire vast amounts of knowledge from extensive text corpora. Nevertheless, in later stages such as fine-tuning and inference, the model may encounter knowledge not covered in the…

Computation and Language · Computer Science 2024-10-10 Bozhou Li , Hao Liang , Yang Li , Fangcheng Fu , Hongzhi Yin , Conghui He , Wentao Zhang

This survey provides an in-depth analysis of knowledge conflicts for large language models (LLMs), highlighting the complex challenges they encounter when blending contextual and parametric knowledge. Our focus is on three categories of…

Computation and Language · Computer Science 2024-06-25 Rongwu Xu , Zehan Qi , Zhijiang Guo , Cunxiang Wang , Hongru Wang , Yue Zhang , Wei Xu

Large language models (LLMs) demonstrate remarkable capabilities but face challenges from hallucinations, which typically arise from insufficient knowledge or context. While instructing LLMs to acknowledge knowledge limitations by…

Computation and Language · Computer Science 2025-08-08 Jiaqi Li , Yixuan Tang , Yi Yang

The fusion of language models (LMs) and knowledge graphs (KGs) is widely used in commonsense question answering, but generating faithful explanations remains challenging. Current methods often overlook path decoding faithfulness, leading to…

Computation and Language · Computer Science 2024-09-23 Weihe Zhai , Arkaitz Zubiaga

We propose Knowledge Boundary Discovery (KBD), a reinforcement learning based framework to explore the knowledge boundaries of the Large Language Models (LLMs). We define the knowledge boundary by automatically generating two types of…

Artificial Intelligence · Computer Science 2026-03-24 Ziquan Wang , Zhongqi Lu