English
Related papers

Related papers: Knowledge Corpus Error in Question Answering

200 papers

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

Computation and Language · Computer Science 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

The integration of retrieved passages and large language models (LLMs), such as ChatGPTs, has significantly contributed to improving open-domain question answering. However, there is still a lack of exploration regarding the optimal…

Information Retrieval · Computer Science 2024-04-09 Ye Liu , Semih Yavuz , Rui Meng , Meghana Moorthy , Shafiq Joty , Caiming Xiong , Yingbo Zhou

While Large Language Models (LLMs) are widely used in open-domain Question Answering (QA), their ability to handle inferential questions-where answers must be derived rather than directly retrieved-remains still underexplored. This study…

Computation and Language · Computer Science 2026-05-13 Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

Applying existing question answering (QA) systems to specialized domains like law and finance presents challenges that necessitate domain expertise. Although large language models (LLMs) have shown impressive language comprehension and…

Computation and Language · Computer Science 2023-10-24 Vaibhav Mavi , Abulhair Saparov , Chen Zhao

Large language models (LLMs) have shown promise as parametric knowledge bases, but often underperform on question answering (QA) tasks due to hallucinations and uncertainty. While prior work attributes these failures to knowledge gaps in…

Computation and Language · Computer Science 2026-01-29 Xingjian Tao , Yiwei Wang , Yujun Cai , Zhicheng Yang , Jing Tang

Open domain question answering systems frequently rely on information retrieved from large collections of text (such as the Web) to answer questions. However, such collections of text often contain conflicting information, and…

Computation and Language · Computer Science 2025-04-29 Siyi Liu , Qiang Ning , Kishaloy Halder , Wei Xiao , Zheng Qi , Phu Mon Htut , Yi Zhang , Neha Anna John , Bonan Min , Yassine Benajiba , Dan Roth

Large Language Models (LLMs) excel at language understanding but remain limited in knowledge-intensive domains due to hallucinations, outdated information, and limited explainability. Text-based retrieval-augmented generation (RAG) helps…

Computation and Language · Computer Science 2026-02-09 Larissa Pusch , Alexandre Courtiol , Tim Conrad

Open-domain Question Answering (QA) has garnered substantial interest by combining the advantages of faithfully retrieved passages and relevant passages generated through Large Language Models (LLMs). However, there is a lack of definitive…

Computation and Language · Computer Science 2024-12-30 Xinkai Du , Quanjie Han , Chao Lv , Yan Liu , Yalin Sun , Hao Shu , Hongbo Shan , Maosong Sun

This work presents a framework for assessing whether large language models (LLMs) encode more factual knowledge in their parameters than what they express in their outputs. While a few studies hint at this possibility, none has clearly…

Computation and Language · Computer Science 2025-08-07 Zorik Gekhman , Eyal Ben David , Hadas Orgad , Eran Ofek , Yonatan Belinkov , Idan Szpektor , Jonathan Herzig , Roi Reichart

Retrieval-Augmented Generation (RAG) has emerged as a prominent method for incorporating domain knowledge into Large Language Models (LLMs). While RAG enhances response relevance by incorporating retrieved domain knowledge in the context,…

Computation and Language · Computer Science 2025-03-28 Kushagra Bhushan , Yatin Nandwani , Dinesh Khandelwal , Sonam Gupta , Gaurav Pandey , Dinesh Raghu , Sachindra Joshi

Lexical matching remains the de facto evaluation method for open-domain question answering (QA). Unfortunately, lexical matching fails completely when a plausible candidate answer does not appear in the list of gold answers, which is…

Computation and Language · Computer Science 2023-07-10 Ehsan Kamalloo , Nouha Dziri , Charles L. A. Clarke , Davood Rafiei

Retrieval-augmented generation (RAG) has received much attention for Open-domain question-answering (ODQA) tasks as a means to compensate for the parametric knowledge of large language models (LLMs). While previous approaches focused on…

Computation and Language · Computer Science 2024-09-30 Minsang Kim , Cheoneum Park , Seungjun Baek

Scholarly communication is a rapid growing field containing a wealth of knowledge. However, due to its unstructured and document format, it is challenging to extract useful information from them through conventional document retrieval…

Information Retrieval · Computer Science 2024-09-16 Kanchan Shivashankar , Nadine Steinmetz

Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA…

Computation and Language · Computer Science 2025-09-23 Chuangtao Ma , Yongrui Chen , Tianxing Wu , Arijit Khan , Haofen Wang

Large language models (LLMs) have emerged as versatile tools in various daily applications. However, they are fraught with issues that undermine their utility and trustworthiness. These include the incorporation of erroneous references…

Computation and Language · Computer Science 2023-09-13 Dongyub Lee , Taesun Whang , Chanhee Lee , Heuiseok Lim

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred to as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to…

Computation and Language · Computer Science 2023-11-09 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Question answering models can use rich knowledge sources -- up to one hundred retrieved passages and parametric knowledge in the large-scale language model (LM). Prior work assumes information in such knowledge sources is consistent with…

Computation and Language · Computer Science 2022-10-26 Hung-Ting Chen , Michael J. Q. Zhang , Eunsol Choi

While auxiliary information has become a key to enhancing Large Language Models (LLMs), relatively little is known about how LLMs merge these contexts, specifically contexts generated by LLMs and those retrieved from external sources. To…

Computation and Language · Computer Science 2024-06-13 Hexiang Tan , Fei Sun , Wanli Yang , Yuanzhuo Wang , Qi Cao , Xueqi Cheng

Large language models (LLMs) have shown remarkable achievements in natural language processing tasks, producing high-quality outputs. However, LLMs still exhibit limitations, including the generation of factually incorrect information. In…

Computation and Language · Computer Science 2023-11-17 Sridevi Wagle , Sai Munikoti , Anurag Acharya , Sara Smith , Sameera Horawalavithana

Large Language Models (LLMs) are versatile, yet they often falter in tasks requiring deep and reliable reasoning due to issues like hallucinations, limiting their applicability in critical scenarios. This paper introduces a rigorously…

Computation and Language · Computer Science 2023-11-21 Saizhuo Wang , Zhihan Liu , Zhaoran Wang , Jian Guo