English
Related papers

Related papers: Localizing and Mitigating Errors in Long-form Ques…

200 papers

Uncertainty quantification has emerged as an effective approach to closed-book hallucination detection for LLMs, but existing methods are largely designed for short-form outputs and do not generalize well to long-form generation. We…

Computation and Language · Computer Science 2026-02-20 Dylan Bouchard , Mohit Singh Chauhan , Viren Bajaj , David Skarbrevik

Multiple choice question answering (MCQA) is popular for LLM evaluation due to its simplicity and human-like testing, but we argue for its reform. We first reveal flaws in MCQA's format, as it struggles to: 1) test generation/subjectivity;…

Computation and Language · Computer Science 2025-06-03 Nishant Balepur , Rachel Rudinger , Jordan Lee Boyd-Graber

We present FoQA, a Faroese extractive question-answering (QA) dataset with 2,000 samples, created using a semi-automated approach combining Large Language Models (LLMs) and human validation. The dataset was generated from Faroese Wikipedia…

Computation and Language · Computer Science 2025-02-12 Annika Simonsen , Dan Saattrup Nielsen , Hafsteinn Einarsson

Question answering systems are typically evaluated on factual correctness, yet many real-world applications-such as education and career guidance-require mentorship: responses that provide reflection and guidance. Existing QA benchmarks…

Computation and Language · Computer Science 2026-01-27 Parth Bhalerao , Diola Dsouza , Ruiwen Guan , Oana Ignat

One critical challenge in the institutional adoption journey of Large Language Models (LLMs) stems from their propensity to hallucinate in generated responses. To address this, we propose MultiQ&A, a systematic approach for evaluating the…

Computation and Language · Computer Science 2025-02-07 Nicole Cho , William Watson

Can Large Language Models (LLMs) be trained to avoid hallucinating factual statements, and can Retrieval-Augmented Generation (RAG) be triggered only when necessary to reduce retrieval and computation costs? In this work, we address both…

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

Computation and Language · Computer Science 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

Large Language Models (LLMs) perform well on standard reasoning and question-answering benchmarks, yet such evaluations often fail to capture their ability to handle long-tail, expertise-intensive knowledge in real-world professional…

Large Language Models (LLMs) have succeeded remarkably in understanding long-form contents. However, exploring their capability for generating long-form contents, such as reports and articles, has been relatively unexplored and inadequately…

Computation and Language · Computer Science 2024-06-05 Haochen Tan , Zhijiang Guo , Zhan Shi , Lu Xu , Zhili Liu , Yunlong Feng , Xiaoguang Li , Yasheng Wang , Lifeng Shang , Qun Liu , Linqi Song

An abundance of datasets and availability of reliable evaluation metrics have resulted in strong progress in factoid question answering (QA). This progress, however, does not easily transfer to the task of long-form QA, where the goal is to…

Computation and Language · Computer Science 2023-01-24 Ivan Stelmakh , Yi Luan , Bhuwan Dhingra , Ming-Wei Chang

People often ask questions with false assumptions, a type of question that does not have regular answers. Answering such questions requires first identifying the false assumptions. Large Language Models (LLMs) often generate misleading…

Computation and Language · Computer Science 2025-09-24 Zijie Wang , Eduardo Blanco

Large Language Models (LLMs) have demonstrated significant capabilities, particularly in the domain of question answering (QA). However, their effectiveness in QA is often undermined by the vagueness of user questions. To address this…

Computation and Language · Computer Science 2025-02-26 Junhao Chen , Bowen Wang , Zhouqiang Jiang , Yuta Nakashima

How retrieved documents are used in language models (LMs) for long-form generation task is understudied. We present two controlled studies on retrieval-augmented LM for long-form question answering (LFQA): one fixing the LM and varying…

Computation and Language · Computer Science 2025-10-07 Hung-Ting Chen , Fangyuan Xu , Shane Arora , Eunsol Choi

Currently, a growing number of health consumers are asking health-related questions online, at any time and from anywhere, which effectively lowers the cost of health care. The most common approach is using online health expert…

Information Retrieval · Computer Science 2016-12-22 Ze Hu , Zhan Zhang , Qing Chen , Haiqin Yang , Decheng Zuo

Large Language Models have demonstrated remarkable capabilities across diverse tasks, yet they frequently generate hallucinations outputs that are fluent but factually incorrect or unsupported. We propose Counterfactual Probing, a novel…

Computation and Language · Computer Science 2025-08-05 Yijun Feng

Large Language Models (LLMs) have shown significant progress in Open-domain question answering (ODQA), yet most evaluations focus on English and assume locale-invariant answers across languages. This assumption neglects the cultural and…

Computation and Language · Computer Science 2025-08-25 Keon-Woo Roh , Yeong-Joon Ju , Seong-Whan Lee

Accurate evaluation of financial question answering (QA) systems necessitates a comprehensive dataset encompassing diverse question types and contexts. However, current financial QA datasets lack scope diversity and question complexity.…

Computation and Language · Computer Science 2025-03-04 Jian Chen , Peilin Zhou , Yining Hua , Yingxin Loh , Kehui Chen , Ziyuan Li , Bing Zhu , Junwei Liang

Hallucination continues to be one of the most critical challenges in the institutional adoption journey of Large Language Models (LLMs). While prior studies have primarily focused on the post-generation analysis and refinement of outputs,…

Machine Learning · Computer Science 2024-12-17 William Watson , Nicole Cho , Nishan Srishankar

Hallucination has been a major problem for large language models and remains a critical challenge when it comes to multimodality in which vision-language models (VLMs) have to deal with not just textual but also visual inputs. Despite rapid…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhecan Wang , Garrett Bingham , Adams Yu , Quoc Le , Thang Luong , Golnaz Ghiasi

We study a new problem setting of question answering (QA), referred to as DocTabQA. Within this setting, given a long document, the goal is to respond to questions by organizing the answers into structured tables derived directly from the…

Computation and Language · Computer Science 2024-08-22 Haochen Wang , Kai Hu , Haoyu Dong , Liangcai Gao