English
Related papers

Related papers: Hurdles to Progress in Long-form Question Answerin…

200 papers

Traditional fact-checking relies on humans to formulate relevant and targeted fact-checking questions (FCQs), search for evidence, and verify the factuality of claims. While Large Language Models (LLMs) have been commonly used to automate…

Computation and Language · Computer Science 2025-02-24 Alimohammad Beigi , Bohan Jiang , Dawei Li , Zhen Tan , Pouya Shaeri , Tharindu Kumarage , Amrita Bhattacharjee , Huan Liu

Question Answering (QA) research is a significant and challenging task in Natural Language Processing. QA aims to extract an exact answer from a relevant text snippet or a document. The motivation behind QA research is the need of user who…

Information Retrieval · Computer Science 2018-10-10 Lokesh Kumar Sharma , Namita Mittal

Textbook Question Answering (TQA) is a task that one should answer a diagram/non-diagram question given a large multi-modal context consisting of abundant essays and diagrams. We argue that the explainability of this task should place…

Computation and Language · Computer Science 2023-07-25 Jie Ma , Qi Chai , Jun Liu , Qingyu Yin , Pinghui Wang , Qinghua Zheng

Question answering systems are typically evaluated on factual correctness, yet many real-world applications-such as education and career guidance-require mentorship: responses that provide reflection and guidance. Existing QA benchmarks…

Computation and Language · Computer Science 2026-01-27 Parth Bhalerao , Diola Dsouza , Ruiwen Guan , Oana Ignat

Question answering over Scholarly Knowledge Graphs (SKGs) remains a challenging task due to the complexity of scholarly content and the intricate structure of these graphs. Large Language Model (LLM) approaches could be used to translate…

Artificial Intelligence · Computer Science 2025-08-15 Xueli Pan , Victor de Boer , Jacco van Ossenbruggen

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

Open-domain Question Answering (OpenQA) is an important task in Natural Language Processing (NLP), which aims to answer a question in the form of natural language based on large-scale unstructured documents. Recently, there has been a surge…

Artificial Intelligence · Computer Science 2021-05-11 Fengbin Zhu , Wenqiang Lei , Chao Wang , Jianming Zheng , Soujanya Poria , Tat-Seng Chua

Large Language Models (LLMs) often struggle with hallucinations and outdated information. To address this, Information Retrieval (IR) systems can be employed to augment LLMs with up-to-date knowledge. However, existing IR techniques contain…

Computation and Language · Computer Science 2024-11-26 Danupat Khamnuansin , Tawunrat Chalothorn , Ekapol Chuangsuwanich

Vision language models can now generate long-form answers to questions about images - long-form visual question answers (LFVQA). We contribute VizWiz-LF, a dataset of long-form answers to visual questions posed by blind and low vision (BLV)…

Computation and Language · Computer Science 2025-07-28 Mina Huh , Fangyuan Xu , Yi-Hao Peng , Chongyan Chen , Hansika Murugu , Danna Gurari , Eunsol Choi , Amy Pavel

Prior work in standardized science exams requires support from large text corpus, such as targeted science corpus fromWikipedia or SimpleWikipedia. However, retrieving knowledge from the large corpus is time-consuming and questions embedded…

Artificial Intelligence · Computer Science 2020-04-28 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Sensitivity to false assumptions (or false premises) in information-seeking questions is critical for robust question-answering (QA) systems. Recent work has shown that false assumptions in naturally occurring questions pose challenges to…

Computation and Language · Computer Science 2024-03-20 Ashwin Daswani , Rohan Sawant , Najoung Kim

Retrieval-Augmented Generation (RAG) is the prevailing paradigm for grounding Large Language Models (LLMs), yet the mechanisms governing how models integrate groups of conflicting retrieved evidence remain opaque. Does an LLM answer a…

Artificial Intelligence · Computer Science 2026-01-13 Atharv Naphade

Advanced table question answering (TableQA) methods prompt large language models (LLMs) to generate answer text, SQL query, Python code, or custom operation, which impressively improve the complex reasoning problems in the TableQA task.…

Computation and Language · Computer Science 2025-09-03 Zhongyuan Wang , Richong Zhang , Zhijie Nie , Hangyu Mao

Large Language Models (LLMs) have shown remarkable performances on a wide range of natural language understanding and generation tasks. We observe that the LLMs provide effective priors in exploiting $\textit{linguistic shortcuts}$ for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Dohwan Ko , Ji Soo Lee , Wooyoung Kang , Byungseok Roh , Hyunwoo J. Kim

Current QA systems can generate reasonable-sounding yet false answers without explanation or evidence for the generated answer, which is especially problematic when humans cannot readily check the model's answers. This presents a challenge…

Computation and Language · Computer Science 2022-04-14 Alicia Parrish , Harsh Trivedi , Ethan Perez , Angelica Chen , Nikita Nangia , Jason Phang , Samuel R. Bowman

Hallucination, a phenomenon where multimodal large language models~(MLLMs) tend to generate textual responses that are plausible but unaligned with the image, has become one major hurdle in various MLLM-related applications. Several…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Han Qiu , Jiaxing Huang , Peng Gao , Qin Qi , Xiaoqin Zhang , Ling Shao , Shijian Lu

Question answering (QA) is an important aspect of open-domain conversational agents, garnering specific research focus in the conversational QA (ConvQA) subtask. One notable limitation of recent ConvQA efforts is the response being answer…

Computation and Language · Computer Science 2020-12-18 Ashutosh Baheti , Alan Ritter , Kevin Small

Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to process long contexts, yet a notable gap remains in generating long, aligned outputs. This limitation stems from a training gap where…

Computation and Language · Computer Science 2024-11-01 Shanghaoran Quan , Tianyi Tang , Bowen Yu , An Yang , Dayiheng Liu , Bofei Gao , Jianhong Tu , Yichang Zhang , Jingren Zhou , Junyang Lin

Text-to-SQL parsing and end-to-end question answering (E2E TQA) are two main approaches for Table-based Question Answering task. Despite success on multiple benchmarks, they have yet to be compared and their synergy remains unexplored. In…

Computation and Language · Computer Science 2024-10-01 Siyue Zhang , Anh Tuan Luu , Chen Zhao

Large Language Models (LLMs) have excelled in multi-hop question-answering (M-QA) due to their advanced reasoning abilities. However, the impact of the inherent reasoning structures on LLM M-QA performance remains unclear, largely due to…