中文
相关论文

相关论文: Shortcomings of Question Answering Based Factualit…

200 篇论文

Question Answering (QA) systems require a large amount of annotated data which is costly and time-consuming to gather. Converting datasets of existing QA benchmarks are challenging due to different formats and complexities. To address these…

计算与语言 · 计算机科学 2022-10-14 Saptarashmi Bandyopadhyay , Shraman Pal , Hao Zou , Abhranil Chandra , Jordan Boyd-Graber

Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we…

In this work, we propose a method for incorporating question-answering (QA) signals into a summarization model. Our method identifies salient noun phrases (NPs) in the input document by automatically generating wh-questions that are…

计算与语言 · 计算机科学 2023-02-28 Daniel Deutsch , Dan Roth

Despite the recent advances in abstractive text summarization, current summarization models still suffer from generating factually inconsistent summaries, reducing their utility for real-world application. We argue that the main reason for…

Traditional fact-checking relies on humans to formulate relevant and targeted fact-checking questions (FCQs), search for evidence, and verify the factuality of claims. While Large Language Models (LLMs) have been commonly used to automate…

计算与语言 · 计算机科学 2025-02-24 Alimohammad Beigi , Bohan Jiang , Dawei Li , Zhen Tan , Pouya Shaeri , Tharindu Kumarage , Amrita Bhattacharjee , Huan Liu

Despite the recent progress in language generation models, their outputs may not always meet user expectations. In this work, we study whether informational feedback in natural language can be leveraged to improve generation quality and…

计算与语言 · 计算机科学 2023-10-17 Yixin Liu , Budhaditya Deb , Milagro Teruel , Aaron Halfaker , Dragomir Radev , Ahmed H. Awadallah

Despite their impressive performance on diverse tasks, large language models (LMs) still struggle with tasks requiring rich world knowledge, implying the limitations of relying solely on their parameters to encode a wealth of world…

计算与语言 · 计算机科学 2023-07-04 Alex Mallen , Akari Asai , Victor Zhong , Rajarshi Das , Daniel Khashabi , Hannaneh Hajishirzi

Multi-hop Question Answering (QA) requires the machine to answer complex questions by finding scattering clues and reasoning from multiple documents. Graph Network (GN) and Question Decomposition (QD) are two common approaches at present.…

计算与语言 · 计算机科学 2022-03-18 Jiawei Li , Mucheng Ren , Yang Gao , Yizhe Yang

To build robust question answering systems, we need the ability to verify whether answers to questions are truly correct, not just "good enough" in the context of imperfect QA datasets. We explore the use of natural language inference (NLI)…

计算与语言 · 计算机科学 2021-09-14 Jifan Chen , Eunsol Choi , Greg Durrett

Motivated by suggested question generation in conversational news recommendation systems, we propose a model for generating question-answer pairs (QA pairs) with self-contained, summary-centric questions and length-constrained,…

计算与语言 · 计算机科学 2021-09-13 Li Zhou , Kevin Small , Yong Zhang , Sandeep Atluri

Large-scale datasets are widely used to perform summarization tasks, but they may not include queries alongside documents and summaries. In the search for suitable datasets for Query-Focused Summarization (QFS), we identify two research…

计算与语言 · 计算机科学 2026-05-08 Yllias Chali , Deen Abdullah

Aspect-based summarization aims to generate summaries that highlight specific aspects of a text, enabling more personalized and targeted summaries. However, its application to books remains unexplored due to the difficulty of constructing…

计算与语言 · 计算机科学 2025-11-11 Ryuhei Miyazato , Ting-Ruen Wei , Xuyang Wu , Hsin-Tai Wu , Kei Harada

To use generative question-and-answering (QA) systems for decision-making and in any critical application, these systems need to provide well-calibrated confidence scores that reflect the correctness of their answers. Existing calibration…

计算与语言 · 计算机科学 2025-03-04 Putra Manggala , Atalanti Mastakouri , Elke Kirschbaum , Shiva Prasad Kasiviswanathan , Aaditya Ramdas

As an important part of Artificial Intelligence (AI), Question Answering (QA) aims at generating answers to questions phrased in natural language. While there has been substantial progress in open-domain question answering, QA systems are…

计算与语言 · 计算机科学 2021-05-21 Gengchen Mai , Krzysztof Janowicz , Rui Zhu , Ling Cai , Ni Lao

Question answer generation using Natural Language Processing models is ubiquitous in the world around us. It is used in many use cases such as the building of chat bots, suggestive prompts in google search and also as a way of navigating…

计算与语言 · 计算机科学 2023-11-28 Shashidhar Reddy Javaji , Haoran Hu , Sai Sameer Vennam , Vijaya Gajanan Buddhavarapu

Accurate text summarization is one of the most common and important tasks performed by Large Language Models, where the costs of human review for an entire document may be high, but the costs of errors in summarization may be even greater.…

计算与语言 · 计算机科学 2024-06-21 Alex Chandler , Devesh Surve , Hui Su

The goal of question answering (QA) is to answer any question. However, major QA datasets have skewed distributions over gender, profession, and nationality. Despite that skew, model accuracy analysis reveals little evidence that accuracy…

计算与语言 · 计算机科学 2021-09-14 Maharshi Gor , Kellie Webster , Jordan Boyd-Graber

Visual Grounding (VG) methods in Visual Question Answering (VQA) attempt to improve VQA performance by strengthening a model's reliance on question-relevant visual information. The presence of such relevant information in the visual input…

计算机视觉与模式识别 · 计算机科学 2024-02-16 Daniel Reich , Tanja Schultz

Reliably determining the performance of Retrieval-Augmented Generation (RAG) systems depends on comprehensive test questions. While a proliferation of evaluation frameworks for LLM-powered applications exists, current practices lack a…

机器学习 · 计算机科学 2025-10-02 Noah Broestl , Adel Nasser Abdalla , Rajprakash Bale , Hersh Gupta , Max Struever

LLMs (Large Language Models) usually interact with users in the form of dialogue and generate responses following their instructions, which naturally require dialogue comprehension abilities. However, dialogue comprehension is a general…

计算与语言 · 计算机科学 2024-04-02 Shuaijie She , Shujian Huang , Xingyun Wang , Yanke Zhou , Jiajun Chen