English
Related papers

Related papers: ISQA: Informative Factuality Feedback for Scientif…

200 papers

Text summarization systems have made significant progress in recent years, but typically generate summaries in one single step. However, the one-shot summarization setting is sometimes inadequate, as the generated summary may contain…

Computation and Language · Computer Science 2023-10-10 Haopeng Zhang , Xiao Liu , Jiawei Zhang

Modern summarization models generate highly fluent but often factually unreliable outputs. This motivated a surge of metrics attempting to measure the factuality of automatically generated summaries. Due to the lack of common benchmarks,…

Computation and Language · Computer Science 2021-07-27 Artidoro Pagnoni , Vidhisha Balachandran , Yulia Tsvetkov

Long document summarization remains a significant challenge for current large language models (LLMs), as existing approaches commonly struggle with information loss, factual inconsistencies, and coherence issues when processing excessively…

Computation and Language · Computer Science 2026-02-06 Weixuan Wang , Minghao Wu , Barry Haddow , Alexandra Birch

Evidence retrieval is a critical stage of question answering (QA), necessary not only to improve performance, but also to explain the decisions of the corresponding QA method. We introduce a simple, fast, and unsupervised iterative evidence…

Computation and Language · Computer Science 2020-05-05 Vikas Yadav , Steven Bethard , Mihai Surdeanu

Review-based Product Question Answering (PQA) allows e-commerce platforms to automatically address customer queries by leveraging insights from user reviews. However, existing PQA systems generate answers with only a single perspective,…

Computation and Language · Computer Science 2025-06-05 An Quang Tang , Xiuzhen Zhang , Minh Ngoc Dinh , Zhuang Li

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

Computation and Language · Computer Science 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

The rapid growth of open-access (OA) publications has intensified the challenge of identifying relevant scientific papers. Due to privacy constraints and limited access to user interaction data, recent efforts have shifted toward…

Information Retrieval · Computer Science 2025-11-06 Shenghua Wang , Zhen Yin

We frame Question Answering (QA) as a Reinforcement Learning task, an approach that we call Active Question Answering. We propose an agent that sits between the user and a black box QA system and learns to reformulate questions to elicit…

Computation and Language · Computer Science 2018-03-05 Christian Buck , Jannis Bulian , Massimiliano Ciaramita , Wojciech Gajewski , Andrea Gesmundo , Neil Houlsby , Wei Wang

Large language models (LLMs) have made significant advancements in various natural language processing tasks, including question answering (QA) tasks. While incorporating new information with the retrieval of relevant passages is a…

Computation and Language · Computer Science 2024-04-23 Jaehyung Kim , Jaehyun Nam , Sangwoo Mo , Jongjin Park , Sang-Woo Lee , Minjoon Seo , Jung-Woo Ha , Jinwoo Shin

Improvements in large language models have led to increasing optimism that they can serve as reliable evaluators of natural language generation outputs. In this paper, we challenge this optimism by thoroughly re-evaluating five…

Computation and Language · Computer Science 2025-01-31 Ameya Godbole , Robin Jia

Despite recent improvements in abstractive summarization, most current approaches generate summaries that are not factually consistent with the source document, severely restricting their trust and usage in real-world applications. Recent…

Computation and Language · Computer Science 2022-07-20 Leonardo F. R. Ribeiro , Mengwen Liu , Iryna Gurevych , Markus Dreyer , Mohit Bansal

Recently, various neural encoder-decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text. At a high level, such neural models…

Computation and Language · Computer Science 2023-04-11 Yichong Huang , Xiachong Feng , Xiaocheng Feng , Bing Qin

The interaction of conversational systems with users poses an exciting opportunity for improving them after deployment, but little evidence has been provided of its feasibility. In most applications, users are not able to provide the…

Computation and Language · Computer Science 2020-11-03 Jon Ander Campos , Kyunghyun Cho , Arantxa Otegi , Aitor Soroa , Gorka Azkune , Eneko Agirre

Despite significant progress in Visual Question Answering over the years, robustness of today's VQA models leave much to be desired. We introduce a new evaluation protocol and associated dataset (VQA-Rephrasings) and show that…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Meet Shah , Xinlei Chen , Marcus Rohrbach , Devi Parikh

Large Language Models (LLMs) drive scientific question-answering on modern search engines, yet their evaluation robustness remains underexplored. We introduce YESciEval, an open-source framework that combines fine-grained rubric-based…

Computation and Language · Computer Science 2025-05-30 Jennifer D'Souza , Hamed Babaei Giglou , Quentin Münch

Replying to formal emails is time-consuming and cognitively demanding, as it requires crafting polite phrasing and providing an adequate response to the sender's demands. Although systems with Large Language Models (LLMs) were designed to…

Human-Computer Interaction · Computer Science 2025-02-10 Yusuke Miura , Chi-Lan Yang , Masaki Kuribayashi , Keigo Matsumoto , Hideaki Kuzuoka , Shigeo Morishima

Video-based Question Answering (Video QA) is a challenging task and becomes even more intricate when addressing Socially Intelligent Question Answering (SIQA). SIQA requires context understanding, temporal reasoning, and the integration of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Aviral Agrawal , Carlos Mateo Samudio Lezcano , Iqui Balam Heredia-Marin , Prabhdeep Singh Sethi

Causality is vital for understanding true cause-and-effect relationships between variables within predictive models, rather than relying on mere correlations, making it highly relevant in the field of Explainable AI. In an automated…

Machine Learning · Computer Science 2024-08-28 Arturo Fredes , Jordi Vitria

The growth of online consumer health questions has led to the necessity for reliable and accurate question answering systems. A recent study showed that manual summarization of consumer health questions brings significant improvement in…

Computation and Language · Computer Science 2021-07-02 Shweta Yadav , Deepak Gupta , Asma Ben Abacha , Dina Demner-Fushman

Scientific writing is a challenging task, particularly for novice researchers who often rely on feedback from experienced peers. Recent work has primarily focused on improving surface form and style rather than manuscript content. In this…

Computation and Language · Computer Science 2024-06-05 Eric Chamoun , Michael Schlichktrull , Andreas Vlachos