中文
相关论文

相关论文: ISQA: Informative Factuality Feedback for Scientif…

200 篇论文

Text summarization systems have made significant progress in recent years, but typically generate summaries in one single step. However, the one-shot summarization setting is sometimes inadequate, as the generated summary may contain…

计算与语言 · 计算机科学 2023-10-10 Haopeng Zhang , Xiao Liu , Jiawei Zhang

Modern summarization models generate highly fluent but often factually unreliable outputs. This motivated a surge of metrics attempting to measure the factuality of automatically generated summaries. Due to the lack of common benchmarks,…

计算与语言 · 计算机科学 2021-07-27 Artidoro Pagnoni , Vidhisha Balachandran , Yulia Tsvetkov

Long document summarization remains a significant challenge for current large language models (LLMs), as existing approaches commonly struggle with information loss, factual inconsistencies, and coherence issues when processing excessively…

计算与语言 · 计算机科学 2026-02-06 Weixuan Wang , Minghao Wu , Barry Haddow , Alexandra Birch

Evidence retrieval is a critical stage of question answering (QA), necessary not only to improve performance, but also to explain the decisions of the corresponding QA method. We introduce a simple, fast, and unsupervised iterative evidence…

计算与语言 · 计算机科学 2020-05-05 Vikas Yadav , Steven Bethard , Mihai Surdeanu

Review-based Product Question Answering (PQA) allows e-commerce platforms to automatically address customer queries by leveraging insights from user reviews. However, existing PQA systems generate answers with only a single perspective,…

计算与语言 · 计算机科学 2025-06-05 An Quang Tang , Xiuzhen Zhang , Minh Ngoc Dinh , Zhuang Li

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

计算与语言 · 计算机科学 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

The rapid growth of open-access (OA) publications has intensified the challenge of identifying relevant scientific papers. Due to privacy constraints and limited access to user interaction data, recent efforts have shifted toward…

信息检索 · 计算机科学 2025-11-06 Shenghua Wang , Zhen Yin

We frame Question Answering (QA) as a Reinforcement Learning task, an approach that we call Active Question Answering. We propose an agent that sits between the user and a black box QA system and learns to reformulate questions to elicit…

Large language models (LLMs) have made significant advancements in various natural language processing tasks, including question answering (QA) tasks. While incorporating new information with the retrieval of relevant passages is a…

计算与语言 · 计算机科学 2024-04-23 Jaehyung Kim , Jaehyun Nam , Sangwoo Mo , Jongjin Park , Sang-Woo Lee , Minjoon Seo , Jung-Woo Ha , Jinwoo Shin

Improvements in large language models have led to increasing optimism that they can serve as reliable evaluators of natural language generation outputs. In this paper, we challenge this optimism by thoroughly re-evaluating five…

计算与语言 · 计算机科学 2025-01-31 Ameya Godbole , Robin Jia

Despite recent improvements in abstractive summarization, most current approaches generate summaries that are not factually consistent with the source document, severely restricting their trust and usage in real-world applications. Recent…

计算与语言 · 计算机科学 2022-07-20 Leonardo F. R. Ribeiro , Mengwen Liu , Iryna Gurevych , Markus Dreyer , Mohit Bansal

Recently, various neural encoder-decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text. At a high level, such neural models…

计算与语言 · 计算机科学 2023-04-11 Yichong Huang , Xiachong Feng , Xiaocheng Feng , Bing Qin

The interaction of conversational systems with users poses an exciting opportunity for improving them after deployment, but little evidence has been provided of its feasibility. In most applications, users are not able to provide the…

计算与语言 · 计算机科学 2020-11-03 Jon Ander Campos , Kyunghyun Cho , Arantxa Otegi , Aitor Soroa , Gorka Azkune , Eneko Agirre

Despite significant progress in Visual Question Answering over the years, robustness of today's VQA models leave much to be desired. We introduce a new evaluation protocol and associated dataset (VQA-Rephrasings) and show that…

计算机视觉与模式识别 · 计算机科学 2019-02-18 Meet Shah , Xinlei Chen , Marcus Rohrbach , Devi Parikh

Large Language Models (LLMs) drive scientific question-answering on modern search engines, yet their evaluation robustness remains underexplored. We introduce YESciEval, an open-source framework that combines fine-grained rubric-based…

计算与语言 · 计算机科学 2025-05-30 Jennifer D'Souza , Hamed Babaei Giglou , Quentin Münch

Replying to formal emails is time-consuming and cognitively demanding, as it requires crafting polite phrasing and providing an adequate response to the sender's demands. Although systems with Large Language Models (LLMs) were designed to…

人机交互 · 计算机科学 2025-02-10 Yusuke Miura , Chi-Lan Yang , Masaki Kuribayashi , Keigo Matsumoto , Hideaki Kuzuoka , Shigeo Morishima

Video-based Question Answering (Video QA) is a challenging task and becomes even more intricate when addressing Socially Intelligent Question Answering (SIQA). SIQA requires context understanding, temporal reasoning, and the integration of…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Aviral Agrawal , Carlos Mateo Samudio Lezcano , Iqui Balam Heredia-Marin , Prabhdeep Singh Sethi

Causality is vital for understanding true cause-and-effect relationships between variables within predictive models, rather than relying on mere correlations, making it highly relevant in the field of Explainable AI. In an automated…

机器学习 · 计算机科学 2024-08-28 Arturo Fredes , Jordi Vitria

The growth of online consumer health questions has led to the necessity for reliable and accurate question answering systems. A recent study showed that manual summarization of consumer health questions brings significant improvement in…

计算与语言 · 计算机科学 2021-07-02 Shweta Yadav , Deepak Gupta , Asma Ben Abacha , Dina Demner-Fushman

Scientific writing is a challenging task, particularly for novice researchers who often rely on feedback from experienced peers. Recent work has primarily focused on improving surface form and style rather than manuscript content. In this…

计算与语言 · 计算机科学 2024-06-05 Eric Chamoun , Michael Schlichktrull , Andreas Vlachos