English
Related papers

Related papers: Continually Improving Extractive QA via Human Feed…

200 papers

Large language models (LLMs) have emerged as versatile tools in various daily applications. However, they are fraught with issues that undermine their utility and trustworthiness. These include the incorporation of erroneous references…

Computation and Language · Computer Science 2023-09-13 Dongyub Lee , Taesun Whang , Chanhee Lee , Heuiseok Lim

We present assertion based question answering (ABQA), an open domain question answering task that takes a question and a passage as inputs, and outputs a semi-structured assertion consisting of a subject, a predicate and a list of…

Computation and Language · Computer Science 2018-01-24 Zhao Yan , Duyu Tang , Nan Duan , Shujie Liu , Wendi Wang , Daxin Jiang , Ming Zhou , Zhoujun Li

\Ac{LFQA} aims to generate lengthy answers to complex questions. This scenario presents great flexibility as well as significant challenges for evaluation. Most evaluations rely on deterministic metrics that depend on string or n-gram…

Information Retrieval · Computer Science 2025-04-28 Ning Xian , Yixing Fan , Ruqing Zhang , Maarten de Rijke , Jiafeng Guo

This study empirically examines the "Evaluative AI" framework, which aims to enhance the decision-making process for AI users by transitioning from a recommendation-based approach to a hypothesis-driven one. Rather than offering direct…

Human-Computer Interaction · Computer Science 2024-11-14 Jaroslaw Kornowicz

Question answering (QA) is a high-level ability of natural language processing. Most extractive ma-chine reading comprehension models focus on factoid questions (e.g., who, when, where) and restrict the output answer as a short and…

Computation and Language · Computer Science 2021-10-25 Peng Cui , Dongyao Hu , Le Hu

Question answering (Q/A) can be formulated as a generative task (Mitra, 2017) where the task is to generate an answer given the question and the passage (knowledge, if available). Recent advances in QA task is focused a lot on language…

Computation and Language · Computer Science 2023-06-05 Jyothir S , Zuhaib Akhtar

Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through…

Computation and Language · Computer Science 2021-06-01 Arnab Debnath , Navid Rajabi , Fardina Fathmiul Alam , Antonios Anastasopoulos

In the era of Big Knowledge Graphs, Question Answering (QA) systems have reached a milestone in their performance and feasibility. However, their applicability, particularly in specific domains such as the biomedical domain, has not gained…

Computation and Language · Computer Science 2020-10-19 Saeedeh Shekarpour , Abhishek Nadgeri , Kuldeep Singh

Human-centered artificial intelligence (AI) posits that machine learning and AI should be developed and applied in a socially aware way. In this article, we argue that qualitative analysis (QA) can be a valuable tool in this process,…

Human-Computer Interaction · Computer Science 2021-12-08 Orestis Papakyriakopoulos , Elizabeth Anne Watkins , Amy Winecoff , Klaudia Jaźwińska , Tithi Chattopadhyay

We analyze the language learned by an agent trained with reinforcement learning as a component of the ActiveQA system [Buck et al., 2017]. In ActiveQA, question answering is framed as a reinforcement learning task in which an agent sits…

Computation and Language · Computer Science 2018-01-24 Christian Buck , Jannis Bulian , Massimiliano Ciaramita , Wojciech Gajewski , Andrea Gesmundo , Neil Houlsby , Wei Wang

Semantic Question Answering (SQA) systems automatically interpret user questions expressed in a natural language in terms of semantic queries. This process involves uncertainty, such that the resulting queries do not always accurately match…

Information Retrieval · Computer Science 2020-06-26 Hamid Zafar , Mohnish Dubey , Jens Lehmann , Elena Demidova

Insufficient modeling of human preferences within the reward model is a major obstacle for leveraging human feedback to improve translation quality. Fortunately, quality estimation (QE), which predicts the quality of a given translation…

Computation and Language · Computer Science 2024-03-19 Zhiwei He , Xing Wang , Wenxiang Jiao , Zhuosheng Zhang , Rui Wang , Shuming Shi , Zhaopeng Tu

Preference learning from human feedback has the ability to align generative models with the needs of end-users. Human feedback is costly and time-consuming to obtain, which creates demand for data-efficient query selection methods. This…

Machine Learning · Computer Science 2026-02-18 Guy Schacht , Ziyad Sheebaelhamd , Riccardo De Santi , Mojmír Mutný , Andreas Krause

Extractive question answering (ExQA) is an essential task for Natural Language Processing. The dominant approach to ExQA is one that represents the input sequence tokens (question and passage) with a pre-trained transformer, then uses two…

Computation and Language · Computer Science 2022-10-28 Urchade Zaratiana , Niama El Khbir , Dennis Núñez , Pierre Holat , Nadi Tomeh , Thierry Charnois

System-provided explanations for recommendations are an important component towards transparent and trustworthy AI. In state-of-the-art research, this is a one-way signal, though, to improve user acceptance. In this paper, we turn the role…

Information Retrieval · Computer Science 2021-05-04 Azin Ghazimatin , Soumajit Pramanik , Rishiraj Saha Roy , Gerhard Weikum

Community question answering (CQA) represents the type of Web applications where people can exchange knowledge via asking and answering questions. One significant challenge of most real-world CQA systems is the lack of effective matching…

Social and Information Networks · Computer Science 2018-07-18 Xianzhi Wang , Chaoran Huang , Lina Yao , Boualem Benatallah , Manqing Dong

Question Answering (QA) systems require a large amount of annotated data which is costly and time-consuming to gather. Converting datasets of existing QA benchmarks are challenging due to different formats and complexities. To address these…

Computation and Language · Computer Science 2022-10-14 Saptarashmi Bandyopadhyay , Shraman Pal , Hao Zou , Abhranil Chandra , Jordan Boyd-Graber

Question Answering has come a long way from answer sentence selection, relational QA to reading and comprehension. We shift our attention to generative question answering (gQA) by which we facilitate machine to read passages and answer…

Computation and Language · Computer Science 2018-07-10 Rajarshee Mitra

Highlighting while reading is a natural behavior for people to track salient content of a document. It would be desirable to teach an extractive summarizer to do the same. However, a major obstacle to the development of a supervised…

Computation and Language · Computer Science 2019-04-05 Kristjan Arumae , Fei Liu

Complex question answering (CQA) over raw text is a challenging task. A prominent approach to this task is based on the programmer-interpreter framework, where the programmer maps the question into a sequence of reasoning actions which is…

Computation and Language · Computer Science 2020-10-20 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari