English
Related papers

Related papers: Complementary Evidence Identification in Open-Doma…

200 papers

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren

Evidence plays a crucial role in automated fact-checking. When verifying real-world claims, existing fact-checking systems either assume the evidence sentences are given or use the search snippets returned by the search engine. Such methods…

Computation and Language · Computer Science 2024-01-30 Xuming Hu , Junzhe Chen , Zhijiang Guo , Philip S. Yu

This paper proposes a question-answering system that can answer questions whose supporting evidence is spread over multiple (potentially long) documents. The system, called Visconde, uses a three-step pipeline to perform the task:…

Computation and Language · Computer Science 2022-12-20 Jayr Pereira , Robson Fidalgo , Roberto Lotufo , Rodrigo Nogueira

Argument mining involves multiple sub-tasks that automatically identify argumentative elements, such as claim detection, evidence extraction, stance classification, etc. However, each subtask alone is insufficient for a thorough…

Computation and Language · Computer Science 2023-06-01 Jia Guo , Liying Cheng , Wenxuan Zhang , Stanley Kok , Xin Li , Lidong Bing

Fact-based Visual Question Answering (FVQA) requires external knowledge beyond visible content to answer questions about an image, which is challenging but indispensable to achieve general VQA. One limitation of existing FVQA solutions is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Zihao Zhu , Jing Yu , Yujing Wang , Yajing Sun , Yue Hu , Qi Wu

Building automatic technical support system is an important yet challenge task. Conceptually, to answer a user question on a technical forum, a human expert has to first retrieve relevant documents, and then read them carefully to identify…

Computation and Language · Computer Science 2021-05-19 Wenhao Yu , Lingfei Wu , Yu Deng , Qingkai Zeng , Ruchi Mahindru , Sinem Guven , Meng Jiang

Recent studies on Question Answering (QA) and Conversational QA (ConvQA) emphasize the role of retrieval: a system first retrieves evidence from a large collection and then extracts answers. This open-retrieval ConvQA setting typically…

Information Retrieval · Computer Science 2021-03-04 Chen Qu , Liu Yang , Cen Chen , W. Bruce Croft , Kalpesh Krishna , Mohit Iyyer

Open-domain question answering (Open-QA) is a common task for evaluating large language models (LLMs). However, current Open-QA evaluations are criticized for the ambiguity in questions and the lack of semantic understanding in evaluators.…

Computation and Language · Computer Science 2024-05-28 Peiran Yao , Denilson Barbosa

Recent state-of-the-art open-domain QA models are typically based on a two stage retriever-reader approach in which the retriever first finds the relevant knowledge/passages and the reader then leverages that to predict the answer. Prior…

Computation and Language · Computer Science 2022-11-24 Neeraj Varshney , Man Luo , Chitta Baral

Multi-text applications, such as multi-document summarization, are typically required to model redundancies across related texts. Current methods confronting consolidation struggle to fuse overlapping information. In order to explicitly…

Computation and Language · Computer Science 2021-09-28 Daniela Brook Weiss , Paul Roit , Ayal Klein , Ori Ernst , Ido Dagan

Modern day applications, especially information retrieval webapps that involve "search" as their use cases are gradually moving towards "answering" modules. Conversational chatbots which have been proved to be more engaging to users, use…

Information Retrieval · Computer Science 2022-10-20 Mohammed Hammad

Retrieval based open-domain QA systems use retrieved documents and answer-span selection over retrieved documents to find best-answer candidates. We hypothesize that multilingual Question Answering (QA) systems are prone to information…

Computation and Language · Computer Science 2022-05-26 Shramay Palta , Haozhe An , Yifan Yang , Shuaiyi Huang , Maharshi Gor

Knowledge-based visual question answering (VQA) requires answering questions with external knowledge in addition to the content of images. One dataset that is mostly used in evaluating knowledge-based VQA is OK-VQA, but it lacks a gold…

Computation and Language · Computer Science 2021-09-10 Man Luo , Yankai Zeng , Pratyay Banerjee , Chitta Baral

Legal documents have complex document layouts involving multiple nested sections, lengthy footnotes and further use specialized linguistic devices like intricate syntax and domain-specific vocabulary to ensure precision and authority. These…

Computation and Language · Computer Science 2026-02-10 Anagha Kulkarni , Parin Rajesh Jhaveri , Prasha Shrestha , Yu Tong Han , Reza Amini , Behrouz Madahian

In this work, we focus on the problem of retrieving relevant arguments for a query claim covering diverse aspects. State-of-the-art methods rely on explicit mappings between claims and premises, and thus are unable to utilize large…

Information Retrieval · Computer Science 2021-03-18 Michael Fromm , Max Berrendorf , Sandra Obermeier , Thomas Seidl , Evgeniy Faerman

Closed-book question answering (QA) requires a model to directly answer an open-domain question without access to any external knowledge. Prior work on closed-book QA either directly finetunes or prompts a pretrained language model (LM) to…

Computation and Language · Computer Science 2023-04-28 Dan Su , Mostofa Patwary , Shrimai Prabhumoye , Peng Xu , Ryan Prenger , Mohammad Shoeybi , Pascale Fung , Anima Anandkumar , Bryan Catanzaro

Direct answering of questions that involve multiple entities and relations is a challenge for text-based QA. This problem is most pronounced when answers can be found only by joining evidence from multiple documents. Curated knowledge…

Information Retrieval · Computer Science 2020-12-01 Xiaolu Lu , Soumajit Pramanik , Rishiraj Saha Roy , Abdalghani Abujabal , Yafang Wang , Gerhard Weikum

Open-domain question answering aims at solving the task of locating the answers to user-generated questions in massive collections of documents. There are two families of solutions available: retriever-readers, and knowledge-graph-based…

Computation and Language · Computer Science 2020-10-26 Jinfeng Xiao , Lidan Wang , Franck Dernoncourt , Trung Bui , Tong Sun , Jiawei Han

Quantities are essential in documents to describe factual information. They are ubiquitous in application domains such as finance, business, medicine, and science in general. Compared to other information extraction approaches,…

Computation and Language · Computer Science 2023-05-16 Satya Almasian , Vivian Kazakova , Philip Göldner , Michael Gertz

Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing. Here, we explore the use of unstructured external knowledge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Shir Gur , Natalia Neverova , Chris Stauffer , Ser-Nam Lim , Douwe Kiela , Austin Reiter