English
Related papers

Related papers: A Multimodal Dense Retrieval Approach for Speech-B…

200 papers

Spoken Question Answering (SQA) is essential for machines to reply to user's question by finding the answer span within a given spoken passage. SQA has been previously achieved without ASR to avoid recognition errors and Out-of-Vocabulary…

Computation and Language · Computer Science 2024-08-27 Chyi-Jiunn Lin , Guan-Ting Lin , Yung-Sung Chuang , Wei-Lun Wu , Shang-Wen Li , Abdelrahman Mohamed , Hung-yi Lee , Lin-shan Lee

Interacting with a speech interface to query a Question Answering (QA) system is becoming increasingly popular. Typically, QA systems rely on passage retrieval to select candidate contexts and reading comprehension to extract the final…

Computation and Language · Computer Science 2022-09-28 Georgios Sidiropoulos , Svitlana Vakulenko , Evangelos Kanoulas

One common approach for question answering over speech data is to first transcribe speech using automatic speech recognition (ASR) and then employ text-based retrieval-augmented generation (RAG) on the transcriptions. While this cascaded…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-06 Do June Min , Karel Mundnich , Andy Lapastora , Erfan Soltanmohammadi , Srikanth Ronanki , Kyu Han

Open-domain question answering can be reformulated as a phrase retrieval problem, without the need for processing documents on-demand during inference (Seo et al., 2019). However, current phrase retrieval models heavily depend on sparse…

Computation and Language · Computer Science 2021-06-03 Jinhyuk Lee , Mujeen Sung , Jaewoo Kang , Danqi Chen

Open-domain question answering relies on efficient passage retrieval to select candidate contexts, where traditional sparse vector space models, such as TF-IDF or BM25, are the de facto method. In this work, we show that retrieval can be…

Computation and Language · Computer Science 2020-10-02 Vladimir Karpukhin , Barlas Oğuz , Sewon Min , Patrick Lewis , Ledell Wu , Sergey Edunov , Danqi Chen , Wen-tau Yih

Conventional keyword search systems operate on automatic speech recognition (ASR) outputs, which causes them to have a complex indexing and search pipeline. This has led to interest in ASR-free approaches to simplify the search procedure.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-17 Bolaji Yusuf , Jan Cernocky , Murat Saraclar

Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method called dense retrieval.…

Information Retrieval · Computer Science 2025-03-25 Ahmed H. Salamah , Pierre McWhannel , Nicole Yan

Dense neural text retrieval has achieved promising results on open-domain Question Answering (QA), where latent representations of questions and passages are exploited for maximum inner product search in the retrieval process. However,…

Information Retrieval · Computer Science 2021-11-01 Ye Liu , Kazuma Hashimoto , Yingbo Zhou , Semih Yavuz , Caiming Xiong , Philip S. Yu

Spoken Question Answering (SQA) is to find the answer from a spoken document given a question, which is crucial for personal assistants when replying to the queries from the users. Existing SQA methods all rely on Automatic Speech…

Information retrieval (IR) or knowledge retrieval, is a critical component for many down-stream tasks such as open-domain question answering (QA). It is also very challenging, as it requires succinctness, completeness, and correctness. In…

Computation and Language · Computer Science 2023-08-10 Xiaodong Yu , Ben Zhou , Dan Roth

In open-domain question answering, a model receives a text question as input and searches for the correct answer using a large evidence corpus. The retrieval step is especially difficult as typical evidence corpora have \textit{millions} of…

Computation and Language · Computer Science 2021-09-24 Christopher Sciavolino

We introduce ART, a new corpus-level autoencoding approach for training dense retrieval models that does not require any labeled training data. Dense retrieval is a central challenge for open-domain tasks, such as Open QA, where…

Computation and Language · Computer Science 2023-04-04 Devendra Singh Sachan , Mike Lewis , Dani Yogatama , Luke Zettlemoyer , Joelle Pineau , Manzil Zaheer

We integrate automatic speech recognition (ASR) and question answering (QA) to realize a speech-driven QA system, and evaluate its performance. We adapt an N-gram language model to natural language questions, so that the input of our system…

Computation and Language · Computer Science 2007-05-23 Tomoyosi Akiba , Atsushi Fujii , Katunobu Itou

Text-based machine comprehension (MC) systems have a wide-range of applications, and standard corpora exist for developing and evaluating approaches. There has been far less research on spoken question answering (SQA) systems. The SQA task…

Computation and Language · Computer Science 2021-07-13 Vatsal Raina , Mark J. F. Gales

Dense retrieval (DR) approaches based on powerful pre-trained language models (PLMs) achieved significant advances and have become a key component for modern open-domain question-answering systems. However, they require large amounts of…

Computation and Language · Computer Science 2022-08-08 Xiaoyu Shen , Svitlana Vakulenko , Marco del Tredici , Gianni Barlacchi , Bill Byrne , Adrià de Gispert

Modern Automatic Speech Recognition (ASR) systems can achieve high performance in terms of recognition accuracy. However, a perfectly accurate transcript still can be challenging to read due to disfluency, filter words, and other errata…

Computation and Language · Computer Science 2021-02-23 Junwei Liao , Yu Shi , Ming Gong , Linjun Shou , Sefik Eskimez , Liyang Lu , Hong Qu , Michael Zeng

In open-domain question answering, dense passage retrieval has become a new paradigm to retrieve relevant passages for finding answers. Typically, the dual-encoder architecture is adopted to learn dense representations of questions and…

Computation and Language · Computer Science 2021-05-13 Yingqi Qu , Yuchen Ding , Jing Liu , Kai Liu , Ruiyang Ren , Wayne Xin Zhao , Daxiang Dong , Hua Wu , Haifeng Wang

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

Computation and Language · Computer Science 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang

Conversational search provides a natural interface for information retrieval (IR). Recent approaches have demonstrated promising results in applying dense retrieval to conversational IR. However, training dense retrievers requires large…

Computation and Language · Computer Science 2023-09-14 Chao-Wei Huang , Chen-Yu Hsu , Tsu-Yuan Hsu , Chen-An Li , Yun-Nung Chen

Long-context multiple-choice question answering tasks require robust reasoning over extensive text sources. Since most of the pre-trained transformer models are restricted to processing only a few hundred words at a time, successful…

Information Retrieval · Computer Science 2025-01-28 Manish Singh , Manish Shrivastava
‹ Prev 1 2 3 10 Next ›