English
Related papers

Related papers: GSQA: An End-to-End Model for Generative Spoken Qu…

200 papers

Long-form question answering (LFQA) poses a challenge as it involves generating detailed answers in the form of paragraphs, which go beyond simple yes/no responses or short factual answers. While existing QA models excel in questions with…

Computation and Language · Computer Science 2023-11-17 Pritom Saha Akash , Kashob Kumar Roy , Lucian Popa , Kevin Chen-Chuan Chang

Answer selection (answer ranking) is one of the key steps in many kinds of question answering (QA) applications, where deep models have achieved state-of-the-art performance. Among these deep models, recurrent neural network (RNN) based…

Computation and Language · Computer Science 2019-05-28 Dong Xu , Jianhui Ji , Haikuan Huang , Hongbo Deng , Wu-Jun Li

Question answering (QA) systems are designed to answer natural language questions. Visual QA (VQA) and Spoken QA (SQA) systems extend the textual QA system to accept visual and spoken input respectively. This work aims to create a system…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-30 Nimrod Shabtay , Zvi Kons , Avihu Dekel , Hagai Aronowitz , Ron Hoory , Assaf Arbelle

Recent work on Event Extraction has reframed the task as Question Answering (QA), with promising results. The advantage of this approach is that it addresses the error propagation issue found in traditional token-based classification…

Computation and Language · Computer Science 2023-07-13 Di Lu , Shihao Ran , Joel Tetreault , Alejandro Jaimes

Question answering (QA) is an important use case on voice assistants. A popular approach to QA is extractive reading comprehension (RC) which finds an answer span in a text passage. However, extractive answers are often unnatural in a…

Computation and Language · Computer Science 2021-03-12 Stan Peshterliev , Barlas Oguz , Debojeet Chatterjee , Hakan Inan , Vikas Bhardwaj

Recent studies show that sentence-level extractive QA, i.e., based on Answer Sentence Selection (AS2), is outperformed by Generation-based QA (GenQA) models, which generate answers using the top-k answer sentences ranked by AS2 models (a la…

Computation and Language · Computer Science 2023-05-25 Matteo Gabburo , Siddhant Garg , Rik Koncel-Kedziorski , Alessandro Moschitti

Question answering (QA) systems provide a way of querying the information available in various formats including, but not limited to, unstructured and structured data in natural languages. It constitutes a considerable part of…

Computation and Language · Computer Science 2021-06-04 Munazza Zaib , Wei Emma Zhang , Quan Z. Sheng , Adnan Mahmood , Yang Zhang

While there has been substantial progress in text comprehension through simple factoid question answering, more holistic comprehension of a discourse still presents a major challenge (Dunietz et al., 2020). Someone critically reflecting on…

Computation and Language · Computer Science 2022-10-18 Wei-Jen Ko , Cutter Dalton , Mark Simmons , Eliza Fisher , Greg Durrett , Junyi Jessy Li

Neural network models recently proposed for question answering (QA) primarily focus on capturing the passage-question relation. However, they have minimal capability to link relevant facts distributed across multiple sentences which is…

Computation and Language · Computer Science 2018-01-26 Souvik Kundu , Hwee Tou Ng

In the rapidly evolving landscape of spoken question-answering (SQA), the integration of large language models (LLMs) has emerged as a transformative development. Conventional approaches often entail the use of separate models for question…

Computation and Language · Computer Science 2024-06-11 Yanis Labrak , Adel Moumen , Richard Dufour , Mickael Rouvier

Despite the successes of pretrained language models, there are still few high-quality, general-purpose QA systems that are freely available. In response, we present Macaw, a versatile, generative question-answering (QA) system that we are…

Computation and Language · Computer Science 2021-09-07 Oyvind Tafjord , Peter Clark

Event argument extraction has long been studied as a sequential prediction problem with extractive-based methods, tackling each argument in isolation. Although recent work proposes generation-based methods to capture cross-argument…

Computation and Language · Computer Science 2022-11-15 Xinya Du , Heng Ji

Multi-modal tasks involving vision and language in deep learning continue to rise in popularity and are leading to the development of newer models that can generalize beyond the extent of their training data. The current models lack…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ethan Shen , Scotty Singh , Bhavesh Kumar

In this work, we extend the instruction-tuned Llama-2 model with end-to-end general-purpose speech processing and reasoning abilities while maintaining the wide range of original LLM capabilities, without using any carefully curated paired…

Computation and Language · Computer Science 2024-04-16 Yassir Fathullah , Chunyang Wu , Egor Lakomkin , Ke Li , Junteng Jia , Yuan Shangguan , Jay Mahadeokar , Ozlem Kalinli , Christian Fuegen , Mike Seltzer

Question answering (QA) is a high-level ability of natural language processing. Most extractive ma-chine reading comprehension models focus on factoid questions (e.g., who, when, where) and restrict the output answer as a short and…

Computation and Language · Computer Science 2021-10-25 Peng Cui , Dongyao Hu , Le Hu

Unsupervised commonsense question answering is appealing since it does not rely on any labeled task data. Among existing work, a popular solution is to use pre-trained language models to score candidate choices directly conditioned on the…

Computation and Language · Computer Science 2021-06-01 Yilin Niu , Fei Huang , Jiaming Liang , Wenkai Chen , Xiaoyan Zhu , Minlie Huang

Knowledge-based Visual Question Answering (VQA) expects models to rely on external knowledge for robust answer prediction. Though significant it is, this paper discovers several leading factors impeding the advancement of current…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Yangyang Guo , Liqiang Nie , Yongkang Wong , Yibing Liu , Zhiyong Cheng , Mohan Kankanhalli

End-to-end speech-to-speech (S2S) dialogue systems have recently garnered increasing research attention for their lower latency and more natural integration of nonverbal cues such as emotion and speaker identity. However, these systems face…

Computation and Language · Computer Science 2025-11-12 Pengchao Feng , Ziyang Ma , Wenxi Chen , Yao Li , Sheng Wang , Kai Yu , Xie Chen

Grammatical feedback is crucial for L2 learners, teachers, and testers. Spoken grammatical error correction (GEC) aims to supply feedback to L2 learners on their use of grammar when speaking. This process usually relies on a cascaded…

Computation and Language · Computer Science 2024-07-22 Stefano Bannò , Rao Ma , Mengjie Qian , Kate M. Knill , Mark J. F. Gales

In spoken conversational question answering (SCQA), the answer to the corresponding question is generated by retrieving and then analyzing a fixed spoken document, including multi-part conversations. Most SCQA systems have considered only…

Computation and Language · Computer Science 2021-06-25 Nuo Chen , Chenyu You , Yuexian Zou