English
Related papers

Related papers: End-to-end Spoken Conversational Question Answerin…

200 papers

We propose a novel method for applying Transformer models to extractive question answering (QA) tasks. Recently, pretrained generative sequence-to-sequence (seq2seq) models have achieved great success in question answering. Contributing to…

Computation and Language · Computer Science 2021-10-14 Peng Xu , Davis Liang , Zhiheng Huang , Bing Xiang

Questions asked by humans during a conversation often contain contextual dependencies, i.e., explicit or implicit references to previous dialogue turns. These dependencies take the form of coreferences (e.g., via pronoun use) or ellipses,…

Computation and Language · Computer Science 2022-07-08 Quentin Brabant , Gwenole Lecorve , Lina M. Rojas-Barahona

Community question answering (CQA) gains increasing popularity in both academy and industry recently. However, the redundancy and lengthiness issues of crowdsourced answers limit the performance of answer selection and lead to reading…

Computation and Language · Computer Science 2019-11-25 Yang Deng , Wai Lam , Yuexiang Xie , Daoyuan Chen , Yaliang Li , Min Yang , Ying Shen

In this paper, we propose a novel end-to-end trainable Video Question Answering (VideoQA) framework with three major components: 1) a new heterogeneous memory which can effectively learn global context information from appearance and motion…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Chenyou Fan , Xiaofan Zhang , Shu Zhang , Wensheng Wang , Chi Zhang , Heng Huang

Speech translation has traditionally been approached through cascaded models consisting of a speech recognizer trained on a corpus of transcribed speech, and a machine translation system trained on parallel texts. Several recent works have…

Computation and Language · Computer Science 2019-04-16 Matthias Sperber , Graham Neubig , Jan Niehues , Alex Waibel

The task of Question Answering has gained prominence in the past few decades for testing the ability of machines to understand natural language. Large datasets for Machine Reading have led to the development of neural models that cater to…

Computation and Language · Computer Science 2018-06-20 Soumya Wadhwa , Khyathi Raghavi Chandu , Eric Nyberg

Speech encompasses a wealth of information, including but not limited to content, paralinguistic, and environmental information. This comprehensive nature of speech significantly impacts communication and is crucial for human-computer…

Computation and Language · Computer Science 2025-01-17 Junyi Ao , Yuancheng Wang , Xiaohai Tian , Dekun Chen , Jun Zhang , Lu Lu , Yuxuan Wang , Haizhou Li , Zhizheng Wu

Dialogue state tracking is an essential part of goal-oriented dialogue systems, while most of these state tracking models often fail to handle unseen services. In this paper, we propose SGD-QA, a simple and extensible model for…

Computation and Language · Computer Science 2021-05-18 Yang Zhang , Vahid Noroozi , Evelina Bakhturina , Boris Ginsburg

Question Answering (QA) is the task of automatically answering questions posed by humans in natural languages. There are different settings to answer a question, such as abstractive, extractive, boolean, and multiple-choice QA. As a popular…

Computation and Language · Computer Science 2023-04-07 Zhichao Duan , Xiuxing Li , Zhengyan Zhang , Zhenyu Li , Ning Liu , Jianyong Wang

Though great progress has been made for human-machine conversation, current dialogue system is still in its infancy: it usually converses passively and utters words more as a matter of response, rather than on its own initiatives. In this…

Computation and Language · Computer Science 2019-11-11 Wenquan Wu , Zhen Guo , Xiangyang Zhou , Hua Wu , Xiyuan Zhang , Rongzhong Lian , Haifeng Wang

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Question Answering (QA) is one of the most important natural language processing (NLP) tasks. It aims using NLP technologies to generate a corresponding answer to a given question based on the massive unstructured corpus. With the…

Computation and Language · Computer Science 2022-07-01 Zhen Wang

We present the Stanford Question Answering Dataset (SQuAD), a new reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text…

Computation and Language · Computer Science 2016-10-12 Pranav Rajpurkar , Jian Zhang , Konstantin Lopyrev , Percy Liang

We introduce the task of acoustic question answering (AQA) in the area of acoustic reasoning. In this task an agent learns to answer questions on the basis of acoustic context. In order to promote research in this area, we propose a data…

Computation and Language · Computer Science 2018-11-27 Jerome Abdelnour , Giampiero Salvi , Jean Rouat

In this paper, we present an update to the NISQA speech quality prediction model that is focused on distortions that occur in communication networks. In contrast to the previous version, the model is trained end-to-end and the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-15 Gabriel Mittag , Babak Naderi , Assmaa Chehadi , Sebastian Möller

Audio question answering (AQA) requires models to understand acoustic content and perform complex reasoning. Current models struggle with dataset imbalances and unstable training dynamics. This work combines curriculum learning with…

Sound · Computer Science 2025-07-10 Gijs Wijngaard , Elia Formisano , Michele Esposito , Michel Dumontier

Knowledge-based dialogue systems with internet retrieval have recently attracted considerable attention from researchers. The dialogue systems overcome a major limitation of traditional knowledge dialogue systems, where the timeliness of…

Information Retrieval · Computer Science 2024-01-17 Zhongtian Hu , Yangqi Chen , Meng Zhao , Ronghan Li , Lifang Wang

Question Answering (QA) and Visual Question Answering (VQA) are well-studied problems in the language and vision domain. One challenging scenario involves multiple sources of information, each of a different modality, where the answer to…

Computation and Language · Computer Science 2025-03-11 Vinay Kumar Verma , Shreyas Sunil Kulkarni , Happy Mittal , Deepak Gupta

In face-to-face conversations, individuals need to switch between speaking and listening roles seamlessly. Existing 3D talking head generation models focus solely on speaking or listening, neglecting the natural dynamics of interactive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Ziqiao Peng , Yanbo Fan , Haoyu Wu , Xuan Wang , Hongyan Liu , Jun He , Zhaoxin Fan

We propose CodeQA, a free-form question answering dataset for the purpose of source code comprehension: given a code snippet and a question, a textual answer is required to be generated. CodeQA contains a Java dataset with 119,778…

Computation and Language · Computer Science 2021-09-20 Chenxiao Liu , Xiaojun Wan