中文
相关论文

相关论文: Attention-Based Methods For Audio Question Answeri…

200 篇论文

The Audio Question Answering (AQA) task includes audio event classification, audio captioning, and open-ended reasoning. Recently, AQA has garnered attention due to the advent of Large Audio Language Models (LALMs). Current literature…

声音 · 计算机科学 2024-12-16 Arvind Krishna Sridhar , Yinyi Guo , Erik Visser

Conversational question answering (CQA) is a novel QA task that requires understanding of dialogue context. Different from traditional single-turn machine reading comprehension (MRC) tasks, CQA includes passage comprehension, coreference…

计算与语言 · 计算机科学 2019-01-04 Chenguang Zhu , Michael Zeng , Xuedong Huang

In this paper, we focus on the Audio-Visual Question Answering (AVQA) task, which aims to answer questions regarding different visual objects, sounds, and their associations in videos. The problem requires comprehensive multimodal…

计算机视觉与模式识别 · 计算机科学 2022-04-06 Guangyao Li , Yake Wei , Yapeng Tian , Chenliang Xu , Ji-Rong Wen , Di Hu

Multimodal question answering tasks can be used as proxy tasks to study systems that can perceive and reason about the world. Answering questions about different types of input modalities stresses different aspects of reasoning such as…

计算与语言 · 计算机科学 2019-11-22 Haytham M. Fayek , Justin Johnson

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Param Ahir , Hiteishi M. Diwanji

We introduce the new task of Acoustic Question Answering (AQA) to promote research in acoustic reasoning. The AQA task consists of analyzing an acoustic scene composed by a combination of elementary sounds and answering questions that…

机器学习 · 计算机科学 2019-03-01 Jerome Abdelnour , Giampiero Salvi , Jean Rouat

Neural network models recently proposed for question answering (QA) primarily focus on capturing the passage-question relation. However, they have minimal capability to link relevant facts distributed across multiple sentences which is…

计算与语言 · 计算机科学 2018-01-26 Souvik Kundu , Hwee Tou Ng

In this report, we describe our submission to Track 5 of the DCASE 2025 Challenge for the task of Audio Question Answering(AQA). Our system leverages the SSL backbone BEATs to extract frame-level audio features, which are then processed by…

Question Answering (QA) in clinical notes has gained a lot of attention in the past few years. Existing machine reading comprehension approaches in clinical domain can only handle questions about a single block of clinical texts and fail to…

计算与语言 · 计算机科学 2022-07-25 Ping Wang , Tian Shi , Khushbu Agarwal , Sutanay Choudhury , Chandan K. Reddy

Visual Question Answering (VQA) models employ attention mechanisms to discover image locations that are most relevant for answering a specific question. For this purpose, several multimodal fusion strategies have been proposed, ranging from…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Moshiur R Farazi , Salman H Khan , Nick Barnes

Voice controlled virtual assistants (VAs) are now available in smartphones, cars, and standalone devices in homes. In most cases, the user needs to first "wake-up" the VA by saying a particular word/phrase every time he or she wants the VA…

人机交互 · 计算机科学 2019-02-05 Atta Norouzian , Bogdan Mazoure , Dermot Connolly , Daniel Willett

We propose a novel attention based deep learning architecture for visual question answering task (VQA). Given an image and an image related natural language question, VQA generates the natural language answer for the question. Generating…

计算机视觉与模式识别 · 计算机科学 2016-04-05 Kan Chen , Jiang Wang , Liang-Chieh Chen , Haoyuan Gao , Wei Xu , Ram Nevatia

In the community question answering (CQA) system, the answer selection task aims to identify the best answer for a specific question, and thus is playing a key role in enhancing the service quality through recommending appropriate answers…

人工智能 · 计算机科学 2019-12-18 Fengshi Jing , Qingpeng Zhang

Answer selection is an important research problem, with applications in many areas. Previous deep learning based approaches for the task mainly adopt the Compare-Aggregate architecture that performs word-level comparison followed by…

计算与语言 · 计算机科学 2019-09-27 Tuan Lai , Quan Hung Tran , Trung Bui , Daisuke Kihara

Question answering (QA) systems provide a way of querying the information available in various formats including, but not limited to, unstructured and structured data in natural languages. It constitutes a considerable part of…

计算与语言 · 计算机科学 2021-06-04 Munazza Zaib , Wei Emma Zhang , Quan Z. Sheng , Adnan Mahmood , Yang Zhang

Spoken conversational question answering (SCQA) requires machines to model complex dialogue flow given the speech utterances and text corpora. Different from traditional text question answering (QA) tasks, SCQA involves audio signal…

计算与语言 · 计算机科学 2021-06-25 Chenyu You , Nuo Chen , Yuexian Zou

In this paper, we introduce Audiopedia, a novel task called Audio Question Answering with Knowledge, which requires both audio comprehension and external knowledge reasoning. Unlike traditional Audio Question Answering (AQA) benchmarks that…

机器学习 · 计算机科学 2024-12-31 Abhirama Subramanyam Penamakuri , Kiran Chhatre , Akshat Jain

This paper focuses on the Audio-Visual Question Answering (AVQA) task that aims to answer questions derived from untrimmed audible videos. To generate accurate answers, an AVQA model is expected to find the most informative audio-visual…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Zhangbin Li , Dan Guo , Jinxing Zhou , Jing Zhang , Meng Wang

Audio question answering (AQA), acting as a widely used proxy task to explore scene understanding, has got more attention. The AQA is challenging for it requires comprehensive temporal reasoning from different scales' events of an audio…

声音 · 计算机科学 2023-05-30 Guangyao Li , Yixin Xu , Di Hu

Visual Question Answering (VQA) is an increasingly popular topic in deep learning research, requiring coordination of natural language processing and computer vision modules into a single architecture. We build upon the model which placed…

计算与语言 · 计算机科学 2018-03-22 Jasdeep Singh , Vincent Ying , Alex Nutkiewicz