中文
相关论文

相关论文: Language-based Audio Retrieval Task in DCASE 2022 …

200 篇论文

We present RECAP (REtrieval-Augmented Audio CAPtioning), a novel and effective audio captioning system that generates captions conditioned on an input audio and other captions similar to the audio retrieved from a datastore. Additionally,…

音频与语音处理 · 电气工程与系统科学 2024-06-07 Sreyan Ghosh , Sonal Kumar , Chandra Kiran Reddy Evuru , Ramani Duraiswami , Dinesh Manocha

Matching raw audio signals with textual descriptions requires understanding the audio's content and the description's semantics and then drawing connections between the two modalities. This paper investigates a hybrid retrieval system that…

音频与语音处理 · 电气工程与系统科学 2024-07-03 Paul Primus , Gerhard Widmer

This paper presents the Low-Complexity Acoustic Scene Classification with Device Information Task of the DCASE 2025 Challenge, along with its baseline system. Continuing the focus on low-complexity models, data efficiency, and device…

音频与语音处理 · 电气工程与系统科学 2026-05-08 Florian Schmid , Paul Primus , Toni Heittola , Annamaria Mesaros , Irene Martín-Morató , Gerhard Widmer

Automated audio captioning is a cross-modal translation task that aims to generate natural language descriptions for given audio clips. This task has received increasing attention with the release of freely available datasets in recent…

音频与语音处理 · 电气工程与系统科学 2022-09-28 Xinhao Mei , Xubo Liu , Mark D. Plumbley , Wenwu Wang

Audio captioning is a multi-modal task, focusing on using natural language for describing the contents of general audio. Most audio captioning methods are based on deep neural networks, employing an encoder-decoder scheme and a dataset with…

声音 · 计算机科学 2020-07-10 Emre Çakır , Konstantinos Drossos , Tuomas Virtanen

This article describes the Data-Efficient Low-Complexity Acoustic Scene Classification Task in the DCASE 2024 Challenge and the corresponding baseline system. The task setup is a continuation of previous editions (2022 and 2023), which…

音频与语音处理 · 电气工程与系统科学 2024-07-19 Florian Schmid , Paul Primus , Toni Heittola , Annamaria Mesaros , Irene Martín-Morató , Khaled Koutini , Gerhard Widmer

We consider the task of retrieving audio using free-form natural language queries. To study this problem, which has received limited attention in the existing literature, we introduce challenging new benchmarks for text-based audio…

信息检索 · 计算机科学 2021-07-23 Andreea-Maria Oncescu , A. Sophia Koepke , João F. Henriques , Zeynep Akata , Samuel Albanie

We present the task description and discussion on the results of the DCASE 2021 Challenge Task 2. In 2020, we organized an unsupervised anomalous sound detection (ASD) task, identifying whether a given sound was normal or anomalous without…

音频与语音处理 · 电气工程与系统科学 2021-09-28 Yohei Kawaguchi , Keisuke Imoto , Yuma Koizumi , Noboru Harada , Daisuke Niizumi , Kota Dohi , Ryo Tanabe , Harsh Purohit , Takashi Endo

This paper presents an analysis of the Low-Complexity Acoustic Scene Classification task in DCASE 2022 Challenge. The task was a continuation from the previous years, but the low-complexity requirements were changed to the following: the…

Audio-text retrieval based on natural language descriptions is a challenging task. It involves learning cross-modality alignments between long sequences under inadequate data conditions. In this work, we investigate several audio features…

声音 · 计算机科学 2022-03-30 Siyu Lou , Xuenan Xu , Mengyue Wu , Kai Yu

This paper presents the details of Task 1: Acoustic Scene Classification in the DCASE 2020 Challenge. The task consists of two subtasks: classification of data from multiple devices, requiring good generalization properties, and…

音频与语音处理 · 电气工程与系统科学 2020-11-03 Toni Heittola , Annamaria Mesaros , Tuomas Virtanen

Automated Audio captioning (AAC) is a cross-modal translation task that aims to use natural language to describe the content of an audio clip. As shown in the submissions received for Task 6 of the DCASE 2021 Challenges, this problem has…

音频与语音处理 · 电气工程与系统科学 2021-11-23 Xubo Liu , Qiushi Huang , Xinhao Mei , Tom Ko , H Lilian Tang , Mark D. Plumbley , Wenwu Wang

Recent progress in self-supervised or unsupervised machine learning has opened the possibility of building a full speech processing system from raw audio without using any textual representations or expert labels such as phonemes,…

计算与语言 · 计算机科学 2022-10-31 Ewan Dunbar , Nicolas Hamilakis , Emmanuel Dupoux

In recent years, user-generated audio content has proliferated across various media platforms, creating a growing need for efficient retrieval methods that allow users to search for audio clips using natural language queries. This task,…

声音 · 计算机科学 2024-12-31 Haoran Sun , Zimu Wang , Qiuyi Chen , Jianjun Chen , Jia Wang , Haiyang Zhang

The L3DAS22 Challenge is aimed at encouraging the development of machine learning strategies for 3D speech enhancement and 3D sound localization and detection in office-like environments. This challenge improves and extends the tasks of the…

音频与语音处理 · 电气工程与系统科学 2022-12-16 Eric Guizzo , Christian Marinoni , Marco Pennese , Xinlei Ren , Xiguang Zheng , Chen Zhang , Bruno Masiero , Aurelio Uncini , Danilo Comminiello

This paper proposes a method for unsupervised anomalous sound detection (UASD) and captioning the reason for detection. While there is a method that captions the difference between given normal and anomalous sound pairs, it is assumed to be…

音频与语音处理 · 电气工程与系统科学 2024-10-30 Ryoya Ogura , Tomoya Nishida , Yohei Kawaguchi

This technical report describes the details of our TASK1A submission of the DCASE2021 challenge. The goal of the task is to design an audio scene classification system for device-imbalanced datasets under the constraints of model…

声音 · 计算机科学 2022-10-26 Byeonggeun Kim , Seunghan Yang , Jangho Kim , Simyung Chang

This paper presents DCASE 2018 task 4. The task evaluates systems for the large-scale detection of sound events using weakly labeled data (without time boundaries). The target of the systems is to provide not only the event class but also…

声音 · 计算机科学 2018-07-30 Romain Serizel , Nicolas Turpault , Hamid Eghbal-Zadeh , Ankit Parag Shah

This paper proposes a benchmark of submissions to Detection and Classification Acoustic Scene and Events 2021 Challenge (DCASE) Task 4 representing a sampling of the state-of-the-art in Sound Event Detection task. The submissions are…

音频与语音处理 · 电气工程与系统科学 2024-01-02 Francesca Ronchini , Romain Serizel

The aim of the Detection and Classification of Acoustic Scenes and Events Challenge Task 4 is to evaluate systems for the detection of sound events in domestic environments using an heterogeneous dataset. The systems need to be able to…

音频与语音处理 · 电气工程与系统科学 2024-01-02 Francesca Ronchini , Samuele Cornell , Romain Serizel , Nicolas Turpault , Eduardo Fonseca , Daniel P. W. Ellis