English
Related papers

Related papers: Language-based Audio Retrieval Task in DCASE 2022 …

200 papers

We present RECAP (REtrieval-Augmented Audio CAPtioning), a novel and effective audio captioning system that generates captions conditioned on an input audio and other captions similar to the audio retrieved from a datastore. Additionally,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Sreyan Ghosh , Sonal Kumar , Chandra Kiran Reddy Evuru , Ramani Duraiswami , Dinesh Manocha

Matching raw audio signals with textual descriptions requires understanding the audio's content and the description's semantics and then drawing connections between the two modalities. This paper investigates a hybrid retrieval system that…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-03 Paul Primus , Gerhard Widmer

This paper presents the Low-Complexity Acoustic Scene Classification with Device Information Task of the DCASE 2025 Challenge, along with its baseline system. Continuing the focus on low-complexity models, data efficiency, and device…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-08 Florian Schmid , Paul Primus , Toni Heittola , Annamaria Mesaros , Irene Martín-Morató , Gerhard Widmer

Automated audio captioning is a cross-modal translation task that aims to generate natural language descriptions for given audio clips. This task has received increasing attention with the release of freely available datasets in recent…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Xinhao Mei , Xubo Liu , Mark D. Plumbley , Wenwu Wang

Audio captioning is a multi-modal task, focusing on using natural language for describing the contents of general audio. Most audio captioning methods are based on deep neural networks, employing an encoder-decoder scheme and a dataset with…

Sound · Computer Science 2020-07-10 Emre Çakır , Konstantinos Drossos , Tuomas Virtanen

This article describes the Data-Efficient Low-Complexity Acoustic Scene Classification Task in the DCASE 2024 Challenge and the corresponding baseline system. The task setup is a continuation of previous editions (2022 and 2023), which…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-19 Florian Schmid , Paul Primus , Toni Heittola , Annamaria Mesaros , Irene Martín-Morató , Khaled Koutini , Gerhard Widmer

We consider the task of retrieving audio using free-form natural language queries. To study this problem, which has received limited attention in the existing literature, we introduce challenging new benchmarks for text-based audio…

Information Retrieval · Computer Science 2021-07-23 Andreea-Maria Oncescu , A. Sophia Koepke , João F. Henriques , Zeynep Akata , Samuel Albanie

We present the task description and discussion on the results of the DCASE 2021 Challenge Task 2. In 2020, we organized an unsupervised anomalous sound detection (ASD) task, identifying whether a given sound was normal or anomalous without…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-28 Yohei Kawaguchi , Keisuke Imoto , Yuma Koizumi , Noboru Harada , Daisuke Niizumi , Kota Dohi , Ryo Tanabe , Harsh Purohit , Takashi Endo

This paper presents an analysis of the Low-Complexity Acoustic Scene Classification task in DCASE 2022 Challenge. The task was a continuation from the previous years, but the low-complexity requirements were changed to the following: the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-14 Irene Martín-Morató , Francesco Paissan , Alberto Ancilotto , Toni Heittola , Annamaria Mesaros , Elisabetta Farella , Alessio Brutti , Tuomas Virtanen

Audio-text retrieval based on natural language descriptions is a challenging task. It involves learning cross-modality alignments between long sequences under inadequate data conditions. In this work, we investigate several audio features…

Sound · Computer Science 2022-03-30 Siyu Lou , Xuenan Xu , Mengyue Wu , Kai Yu

This paper presents the details of Task 1: Acoustic Scene Classification in the DCASE 2020 Challenge. The task consists of two subtasks: classification of data from multiple devices, requiring good generalization properties, and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-03 Toni Heittola , Annamaria Mesaros , Tuomas Virtanen

Automated Audio captioning (AAC) is a cross-modal translation task that aims to use natural language to describe the content of an audio clip. As shown in the submissions received for Task 6 of the DCASE 2021 Challenges, this problem has…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-23 Xubo Liu , Qiushi Huang , Xinhao Mei , Tom Ko , H Lilian Tang , Mark D. Plumbley , Wenwu Wang

Recent progress in self-supervised or unsupervised machine learning has opened the possibility of building a full speech processing system from raw audio without using any textual representations or expert labels such as phonemes,…

Computation and Language · Computer Science 2022-10-31 Ewan Dunbar , Nicolas Hamilakis , Emmanuel Dupoux

In recent years, user-generated audio content has proliferated across various media platforms, creating a growing need for efficient retrieval methods that allow users to search for audio clips using natural language queries. This task,…

Sound · Computer Science 2024-12-31 Haoran Sun , Zimu Wang , Qiuyi Chen , Jianjun Chen , Jia Wang , Haiyang Zhang

The L3DAS22 Challenge is aimed at encouraging the development of machine learning strategies for 3D speech enhancement and 3D sound localization and detection in office-like environments. This challenge improves and extends the tasks of the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-16 Eric Guizzo , Christian Marinoni , Marco Pennese , Xinlei Ren , Xiguang Zheng , Chen Zhang , Bruno Masiero , Aurelio Uncini , Danilo Comminiello

This paper proposes a method for unsupervised anomalous sound detection (UASD) and captioning the reason for detection. While there is a method that captions the difference between given normal and anomalous sound pairs, it is assumed to be…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-30 Ryoya Ogura , Tomoya Nishida , Yohei Kawaguchi

This technical report describes the details of our TASK1A submission of the DCASE2021 challenge. The goal of the task is to design an audio scene classification system for device-imbalanced datasets under the constraints of model…

Sound · Computer Science 2022-10-26 Byeonggeun Kim , Seunghan Yang , Jangho Kim , Simyung Chang

This paper presents DCASE 2018 task 4. The task evaluates systems for the large-scale detection of sound events using weakly labeled data (without time boundaries). The target of the systems is to provide not only the event class but also…

Sound · Computer Science 2018-07-30 Romain Serizel , Nicolas Turpault , Hamid Eghbal-Zadeh , Ankit Parag Shah

This paper proposes a benchmark of submissions to Detection and Classification Acoustic Scene and Events 2021 Challenge (DCASE) Task 4 representing a sampling of the state-of-the-art in Sound Event Detection task. The submissions are…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Francesca Ronchini , Romain Serizel

The aim of the Detection and Classification of Acoustic Scenes and Events Challenge Task 4 is to evaluate systems for the detection of sound events in domestic environments using an heterogeneous dataset. The systems need to be able to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-02 Francesca Ronchini , Samuele Cornell , Romain Serizel , Nicolas Turpault , Eduardo Fonseca , Daniel P. W. Ellis