English
Related papers

Related papers: Audio-visual scene classification: analysis of DCA…

200 papers

In this report, the Brno University of Technology (BUT) team submissions for Task 1 (Acoustic Scene Classification, ASC) of the DCASE-2019 challenge are described. Also, the analysis of different methods is provided. The proposed approach…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-17 Hossein Zeinali , Lukáš Burget , Jan "Honza'' Černocký

Sound event localization and detection is a novel area of research that emerged from the combined interest of analyzing the acoustic scene in terms of the spatial and temporal activity of sounds of interest. This paper presents an overview…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-12 Archontis Politis , Annamaria Mesaros , Sharath Adavanne , Toni Heittola , Tuomas Virtanen

This paper presents a task of audio-visual scene classification (SC) where input videos are classified into one of five real-life crowded scenes: 'Riot', 'Noise-Street', 'Firework-Event', 'Music-Event', and 'Sport-Atmosphere'. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Lam Pham , Dat Ngo , Phu X. Nguyen , Truong Hoang , Alexander Schindler

We describe in this report our audio scene recognition system submitted to the DCASE 2016 challenge. Firstly, given the label set of the scenes, a label tree is automatically constructed. This category taxonomy is then used in the feature…

Neural and Evolutionary Computing · Computer Science 2016-08-16 Huy Phan , Lars Hertel , Marco Maass , Philipp Koch , Alfred Mertins

In this paper, we present a deep learning based multimodal system for classifying daily life videos. To train the system, we propose a two-phase training strategy. In the first training phase (Phase I), we extract the audio and visual…

Sound · Computer Science 2023-05-03 Lam Pham , Trang Le , Cam Le , Dat Ngo , Weissenfeld Axel , Alexander Schindler

In this report, we presents low-complexity deep learning frameworks for acoustic scene classification (ASC). The proposed frameworks can be separated into four main steps: Front-end spectrogram extraction, online data augmentation, back-end…

Sound · Computer Science 2022-06-14 Lam Pham , Dat Ngo , Anahid Jalali , Alexander Schindler

This article proposes an encoder-decoder network model for Acoustic Scene Classification (ASC), the task of identifying the scene of an audio recording from its acoustic signature. We make use of multiple low-level spectrogram features at…

Sound · Computer Science 2020-02-12 Lam Pham , Huy Phan , Truc Nguyen , Ramaswamy Palaniappan , Alfred Mertins , Ian McLoughlin

In this work, we compare the performance of three selected techniques in open set acoustic scenes classification (ASC). We test thresholding of the softmax output of a deep network classifier, which is the most popular technique nowadays…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Zuzanna Kwiatkowska , Beniamin Kalinowski , Michał Kośmider , Krzysztof Rykaczewski

Although deep learning methods have achieved advanced video object recognition performance in recent years, perceiving heavily occluded objects in a video is still a very challenging task. To promote the development of occlusion…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Jiyang Qi , Yan Gao , Yao Hu , Xinggang Wang , Xiaoyu Liu , Xiang Bai , Serge Belongie , Alan Yuille , Philip H. S. Torr , Song Bai

This technical report outlines our approach to Task 3A of the Detection and Classification of Acoustic Scenes and Events (DCASE) 2024, focusing on Sound Event Localization and Detection (SELD). SELD provides valuable insights by estimating…

Sound · Computer Science 2025-07-25 Quoc Thinh Vo , David Han

Deep neural networks (DNNs) have recently achieved great success in a multitude of classification tasks. Ensembles of DNNs have been shown to improve the performance. In this paper, we explore the recent state-of-the-art DNNs used for image…

Sound · Computer Science 2017-10-04 Venkatesh Duppada , Sushant Hiray

This report describes our systems submitted for the DCASE2024 Task 3 challenge: Audio and Audiovisual Sound Event Localization and Detection with Source Distance Estimation (Track B). Our main model is based on the audio-visual (AV)…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-30 Davide Berghi , Philip J. B. Jackson

We introduce in this work an efficient approach for audio scene classification using deep recurrent neural networks. An audio scene is firstly transformed into a sequence of high-level label tree embedding feature vectors. The vector…

Sound · Computer Science 2017-06-06 Huy Phan , Philipp Koch , Fabrice Katzberg , Marco Maass , Radoslaw Mazur , Alfred Mertins

Acoustic Scene Classification (ASC) identifies an environment based on an audio signal. This paper explores ASC in low-resource conditions and proposes a novel model, DS-FlexiNet, which combines depthwise separable convolutions from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-29 Zhi Chen , Yun-Fei Shao , Yong Ma , Mingsheng Wei , Le Zhang , Wei-Qiang Zhang

Acoustic scene classification is an intricate problem for a machine. As an emerging field of research, deep Convolutional Neural Networks (CNN) achieve convincing results. In this paper, we explore the use of multi-scale Dense connected…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Dawei Feng , Kele Xu , Haibo Mi , Feifan Liao , Yan Zhou

Acoustic scene recordings are often collected from a diverse range of cities. Most existing acoustic scene classification (ASC) approaches focus on identifying common acoustic scene patterns across cities to enhance generalization. However,…

Sound · Computer Science 2025-06-16 Yiqiang Cai , Yizhou Tan , Shengchen Li , Xi Shao , Mark D. Plumbley

Language-based audio retrieval is a task, where natural language textual captions are used as queries to retrieve audio signals from a dataset. It has been first introduced into DCASE 2022 Challenge as Subtask 6B of task 6, which aims at…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-05 Huang Xie , Samuel Lipping , Tuomas Virtanen

Language-based audio retrieval is a task, where natural language textual captions are used as queries to retrieve audio signals from a dataset. It has been first introduced into DCASE 2022 Challenge as Subtask 6B of task 6, which aims at…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-06 Huang Xie , Samuel Lipping , Tuomas Virtanen

The use of multiple and semantically correlated sources can provide complementary information to each other that may not be evident when working with individual modalities on their own. In this context, multi-modal models can help producing…

In this technical report, a low-complexity deep learning system for acoustic scene classification (ASC) is presented. The proposed system comprises two main phases: (Phase I) Training a teacher network; and (Phase II) training a student…

Sound · Computer Science 2023-05-17 Lam Pham , Dat Ngo , Cam Le , Anahid Jalali , Alexander Schindler