English
Related papers

Related papers: Robust Acoustic Scene Classification using a Multi…

200 papers

In this paper we study the problem of acoustic scene classification, i.e., categorization of audio sequences into mutually exclusive classes based on their spectral content. We describe the methods and results discovered during a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-30 Shayan Gharib , Honain Derrar , Daisuke Niizumi , Tuukka Senttula , Janne Tommola , Toni Heittola , Tuomas Virtanen , Heikki Huttunen

Environmental sound detection is a challenging application of machine learning because of the noisy nature of the signal, and the small amount of (labeled) data that is typically available. This work thus presents a comparison of several…

Sound · Computer Science 2017-03-22 Juncheng Li , Wei Dai , Florian Metze , Shuhui Qu , Samarjit Das

This technical report proposes an audio captioning system for DCASE 2021 Task 6 audio captioning challenge. Our proposed model is based on an encoder-decoder architecture with bi-directional Gated Recurrent Units (BiGRU) using pretrained…

Sound · Computer Science 2021-10-08 Ayşegül Özkaya Eren , Mustafa Sert

Scene text detection based on deep neural networks have progressed substantially over the past years. However, previous state-of-the-art methods may still fall short when dealing with challenging public benchmarks because the performances…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Sihwan Kim , Taejang Park

Convolutional neural networks (CNNs) with log-mel spectrum features have shown promising results for acoustic scene classification tasks. However, the performance of these CNN based classifiers is still lacking as they do not generalise…

Sound · Computer Science 2021-08-17 Yang Liu , Alexandros Neophytou , Sunando Sengupta , Eric Sommerlade

Recent advances in the Active Speaker Detection (ASD) problem build upon a two-stage process: feature extraction and spatio-temporal context aggregation. In this paper, we propose an end-to-end ASD workflow where feature learning and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Juan Leon Alcazar , Moritz Cordes , Chen Zhao , Bernard Ghanem

This paper addresses the issue of active speaker detection (ASD) in noisy environments and formulates a robust active speaker detection (rASD) problem. Existing ASD approaches leverage both audio and visual modalities, but non-speech sounds…

Multimedia · Computer Science 2024-04-02 Siva Sai Nagender Vasireddy , Chenxu Zhang , Xiaohu Guo , Yapeng Tian

Environmental sound classification (ESC) has gained significant attention due to its diverse applications in smart city monitoring, fault detection, acoustic surveillance, and manufacturing quality control. To enhance CNN performance,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-25 Parinaz Binandeh Dehaghania , Danilo Penab , A. Pedro Aguiar

Recent studies focus on developing efficient systems for acoustic scene classification (ASC) using convolutional neural networks (CNNs), which typically consist of consecutive kernels. This paper highlights the benefits of using separate…

Sound · Computer Science 2024-05-30 Yiqiang Cai , Peihong Zhang , Shengchen Li

This paper presents the details of the Audio-Visual Scene Classification task in the DCASE 2021 Challenge (Task 1 Subtask B). The task is concerned with classification using audio and video modalities, using a dataset of synchronized…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-21 Shanshan Wang , Toni Heittola , Annamaria Mesaros , Tuomas Virtanen

The use of multiple and semantically correlated sources can provide complementary information to each other that may not be evident when working with individual modalities on their own. In this context, multi-modal models can help producing…

This technical report describes the SurreyAudioTeam22s submission for DCASE 2022 ASC Task 1, Low-Complexity Acoustic Scene Classification (ASC). The task has two rules, (a) the ASC framework should have maximum 128K parameters, and (b)…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-03 Arshdeep Singh , James A King , Xubo Liu , Wenwu Wang , Mark D. Plumbley

Sound event detection (SED) and acoustic scene classification (ASC) are major tasks in environmental sound analysis. Considering that sound events and scenes are closely related to each other, some works have addressed joint analyses of…

Although acoustic scenes and events include many related tasks, their combined detection and classification have been scarcely investigated. We propose three architectures of deep neural networks that are integrated to simultaneously…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Jee-weon Jung , Hye-jin Shim , Ju-ho Kim , Ha-Jin Yu

Varying conditions between the data seen at training and at application time remain a major challenge for machine learning. We study this problem in the context of Acoustic Scene Classification (ASC) with mismatching recording devices.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Paul Primus and , Gerhard Widmer

Scene classification, aiming at classifying a scene image to one of the predefined scene categories by comprehending the entire image, is a longstanding, fundamental and challenging problem in computer vision. The rise of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Delu Zeng , Minyu Liao , Mohammad Tavakolian , Yulan Guo , Bolei Zhou , Dewen Hu , Matti Pietikäinen , Li Liu

Ambient sound scenes typically comprise multiple short events occurring on top of a somewhat stationary background. We consider the task of separating these events from the background, which we call foreground-background ambient sound scene…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Michel Olvera , Emmanuel Vincent , Romain Serizel , Gilles Gasso

Remote sensing image scene classification, which aims at labeling remote sensing images with a set of semantic categories based on their contents, has broad applications in a range of fields. Propelled by the powerful feature learning…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Gong Cheng , Xingxing Xie , Junwei Han , Lei Guo , Gui-Song Xia

The paper proposes a new text recognition network for scene-text images. Many state-of-the-art methods employ the attention mechanism either in the text encoder or decoder for the text alignment. Although the encoder-based attention yields…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Usman Sajid , Michael Chow , Jin Zhang , Taejoon Kim , Guanghui Wang

In this paper, a neural network named Sequence-to-sequence ConvErsion NeTwork (SCENT) is presented for acoustic modeling in voice conversion. At training stage, a SCENT model is estimated by aligning the feature sequences of source and…

Sound · Computer Science 2020-01-14 Jing-Xuan Zhang , Zhen-Hua Ling , Li-Juan Liu , Yuan Jiang , Li-Rong Dai