English
Related papers

Related papers: Audio Event-Relational Graph Representation Learni…

200 papers

In this paper, we present deep learning frameworks for audio-visual scene classification (SC) and indicate how individual visual and audio features as well as their combination affect SC performance. Our extensive experiments, which are…

Sound · Computer Science 2021-06-17 Lam Pham , Alexander Schindler , Mina Schütz , Jasmin Lampert , Sven Schlarb , Ross King

Previous works on scene classification are mainly based on audio or visual signals, while humans perceive the environmental scenes through multiple senses. Recent studies on audio-visual scene classification separately fine-tune the…

Sound · Computer Science 2022-08-04 Yuanbo Hou , Bo Kang , Dick Botteldooren

We present in this paper an efficient approach for acoustic scene classification by exploring the structure of class labels. Given a set of class labels, a category taxonomy is automatically learned by collectively optimizing a clustering…

Multimedia · Computer Science 2016-07-27 Huy Phan , Lars Hertel , Marco Maass , Philipp Koch , Alfred Mertins

Acoustic scene classification is the task of identifying the scene from which the audio signal is recorded. Convolutional neural network (CNN) models are widely adopted with proven successes in acoustic scene classification. However, there…

Sound · Computer Science 2019-01-08 Yuzhong Wu , Tan Lee

Pre-trained deep learning embeddings have consistently shown superior performance over handcrafted acoustic features in speech emotion recognition (SER). However, unlike acoustic features with clear physical meaning, these embeddings lack…

Sound · Computer Science 2024-09-17 Satvik Dixit , Daniel M. Low , Gasser Elbanna , Fabio Catania , Satrajit S. Ghosh

Acoustic scene classification (ASC) aims to identify the type of scene (environment) in which a given audio signal is recorded. The log-mel feature and convolutional neural network (CNN) have recently become the most popular time-frequency…

Sound · Computer Science 2021-08-12 Yuzhong Wu , Tan Lee

In this paper, we presents a low-complexity deep learning frameworks for acoustic scene classification (ASC). The proposed framework can be separated into three main steps: Front-end spectrogram extraction, back-end classification, and late…

Sound · Computer Science 2021-06-17 Lam Pham , Hieu Tang , Anahid Jalali , Alexander Schindler , Ross King

Sound event detection (SED) and acoustic scene classification (ASC) are important research topics in environmental sound analysis. Many research groups have addressed SED and ASC using neural-network-based methods, such as the convolutional…

Sound · Computer Science 2021-02-24 Noriyuki Tonami , Keisuke Imoto , Ryosuke Yamanishi , Yoichi Yamashita

Research on soundscapes has shifted the focus of environmental acoustics from noise levels to the perception of sounds, incorporating contextual factors. Soundscape emotion recognition (SER) models perception using a set of features, with…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-19 Samuel Rey , Luca Martino , Roberto San Millan , Eduardo Morgado

Acoustic scene classification (ASC) is a problem related to the field of machine listening whose objective is to classify/tag an audio clip in a predefined label describing a scene location (e. g. park, airport, etc.). Many state-of-the-art…

Sound · Computer Science 2020-06-29 Javier Naranjo-Alcazar , Sergi Perez-Castanos , Pedro Zuccarello , Maximo Cobos

Effectiveness of speech emotion recognition in real-world scenarios is often hindered by noisy environments and variability across datasets. This paper introduces a two-step approach to enhance the robustness and generalization of speech…

Sound · Computer Science 2025-10-13 Upasana Tiwari , Rupayan Chakraborty , Sunil Kumar Kopparapu

Recent efforts have been made on acoustic scene classification in the audio signal processing community. In contrast, few studies have been conducted on acoustic scene clustering, which is a newly emerging problem. Acoustic scene clustering…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Yanxiong Li , Mingle Liu , Wucheng Wang , Yuhan Zhang , Qianhua He

In the past, Acoustic Scene Classification systems have been based on hand crafting audio features that are input to a classifier. Nowadays, the common trend is to adopt data driven techniques, e.g., deep learning, where audio…

Sound · Computer Science 2018-06-29 Eduardo Fonseca , Rong Gong , Xavier Serra

In automatic speech recognition (ASR) what a user says depends on the particular context she is in. Typically, this context is represented as a set of word n-grams. In this work, we present a novel, all-neural, end-to-end (E2E) ASR sys- tem…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-09 Golan Pundak , Tara N. Sainath , Rohit Prabhavalkar , Anjuli Kannan , Ding Zhao

Sound event detection (SED) and acoustic scene classification (ASC) are major tasks in environmental sound analysis. Considering that sound events and scenes are closely related to each other, some works have addressed joint analyses of…

Audio-Visual scene understanding is a challenging problem due to the unstructured spatial-temporal relations that exist in the audio signals and spatial layouts of different objects and various texture patterns in the visual images.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Liguang Zhou , Yuhongze Zhou , Xiaonan Qi , Junjie Hu , Tin Lun Lam , Yangsheng Xu

Speech emotion recognition (SER), the task of identifying the expression of emotion from spoken content, is challenging due to the difficulty in extracting representations that capture emotional attributes from speech. The scarcity of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Soumya Dutta , Sriram Ganapathy

In this technical report, a low-complexity deep learning system for acoustic scene classification (ASC) is presented. The proposed system comprises two main phases: (Phase I) Training a teacher network; and (Phase II) training a student…

Sound · Computer Science 2023-05-17 Lam Pham , Dat Ngo , Cam Le , Anahid Jalali , Alexander Schindler

We introduce in this work an efficient approach for audio scene classification using deep recurrent neural networks. An audio scene is firstly transformed into a sequence of high-level label tree embedding feature vectors. The vector…

Sound · Computer Science 2017-06-06 Huy Phan , Philipp Koch , Fabrice Katzberg , Marco Maass , Radoslaw Mazur , Alfred Mertins

Relating speech to EEG holds considerable importance but is challenging. In this study, a deep convolutional network was employed to extract spatiotemporal features from EEG data. Self-supervised speech representation and contextual text…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Bo Wang , Xiran Xu , Zechen Zhang , Haolin Zhu , YuJie Yan , Xihong Wu , Jing Chen