English
Related papers

Related papers: ESResNet: Environmental Sound Classification Based…

200 papers

Temporal detection problems appear in many fields including time-series estimation, activity recognition and sound event detection (SED). In this work, we propose a new approach to temporal event modeling by explicitly modeling event onsets…

Acoustic Event Classification (AEC) has been widely used in devices such as smart speakers and mobile phones for home safety or accessibility support. As AEC models run on more and more devices with diverse computation resource constraints,…

Sound · Computer Science 2023-03-21 Guan-Ting Lin , Qingming Tang , Chieh-Chi Kao , Viktor Rozgic , Chao Wang

Audio and visual signals typically occur simultaneously, and humans possess an innate ability to correlate and synchronize information from these two modalities. Recently, a challenging problem known as Audio-Visual Segmentation (AVS) has…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yuxuan Wang , Jinchao Zhu , Feng Dong , Shuyue Zhu

Acoustic scene classification is an intricate problem for a machine. As an emerging field of research, deep Convolutional Neural Networks (CNN) achieve convincing results. In this paper, we explore the use of multi-scale Dense connected…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Dawei Feng , Kele Xu , Haibo Mi , Feifan Liao , Yan Zhou

With the growth of the Internet of Things and the rise of Big Data, data processing and machine learning applications are being moved to cheap and low size, weight, and power (SWaP) devices at the edge, often in the form of mobile phones,…

Sound · Computer Science 2021-03-24 David Elliott , Carlos E. Otero , Steven Wyatt , Evan Martino

Audio deepfake detection has become increasingly challenging due to rapid advances in speech synthesis and voice conversion technologies, particularly under channel distortions, replay attacks, and real-world recording conditions. This…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 K. A. Shahriar

Sound Event Early Detection (SEED) is an essential task in recognizing the acoustic environments and soundscapes. However, most of the existing methods focus on the offline sound event detection, which suffers from the over-confidence issue…

Sound · Computer Science 2022-02-15 Xujiang Zhao , Xuchao Zhang , Wei Cheng , Wenchao Yu , Yuncong Chen , Haifeng Chen , Feng Chen

Real time acquisition of accurate underwater sound velocity profile (SSP) is crucial for tracking the propagation trajectory of underwater acoustic signals, making it play a key role in ocean communication positioning. SSPs can be directly…

Sound · Computer Science 2025-09-09 Wei Huang , Jiajun Lu , Hao Zhang , Tianhe Xu

Audio deepfake detection aims to detect real human voices from those generated by Artificial Intelligence (AI) and has emerged as a significant problem in the field of voice biometrics systems. With the ever-improving quality of synthetic…

Sound · Computer Science 2026-05-12 Aishwarya Fursule , Shruti Kshirsagar , Anderson R. Avila

This paper proposes an active learning system for sound event detection (SED). It aims at maximizing the accuracy of a learned SED model with limited annotation effort. The proposed system analyzes an initially unlabeled audio dataset, from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-10 Shuyang Zhao , Toni Heittola , Tuomas Virtanen

The ResNet-based architecture has been widely adopted to extract speaker embeddings for text-independent speaker verification systems. By introducing the residual connections to the CNN and standardizing the residual blocks, the ResNet…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-01 Tianyan Zhou , Yong Zhao , Jian Wu

Immersive communication has made significant advancements, especially with the release of the codec for Immersive Voice and Audio Services. Aiming at its further realization, the DCASE 2025 Challenge has recently introduced a task for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Binh Thien Nguyen , Masahiro Yasuda , Daiki Takeuchi , Daisuke Niizumi , Yasunori Ohishi , Noboru Harada

We propose a novel deep neural network architecture for speech recognition that explicitly employs knowledge of the background environmental noise within a deep neural network acoustic model. A deep neural network is used to predict the…

Computation and Language · Computer Science 2016-10-03 Suyoun Kim , Bhiksha Raj , Ian Lane

State-of-the-art anomalous sound detection (ASD) systems in domain-shifted conditions rely on projecting audio signals into an embedding space and using distance-based outlier detection to compute anomaly scores. One of the major…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-29 Kevin Wilkinghoff , Haici Yang , Janek Ebbers , François G. Germain , Gordon Wichern , Jonathan Le Roux

End-to-end Automatic Speech Recognition (ASR) systems based on neural networks have seen large improvements in recent years. The availability of large scale hand-labeled datasets and sufficient computing resources made it possible to train…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Maxime Burchi , Radu Timofte

Environmental sound understanding in computational auditory scene analysis (CASA) is often formulated as an audio-only recognition problem. This formulation leaves a persistent drawback in multi-label audio tagging (AT): acoustic similarity…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-12 Yuanbo Hou , Yanru Wu , Qiaoqiao Ren , Shengchen Li , Stephen Roberts , Dick Botteldooren

Visual learning often occurs in a specific context, where an agent acquires skills through exploration and tracking of its location in a consistent environment. The historical spatial context of the agent provides a similarity signal for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Lizhen Zhu , James Z. Wang , Wonseuk Lee , Brad Wyble

Environmental sound scene and sound event recognition is important for the recognition of suspicious events in indoor and outdoor environments (such as nurseries, smart homes, nursing homes, etc.) and is a fundamental task involved in many…

Sound · Computer Science 2023-08-31 Nan Che , Chenrui Liu , Fei Yu

This paper presents EffortNet, a novel deep learning framework for decoding individual listening effort from electroencephalography (EEG) during speech comprehension. Listening effort represents a significant challenge in speech-hearing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-22 Ching-Chih Sung , Cheng-Hung Hsin , Yu-Anne Shiah , Bo-Jyun Lin , Yi-Xuan Lai , Chia-Ying Lee , Yu-Te Wang , Borchin Su , Yu Tsao

Audio-visual speech separation methods aim to integrate different modalities to generate high-quality separated speech, thereby enhancing the performance of downstream tasks such as speech recognition. Most existing state-of-the-art (SOTA)…

Sound · Computer Science 2024-03-22 Samuel Pegg , Kai Li , Xiaolin Hu