English
Related papers

Related papers: Asca: less audio data is more insightful

200 papers

We present working notes on transfer learning with semi-supervised dataset annotation for the BirdCLEF 2023 competition, focused on identifying African bird species in recorded soundscapes. Our approach utilizes existing off-the-shelf…

Sound · Computer Science 2024-07-10 Anthony Miyaguchi , Nathan Zhong , Murilo Gustineli , Chris Hayduk

The performance of voice-controlled systems is usually influenced by accented speech. To make these systems more robust, the frontend accent recognition (AR) technologies have received increased attention in recent years. As accent is a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-06 Zhan Zhang , Xi Chen , Yuehai Wang , Jianyi Yang

Attention-based beamformers have recently been shown to be effective for multi-channel speech recognition. However, they are less capable at capturing local information. In this work, we propose a 2D Conv-Attention module which combines…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Bhargav Pulugundla , Yang Gao , Brian King , Gokce Keskin , Harish Mallidi , Minhua Wu , Jasha Droppo , Roland Maas

Audio classification is an important task of mapping audio samples into their corresponding labels. Recently, the transformer model with self-attention mechanisms has been adopted in this field. However, existing audio transformers require…

Sound · Computer Science 2022-02-03 Ke Chen , Xingjian Du , Bilei Zhu , Zejun Ma , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural…

Auditory attention detection (AAD) aims to identify the direction of the attended speaker in multi-speaker environments from brain signals, such as Electroencephalography (EEG) signals. However, existing EEG-based AAD methods overlook the…

Human-Computer Interaction · Computer Science 2025-05-16 Cunhang Fan , Xiaoke Yang , Hongyu Zhang , Ying Chen , Lu Li , Jian Zhou , Zhao Lv

Monitoring of bird populations has played a vital role in conservation efforts and in understanding biodiversity loss. The automation of this process has been facilitated by both sensing technologies, such as passive acoustic monitoring,…

Machine Learning · Computer Science 2021-08-23 Irina Tolkova , Brian Chu , Marcel Hedman , Stefan Kahl , Holger Klinck

Multi-channel audio alignment is a key requirement in bioacoustic monitoring, spatial audio systems, and acoustic localization. However, existing methods often struggle to address nonlinear clock drift and lack mechanisms for quantifying…

Sound · Computer Science 2025-09-23 Ragib Amin Nihal , Benjamin Yen , Takeshi Ashizawa , Kazuhiro Nakadai

Deep learning (DL) has greatly advanced audio classification, yet the field is limited by the scarcity of large-scale benchmark datasets that have propelled progress in other domains. While AudioSet is a pivotal step to bridge this gap as a…

Cloud cover can significantly hinder the use of remote sensing images for Earth observation, prompting urgent advancements in cloud removal technology. Recently, deep learning strategies have shown strong potential in restoring…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Wenli Huang , Ye Deng , Yang Wu , Jinjun Wang

Varying conditions between the data seen at training and at application time remain a major challenge for machine learning. We study this problem in the context of Acoustic Scene Classification (ASC) with mismatching recording devices.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Paul Primus and , Gerhard Widmer

In this paper, ensembles of classifiers that exploit several data augmentation techniques and four signal representations for training Convolutional Neural Networks (CNNs) for audio classification are presented and tested on three freely…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-18 Loris Nanni , Gianluca Maguolo , Sheryl Brahnam , Michelangelo Paci

Recently, channel attention mechanism has demonstrated to offer great potential in improving the performance of deep convolutional neural networks (CNNs). However, most existing methods dedicate to developing more sophisticated attention…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Qilong Wang , Banggu Wu , Pengfei Zhu , Peihua Li , Wangmeng Zuo , Qinghua Hu

The rapid advancement of artificial intelligence (AI) has enabled sophisticated audio generation and voice cloning technologies, posing significant security risks for applications reliant on voice authentication. While existing datasets and…

Sound · Computer Science 2025-05-22 Kunyang Huang , Bin Hu

In this paper, we present a robust and low complexity system for Acoustic Scene Classification (ASC), the task of identifying the scene of an audio recording. We first construct an ASC baseline system in which a novel…

Sound · Computer Science 2022-03-24 Lam Pham , Khoa Dinh , Dat Ngo , Hieu Tang , Alexander Schindler

Automated birdsong classification is essential for advancing ecological monitoring and biodiversity studies. Despite recent progress, existing methods often depend heavily on labeled data, use limited feature representations, and overlook…

Sound · Computer Science 2025-10-28 Md. Abdur Rahman , Selvarajah Thuseethan , Kheng Cher Yeo , Reem E. Mohamed , Sami Azam

Audio self-supervised learning (SSL) pre-training, which aims to learn good representations from unlabeled audio, has made remarkable progress. However, the extensive computational demands during pre-training pose a significant barrier to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Wenxi Chen , Yuzhe Liang , Ziyang Ma , Zhisheng Zheng , Xie Chen

Voice controlled virtual assistants (VAs) are now available in smartphones, cars, and standalone devices in homes. In most cases, the user needs to first "wake-up" the VA by saying a particular word/phrase every time he or she wants the VA…

Human-Computer Interaction · Computer Science 2019-02-05 Atta Norouzian , Bogdan Mazoure , Dermot Connolly , Daniel Willett

Accurate segmentation of heterogeneous anatomical structures is pivotal for computer-aided diagnosis and subsequent clinical decision-making. Although U-Net based convolutional neural networks have achieved remarkable progress, their…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jun Ding , Shang Gao

Audio-visual speech enhancement system is regarded to be one of promising solutions for isolating and enhancing speech of desired speaker. Conventional methods focus on predicting clean speech spectrum via a naive convolution neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Xinmeng Xu , Jianjun Hao