English
Related papers

Related papers: ARIONet: An Advanced Self-supervised Contrastive R…

200 papers

Most of the achievements in artificial intelligence so far were accomplished by supervised learning which requires numerous annotated training data and thus costs innumerable manpower for labeling. Unsupervised learning is one of the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Mingxiang Chen , Zhanguo Chang , Haonan Lu , Bitao Yang , Zhuang Li , Liufang Guo , Zhecheng Wang

Environmental Sound Classification (ESC) is a challenging field of research in non-speech audio processing. Most of current research in ESC focuses on designing deep models with special architectures tailored for specific audio datasets,…

Sound · Computer Science 2021-03-03 Alireza Nasiri , Jianjun Hu

In recent decade, many state-of-the-art algorithms on image classification as well as audio classification have achieved noticeable successes with the development of deep convolutional neural network (CNN). However, most of the works only…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bold Naranchimeg , Chao Zhang , Takuya Akashi

Real-world sound scenes consist of time-varying collections of sound sources, each generating characteristic sound events that are mixed together in audio recordings. The association of these constituent sound events with their mixture and…

In this paper, we present a framework for contrastive learning for audio representations, in a self supervised frame work without access to any ground truth labels. The core idea in self supervised contrastive learning is to map an audio…

Sound · Computer Science 2021-03-18 Prateek Verma , Julius Smith

Compared with automatic speech recognition (ASR), the human auditory system is more adept at handling noise-adverse situations, including environmental noise and channel distortion. To mimic this adeptness, auditory models have been widely…

Computation and Language · Computer Science 2016-09-16 Peng Dai , Xue Teng , Frank Rudzicz , Ing Yann Soon

Multi-channel audio alignment is a key requirement in bioacoustic monitoring, spatial audio systems, and acoustic localization. However, existing methods often struggle to address nonlinear clock drift and lack mechanisms for quantifying…

Sound · Computer Science 2025-09-23 Ragib Amin Nihal , Benjamin Yen , Takeshi Ashizawa , Kazuhiro Nakadai

Image classification models often demonstrate unstable performance in real-world applications due to variations in image information, driven by differing visual perspectives of subject objects and lighting discrepancies. To mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuze Zheng , Zixuan Li , Xiangxian Li , Jinxing Liu , Yuqing Wang , Xiangxu Meng , Lei Meng

This work presents a supervised deep hashing method for retrieving similar audio events. The proposed method, named AudioNet, is a deep-learning-based system for efficient hashing and retrieval of similar audio events using an audio example…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Sagar Dutta , Vipul Arora

Research in bioacoustics, neuroscience, and linguistics often uses birdsong as a proxy to acquire knowledge across diverse areas. This requires audio models to annotate and parse the birdsong. Developing such models requires precise,…

Machine Learning · Computer Science 2026-05-20 Houtan Ghaffari , Lukas Rauch , Paul Devos

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various data augmentation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Salah Zaiem , Titouan Parcollet , Slim Essid

Self-supervised pre-training methods based on contrastive learning or regression tasks can utilize more unlabeled data to improve the performance of automatic speech recognition (ASR). However, the robustness impact of combining the two…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-28 Qiu-Shi Zhu , Long Zhou , Jie Zhang , Shu-Jie Liu , Yu-Chen Hu , Li-Rong Dai

Existing contrastive learning methods for anomalous sound detection refine the audio representation of each audio sample by using the contrast between the samples' augmentations (e.g., with time or frequency masking). However, they might be…

Sound · Computer Science 2023-04-11 Jian Guan , Feiyang Xiao , Youde Liu , Qiaoxi Zhu , Wenwu Wang

In this work, we investigate the time series representation learning problem using self-supervised techniques. Contrastive learning is well-known in this area as it is a powerful method for extracting information from the series and…

Machine Learning · Computer Science 2024-10-08 Duy A. Nguyen , Trang H. Tran , Huy Hieu Pham , Phi Le Nguyen , Lam M. Nguyen

Self-supervised pretraining on large-scale satellite data has raised great interest in building Earth observation (EO) foundation models. However, many important resources beyond pure satellite imagery, such as land-cover-land-use products…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Yi Wang , Conrad M Albrecht , Xiao Xiang Zhu

Biodiversity loss poses a significant threat to humanity, making wildlife monitoring essential for assessing ecosystem health. Avian species are ideal subjects for this due to their popularity and the ease of identifying them through their…

Machine Learning · Computer Science 2026-02-23 Nina Brolich , Simon Geis , Maximilian Kasper , Alexander Barnhill , Axel Plinge , Dominik Seuß

Audio recognition in specialized areas such as birdsong and submarine acoustics faces challenges in large-scale pre-training due to the limitations in available samples imposed by sampling environments and specificity requirements. While…

Sound · Computer Science 2023-09-26 Xiang Li , Junhao Chen , Chao Li , Hongwu Lv

For centuries researchers have used sound to monitor and study wildlife. Traditionally, conservationists have identified species by ear; however, it is now common to deploy audio recording technology to monitor animal and ecosystem sounds.…

Sound · Computer Science 2021-03-15 C. Chalmers , P. Fergus , S. Wich , S. N. Longmore

Acoustic scene classification (ASC) predominantly relies on supervised approaches. However, acquiring labeled data for training ASC models is often costly and time-consuming. Recently, self-supervised learning (SSL) has emerged as a…

Sound · Computer Science 2024-08-28 Yiqiang Cai , Shengchen Li , Xi Shao

Recognition and interpretation of bird vocalizations are pivotal in ornithological research and ecological conservation efforts due to their significance in understanding avian behaviour, performing habitat assessment and judging ecological…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-30 Yashwardhan Chaudhuri , Paridhi Mundra , Arnesh Batra , Orchid Chetia Phukan , Arun Balaji Buduru