English
Related papers

Related papers: ARIONet: An Advanced Self-supervised Contrastive R…

200 papers

Due to the unprecedented breakthroughs brought about by deep learning, speech enhancement (SE) techniques have been developed rapidly and play an important role prior to acoustic modeling to mitigate noise effects on speech. To increase the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Fu-An Chao , Shao-Wei Fan Jiang , Bi-Cheng Yan , Jeih-weih Hung , Berlin Chen

Time series forecasting (TSF) holds significant importance in modern society, spanning numerous domains. Previous representation learning-based TSF algorithms typically embrace a contrastive learning paradigm featuring segregated…

Machine Learning · Computer Science 2023-12-12 Jiaxin Gao , Yuxiao Hu , Qinglong Cao , Siqi Dai , Yuntian Chen

We introduce CrossNet, a complex spectral mapping approach to speaker separation and enhancement in reverberant and noisy conditions. The proposed architecture comprises an encoder layer, a global multi-head self-attention module, a…

Sound · Computer Science 2024-03-07 Vahid Ahmadi Kalkhorani , DeLiang Wang

Training a classifier on web-crawled data demands learning algorithms that are robust to annotation errors and irrelevant examples. This paper builds upon the recent empirical observation that applying unsupervised contrastive learning to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Paul Albert , Jack Valmadre , Eric Arazo , Tarun Krishna , Noel E. O'Connor , Kevin McGuinness

Unsupervised learning methods for feature extraction are becoming more and more popular. We combine the popular contrastive learning method (prototypical contrastive learning) and the classic representation learning method (autoencoder) to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Zeyu Cao , Xiaorun Li , Liaoying Zhao

In medical imaging, manual annotations can be expensive to acquire and sometimes infeasible to access, making conventional deep learning-based models difficult to scale. As a result, it would be beneficial if useful representations could be…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Jianbo Jiao , Yifan Cai , Mohammad Alsharid , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

Acoustic identification of individual animals (AIID) is closely related to audio-based species classification but requires a finer level of detail to distinguish between individual animals within the same species. In this work, we frame…

Sound · Computer Science 2024-09-16 Ines Nolasco , Ilyass Moummad , Dan Stowell , Emmanouil Benetos

Acoustic scene classification systems using deep neural networks classify given recordings into pre-defined classes. In this study, we propose a novel scheme for acoustic scene classification which adopts an audio tagging system inspired by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Jee-weon Jung , Hye-jin Shim , Ju-ho Kim , Seung-bin Kim , Ha-Jin Yu

Passive acoustic monitoring (PAM) is crucial for bioacoustic research, enabling non-invasive species tracking and biodiversity monitoring. Citizen science platforms provide large annotated datasets from focal recordings, where the target…

Sound · Computer Science 2026-01-29 Ilyass Moummad , Romain Serizel , Emmanouil Benetos , Nicolas Farrugia

Acoustic word embeddings (AWEs) are fixed-dimensional representations of variable-length speech segments. For zero-resource languages where labelled data is not available, one AWE approach is to use unsupervised autoencoder-based recurrent…

Computation and Language · Computer Science 2021-03-22 Christiaan Jacobs , Yevgen Matusevych , Herman Kamper

Learning rich visual representations using contrastive self-supervised learning has been extremely successful. However, it is still a major question whether we could use a similar approach to learn superior auditory representations. In this…

Sound · Computer Science 2020-10-20 Haider Al-Tahan , Yalda Mohsenzadeh

Advances in passive acoustic monitoring and machine learning have led to the procurement of vast datasets for computational bioacoustic research. Nevertheless, data scarcity is still an issue for rare and underrepresented species. This…

Taxonomic classification of ecological families, genera, and species underpins biodiversity monitoring and conservation. Existing computer vision methods typically address fine-grained recognition and long-tailed learning in isolation.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Cheng Yaw Low , Heejoon Koo , Jaewoo Park , Meeyoung Cha

Deep learning has celebrated resounding successes in many application areas of relevance to the Internet of Things (IoT), such as computer vision and machine listening. These technologies must ultimately be brought directly to the edge to…

Sound · Computer Science 2022-01-19 Md Mohaimenuzzaman , Christoph Bergmeir , Bernd Meyer

Methods based on supervised learning using annotations in an end-to-end fashion have been the state-of-the-art for classification problems. However, they may be limited in their generalization capability, especially in the low data regime.…

Sound · Computer Science 2023-08-14 Ilyass Moummad , Nicolas Farrugia

Current fake audio detection relies on hand-crafted features, which lose information during extraction. To overcome this, recent studies use direct feature extraction from raw audio signals. For example, RawNet is one of the representative…

Sound · Computer Science 2023-05-24 Chenglong Wang , Jiangyan Yi , Jianhua Tao , Chuyuan Zhang , Shuai Zhang , Ruibo Fu , Xun Chen

Efficient real-time disparity estimation is critical for the application of stereo vision systems in various areas. Recently, stereo network based on coarse-to-fine method has largely relieved the memory constraints and speed limitations of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 He Dai , Xuchong Zhang , Yongli Zhao , Hongbin Sun

As deepfake audio becomes more realistic and diverse, developing generalizable countermeasure systems has become crucial. Existing detection methods primarily depend on XLS-R front-end features to improve generalization. Nonetheless, their…

Sound · Computer Science 2026-02-17 Zhe Ye , Xiangui Kang , Jiayi He , Chengxin Chen , Wei Zhu , Kai Wu , Yin Yang , Jiwu Huang

Recent progress in self-supervised learning has resulted in models that are capable of extracting rich representations from image collections without requiring any explicit label supervision. However, to date the vast majority of these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Grant Van Horn , Elijah Cole , Sara Beery , Kimberly Wilber , Serge Belongie , Oisin Mac Aodha

Camera traps have become a common tool for wildlife monitoring efforts in ecological research and biodiversity conservation. Wildlife classification models have benefited from the increase in wildlife visual data. These models reach high…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mufhumudzi Muthivhi , Jiahao Huo , Fredrik Gustafsson , Terence L. van Zyl