English
Related papers

Related papers: Contrastive Environmental Sound Representation Lea…

200 papers

Today, data collection has improved in various areas, and the medical domain is no exception. Auscultation, as an important diagnostic technique for physicians, due to the progress and availability of digital stethoscopes, lends itself well…

The learning of interpretable representations from raw data presents significant challenges for time series data like speech. In this work, we propose a relevance weighting scheme that allows the interpretation of the speech representations…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Purvi Agrawal , Sriram Ganapathy

The objective of this work is to localize the sound sources in visual scenes. Existing audio-visual works employ contrastive learning by assigning corresponding audio-visual pairs from the same source as positives while randomly mismatched…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Arda Senocak , Hyeonggon Ryu , Junsik Kim , In So Kweon

Many speech enhancement methods try to learn the relationship between noisy and clean speech, obtained using an acoustic room simulator. We point out several limitations of enhancement methods relying on clean speech targets; the goal of…

Computation and Language · Computer Science 2018-12-26 Geonmin Kim , Hwaran Lee , Bo-Kyeong Kim , Sang-Hoon Oh , Soo-Young Lee

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Speech quality assessment (SQA) is often used to learn a mapping from a high-dimensional input space to a scalar that represents the mean opinion score (MOS) of the perceptual speech quality. Learning such a mapping is challenging for many…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-17 Junyi Fan , Donald Williamson

Contrastive Learning has recently received interest due to its success in self-supervised representation learning in the computer vision domain. However, the origins of Contrastive Learning date as far back as the 1990s and its development…

Machine Learning · Computer Science 2020-10-29 Phuc H. Le-Khac , Graham Healy , Alan F. Smeaton

This paper proposes to use low-level spatial features extracted from multichannel audio for sound event detection. We extend the convolutional recurrent neural network to handle more than one type of these multichannel features by learning…

Sound · Computer Science 2017-06-09 Sharath Adavanne , Pasi Pertilä , Tuomas Virtanen

In the context of the Internet of Things (IoT), sound sensing applications are required to run on embedded platforms where notions of product pricing and form factor impose hard constraints on the available computing power. Whereas…

Sound · Computer Science 2016-09-09 Siddharth Sigtia , Adam M. Stark , Sacha Krstulovic , Mark D. Plumbley

The majority of sound scene analysis work focuses on one of two clearly defined tasks: acoustic scene classification or sound event detection. Whilst this separation of tasks is useful for problem definition, they inherently ignore some…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-30 Helen L. Bear , Toni Heittola , Annamaria Mesaros , Emmanouil Benetos , Tuomas Virtanen

This work describes a speech denoising system for machine ears that aims to improve speech intelligibility and the overall listening experience in noisy environments. We recorded approximately 100 hours of audio data with reverberation and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-18 Cong Han , E. Merve Kaya , Kyle Hoefer , Malcolm Slaney , Simon Carlile

Anomalous sound detection (ASD) is one of the most significant tasks of mechanical equipment monitoring and maintaining in complex industrial systems. In practice, it is vital to precisely identify abnormal status of the working mechanical…

DeepFake Audio, unlike DeepFake images and videos, has been relatively less explored from detection perspective, and the solutions which exist for the synthetic speech classification either use complex networks or dont generalize to…

Sound · Computer Science 2022-10-24 Vardhan Dongre , Abhinav Thimma Reddy , Nikhitha Reddeddy

Environmental acoustic sensing involves the retrieval and processing of audio signals to better understand our surroundings. While large-scale acoustic data make manual analysis infeasible, they provide a suitable playground for machine…

Machine Learning · Statistics 2017-12-08 Yunpeng Li , Ivan Kiskin , Davide Zilli , Marianne Sinka , Henry Chan , Kathy Willis , Stephen Roberts

In this work, we investigate the time series representation learning problem using self-supervised techniques. Contrastive learning is well-known in this area as it is a powerful method for extracting information from the series and…

Machine Learning · Computer Science 2024-10-08 Duy A. Nguyen , Trang H. Tran , Huy Hieu Pham , Phi Le Nguyen , Lam M. Nguyen

Recognizing underwater targets from acoustic signals is a challenging task owing to the intricate ocean environments and variable underwater channels. While deep learning-based systems have become the mainstream approach for underwater…

Sound · Computer Science 2024-02-21 Yuan Xie , Jiawei Ren , Ji Xu

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

Methods based on supervised learning using annotations in an end-to-end fashion have been the state-of-the-art for classification problems. However, they may be limited in their generalization capability, especially in the low data regime.…

Sound · Computer Science 2023-08-14 Ilyass Moummad , Nicolas Farrugia

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu

While supervised learning has enabled great progress in many applications, unsupervised learning has not seen such widespread adoption, and remains an important and challenging endeavor for artificial intelligence. In this work, we propose…

Machine Learning · Computer Science 2019-01-23 Aaron van den Oord , Yazhe Li , Oriol Vinyals