English
Related papers

Related papers: Noise Supervised Contrastive Learning and Feature-…

200 papers

Anomaly detection in multivariate time series (MTS) is hindered by dynamic inter-variable dependencies and feature entanglement under spectral noise, and in practice, is further complicated by the absence of anomaly labels. Existing…

Machine Learning · Computer Science 2026-05-25 Yunhua Pei , Zixing Song , Jin Zheng , John Cartlidge

In this paper, we propose a simple but powerful unsupervised learning method for speaker recognition, namely Contrastive Equilibrium Learning (CEL), which increases the uncertainty on nuisance factors latent in the embeddings by employing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Sung Hwan Mun , Woo Hyun Kang , Min Hyun Han , Nam Soo Kim

This paper presents the Speech Technology Center (STC) replay attack detection systems proposed for Automatic Speaker Verification Spoofing and Countermeasures Challenge 2017. In this study we focused on comparison of different spoofing…

Unsupervised anomaly detection (UAD) methods are trained with normal (or healthy) images only, but during testing, they are able to classify normal and abnormal (or disease) images. UAD is an important medical image analysis (MIA) method to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-16 Yu Tian , Fengbei Liu , Guansong Pang , Yuanhong Chen , Yuyuan Liu , Johan W. Verjans , Rajvinder Singh , Gustavo Carneiro

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Contrastive learning (CL) is one of the most successful paradigms for self-supervised learning (SSL). In a principled way, it considers two augmented "views" of the same image as positive to be pulled closer, and all other images as…

Machine Learning · Computer Science 2023-06-21 Chun-Hsiao Yeh , Cheng-Yao Hong , Yen-Chi Hsu , Tyng-Luh Liu , Yubei Chen , Yann LeCun

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

The detection of anomalous sounds in machinery operation presents a significant challenge due to the difficulty in generalizing anomalous acoustic patterns. This task is typically approached as an unsupervised learning or novelty detection…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-30 Seunghyeon Shin , Seokjin Lee

Anomalous Sound Detection (ASD) aims at identifying anomalous sounds from machines and has gained extensive research interests from both academia and industry. However, the uncertainty of anomaly location and much redundant information such…

Sound · Computer Science 2025-08-22 Guirui Zhong , Qing Wang , Jun Du , Lei Wang , Mingqi Cai , Xin Fang

The increasing level of sound pollution in marine environments poses an increased threat to ocean health, making it crucial to monitor underwater noise. By monitoring this noise, the sources responsible for this pollution can be mapped.…

Sound · Computer Science 2025-05-20 Hilde I. Hummel , Arwin Gansekoele , Sandjai Bhulai , Rob van der Mei

Overlapping sound events are ubiquitous in real-world environments, but existing end-to-end sound event detection (SED) methods still struggle to detect them effectively. A critical reason is that these methods represent overlapping events…

Sound · Computer Science 2024-01-12 Yadong Guan , Jiqing Han , Hongwei Song , Wenjie Song , Guibin Zheng , Tieran Zheng , Yongjun He

Contrastive learning (CL) has recently been applied to adversarial learning tasks. Such practice considers adversarial samples as additional positive views of an instance, and by maximizing their agreements with each other, yields better…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Qiying Yu , Jieming Lou , Xianyuan Zhan , Qizhang Li , Wangmeng Zuo , Yang Liu , Jingjing Liu

This paper presents a unified AI framework for high-accuracy audio anomaly detection by integrating advanced noise reduction, feature extraction, and machine learning modeling techniques. The approach combines spectral subtraction and…

Sound · Computer Science 2025-06-02 Hamideh Khaleghpour , Brett McKinney

Sound event detection (SED), as a core module of acoustic environmental analysis, suffers from the problem of data deficiency. The integration of semi-supervised learning (SSL) largely mitigates such problem while bringing no extra…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-01 Nian Shao , Erfan Loweimi , Xiaofei Li

Unsupervised learning is a challenging task due to the lack of labels. Multiple Object Tracking (MOT), which inevitably suffers from mutual object interference, occlusion, etc., is even more difficult without label supervision. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sha Meng , Dian Shao , Jiacheng Guo , Shan Gao

Network intrusion detection remains a critical challenge in cybersecurity. While supervised machine learning models achieve state-of-the-art performance, their reliance on large labelled datasets makes them impractical for many real-world…

Machine Learning · Computer Science 2025-09-09 Jack Wilkie , Hanan Hindy , Christos Tachtatzis , Robert Atkinson

This paper investigates negative sampling for contrastive learning in the context of audio-text retrieval. The strategy for negative sampling refers to selecting negatives (either audio clips or textual descriptions) from a pool of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-20 Huang Xie , Okko Räsänen , Tuomas Virtanen

Customizable keyword spotting (KWS) in continuous speech has attracted increasing attention due to its real-world application potential. While contrastive learning (CL) has been widely used to extract keyword representations, previous CL…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-15 Yu Xi , Baochen Yang , Hao Li , Jiaqi Guo , Kai Yu

The goal of self-supervised learning (SSL) for automatic speech recognition (ASR) is to learn good speech representations from a large amount of unlabeled speech for the downstream ASR task. However, most SSL frameworks do not consider…

Computation and Language · Computer Science 2022-01-27 Yiming Wang , Jinyu Li , Heming Wang , Yao Qian , Chengyi Wang , Yu Wu

This paper introduces a semi-supervised contrastive learning framework and its application to text-independent speaker verification. The proposed framework employs generalized contrastive loss (GCL). GCL unifies losses from two different…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-09 Nakamasa Inoue , Keita Goto