English
Related papers

Related papers: Contrastive Learning with Spectrum Information Aug…

200 papers

Sound event detection systems are widely used in various applications such as surveillance and environmental monitoring where data is automatically collected, processed, and sent to a cloud for sound recognition. However, this process may…

Sound · Computer Science 2024-01-04 Shayan Gharib , Minh Tran , Diep Luong , Konstantinos Drossos , Tuomas Virtanen

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

Machine Learning · Computer Science 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Feature selection places an important role in improving the performance of outlier detection, especially for noisy data. Existing methods usually perform feature selection and outlier scoring separately, which would select feature subsets…

Machine Learning · Computer Science 2020-01-17 Li Cheng , Yijie Wang , Xinwang Liu , Bin Li

We present a self-supervised learning method to learn audio and video representations. Prior work uses the natural correspondence between audio and video to define a standard cross-modal instance discrimination task, where a model is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Pedro Morgado , Ishan Misra , Nuno Vasconcelos

Outliers are the points which are different from or inconsistent with the rest of the data. They can be novel, new, abnormal, unusual or noisy information. Outliers are sometimes more interesting than the majority of the data. The main…

Computer Vision and Pattern Recognition · Computer Science 2014-06-20 Singh Vijendra , Pathak Shivani

In the present era of large scale surveys, big data presents new challenges to the discovery process for anomalous data. Such data can be indicative of systematic errors, extreme (or rare) forms of known phenomena, or most interestingly,…

Instrumentation and Methods for Astrophysics · Physics 2020-09-17 Daniel Giles , Lucianne Walkowicz

Accurate noise modelling is important for training of deep learning reconstruction algorithms. While noise models are well known for traditional imaging techniques, the noise distribution of a novel sensor may be difficult to determine a…

Machine Learning · Computer Science 2018-07-11 Felix Horger , Tobias Würfl , Vincent Christlein , Andreas Maier

Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly…

Machine Learning · Computer Science 2020-10-07 Lucas Deecke , Lukas Ruff , Robert A. Vandermeulen , Hakan Bilen

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Anomaly detection (AD) is a crucial machine learning task that aims to learn patterns from a set of normal training samples to identify abnormal samples in test data. Most existing AD studies assume that the training and test data are drawn…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tri Cao , Jiawen Zhu , Guansong Pang

Recently, speech separation (SS) task has achieved remarkable progress driven by deep learning technique. However, it is still challenging to separate target speech from noisy mixture, as the neural model is vulnerable to assign background…

Sound · Computer Science 2024-01-09 Zizheng Zhang , Chen Chen , Hsin-Hung Chen , Xiang Liu , Yuchen Hu , Eng Siong Chng

We propose discriminative neighborhood smoothing of generative anomaly scores for anomalous sound detection. While the discriminative approach is known to achieve better performance than generative approaches often, we have found that it…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-19 Takuya Fujimura , Keisuke Imoto , Tomoki Toda

Environmental Sound Classification (ESC) is a challenging field of research in non-speech audio processing. Most of current research in ESC focuses on designing deep models with special architectures tailored for specific audio datasets,…

Sound · Computer Science 2021-03-03 Alireza Nasiri , Jianjun Hu

Recently, self-supervised contrastive learning has achieved great success on various tasks. However, its underlying working mechanism is yet unclear. In this paper, we first provide the tightest bounds based on the widely adopted assumption…

Machine Learning · Computer Science 2025-11-06 Qi Zhang , Yifei Wang , Yisen Wang

We present a novel method for image anomaly detection, where algorithms that use samples drawn from some distribution of "normal" data, aim to detect out-of-distribution (abnormal) samples. Our approach includes a combination of encoder and…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Nina Tuluptceva , Bart Bakker , Irina Fedulova , Anton Konushin

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Noah Goodman

In this paper, we propose the Adversarial Denoising Diffusion Model (ADDM). The ADDM is based on the Denoising Diffusion Probabilistic Model (DDPM) but complementarily trained by adversarial learning. The proposed adversarial learning is…

Image and Video Processing · Electrical Eng. & Systems 2023-12-08 Jongmin Yu , Hyeontaek Oh , Jinhong Yang

Encoder-decoder models have achieved remarkable success in abstractive text summarization, which aims to compress one or more documents into a shorter version without the loss of the essential content. Unfortunately, these models mostly…

Computation and Language · Computer Science 2021-08-27 Shichao Sun , Wenjie Li

The goal of this work is to localize sound sources in visual scenes with a self-supervised approach. Contrastive learning in the context of sound source localization leverages the natural correspondence between audio and visual signals…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Sooyoung Park , Arda Senocak , Joon Son Chung

The Dark Energy Survey is able to collect image data of an extremely large number of extragalactic objects, and it can be reasonably assumed that many unusual objects of high scientific interest are hidden inside these data. Due to the…

Astrophysics of Galaxies · Physics 2023-05-04 Lior Shamir