English
Related papers

Related papers: DCdetector: Dual Attention Contrastive Representat…

200 papers

Natural language understanding (NLU) models often rely on dataset biases rather than intended task-relevant features to achieve high performance on specific datasets. As a result, these models perform poorly on datasets outside the training…

Computation and Language · Computer Science 2023-01-05 Yougang Lyu , Piji Li , Yechang Yang , Maarten de Rijke , Pengjie Ren , Yukun Zhao , Dawei Yin , Zhaochun Ren

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

Anomaly detection in time series is a complex task that has been widely studied. In recent years, the ability of unsupervised anomaly detection algorithms has received much attention. This trend has led researchers to compare only…

Machine Learning · Computer Science 2022-09-13 Julien Audibert , Pietro Michiardi , Frédéric Guyard , Sébastien Marti , Maria A. Zuluaga

Data-driven methods that detect anomalies in times series data are ubiquitous in practice, but they are in general unable to provide helpful explanations for the predictions they make. In this work we propose a model-agnostic algorithm that…

One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios. Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an…

Machine Learning · Computer Science 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi

The core challenge in unsupervised anomaly detection is identifying abnormal patterns without prior knowledge of their characteristics. While existing methods have addressed aspects of this problem, they often struggle to learn a robust…

Machine Learning · Computer Science 2026-05-12 Prithul Sarker , Sushmita Sarker , Nicholas G. Murray , Alireza Tavakkoli

Anomaly detection in multi-variate time series (MVTS) data is a huge challenge as it requires simultaneous representation of long term temporal dependencies and correlations across multiple variables. More often, this is solved by breaking…

Machine Learning · Computer Science 2022-02-09 Theivendiram Pranavan , Terence Sim , Arulmurugan Ambikapathi , Savitha Ramasamy

In this paper, we propose a novel training procedure for the continual representation learning problem in which a neural network model is sequentially learned to alleviate catastrophic forgetting in visual search tasks. Our method, called…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Tommaso Barletti , Niccolo' Biondi , Federico Pernici , Matteo Bruni , Alberto Del Bimbo

Anomaly detection is crucial to the advanced identification of product defects such as incorrect parts, misaligned components, and damages in industrial manufacturing. Due to the rare observations and unknown types of defects, anomaly…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jeeho Hyun , Sangyun Kim , Giyoung Jeon , Seung Hwan Kim , Kyunghoon Bae , Byung Jun Kang

Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly…

Machine Learning · Computer Science 2020-10-07 Lucas Deecke , Lukas Ruff , Robert A. Vandermeulen , Hakan Bilen

Time series anomaly detection has been recognized as of critical importance for the reliable and efficient operation of real-world systems. Many anomaly detection methods have been developed based on various assumptions on anomaly…

Machine Learning · Computer Science 2022-07-28 Jiuqi Elise Zhang , Di Wu , Benoit Boulet

Recently, dense contrastive learning has shown superior performance on dense prediction tasks compared to instance-level contrastive learning. Despite its supremacy, the properties of dense contrastive representations have not yet been…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Jong Hak Moon , Wonjae Kim , Edward Choi

Anomaly detection is critical for the secure and reliable operation of industrial control systems. As our reliance on such complex cyber-physical systems grows, it becomes paramount to have automated methods for detecting anomalies,…

Machine Learning · Computer Science 2024-05-10 Mayra Macas , Chunming Wu , Walter Fuertes

In this work, we investigate the time series representation learning problem using self-supervised techniques. Contrastive learning is well-known in this area as it is a powerful method for extracting information from the series and…

Machine Learning · Computer Science 2024-10-08 Duy A. Nguyen , Trang H. Tran , Huy Hieu Pham , Phi Le Nguyen , Lam M. Nguyen

Anomaly detection in multivariate time series is an important problem across various fields such as healthcare, financial services, manufacturing or physics detector monitoring. Accurately identifying when unexpected errors or faults occur…

Machine Learning · Computer Science 2025-06-26 Laura Boggia , Rafael Teixeira de Lima , Bogdan Malaescu

A recent popular approach to out-of-distribution (OOD) detection is based on a self-supervised learning technique referred to as contrastive learning. There are two main variants of contrastive learning, namely instance and class…

Machine Learning · Computer Science 2022-11-08 Nawid Keshtmand , Raul Santos-Rodriguez , Jonathan Lawry

Novelty detection is the process of determining whether a query example differs from the learned training distribution. Previous methods attempt to learn the representation of the normal samples via generative adversarial networks (GANs).…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Chengwei Chen , Yuan Xie , Shaohui Lin , Ruizhi Qiao , Jian Zhou , Xin Tan , Yi Zhang , Lizhuang Ma

Handling out-of-distribution (OOD) samples has become a major stake in the real-world deployment of machine learning systems. This work explores the use of self-supervised contrastive learning to the simultaneous detection of two types of…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pau Rodriguez , David Vazquez , Ioannis Mitliagkas , Joao Monteiro

Deep Bregman divergence measures divergence of data points using neural networks which is beyond Euclidean distance and capable of capturing divergence over distributions. In this paper, we propose deep Bregman divergences for contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Mina Rezaei , Farzin Soleymani , Bernd Bischl , Shekoofeh Azizi

The remarkable progress in deep learning (DL) showcases outstanding results in various computer vision tasks. However, adaptation to real-time variations in data distributions remains an important challenge. Test-Time Training (TTT) was…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Marco Colussi , Sergio Mascetti , Jose Dolz , Christian Desrosiers