English
Related papers

Related papers: Contrastive predictive coding for Anomaly Detectio…

200 papers

We present a unified experiment, analysis, and benchmark study of multivariate time-series (MTS) anomaly detection. Ten family-representative detectors -- spanning statistical, reconstruction, association, frequency, and generic-transformer…

Machine Learning · Computer Science 2026-05-28 Junhao Wei , Yanxiao Li , Bidong Chen , Yifu Zhao , Haochen Li , Dexing Yao , Baili Lu , Xudong Ye , Jietian Feng , Sio-Kei Im , Yapeng Wang , Xu Yang

Time series anomaly detection plays a critical role in automated monitoring systems. Most previous deep learning efforts related to time series anomaly detection were based on recurrent neural networks (RNN). In this paper, we propose a…

Machine Learning · Computer Science 2019-06-03 Tailai Wen , Roy Keyes

The vision-language navigation (VLN) task requires an agent to reach a target with the guidance of natural language instruction. Previous works learn to navigate step-by-step following an instruction. However, these works may fail to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xiwen Liang , Fengda Zhu , Yi Zhu , Bingqian Lin , Bing Wang , Xiaodan Liang

Unsupervised anomaly detection in medical imaging aims to detect and localize arbitrary anomalies without requiring annotated anomalous data during training. Often, this is achieved by learning a data distribution of normal samples and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Carsten T. Lüth , David Zimmerer , Gregor Koehler , Paul F. Jaeger , Fabian Isensee , Jens Petersen , Klaus H. Maier-Hein

The use of deep learning techniques in detecting anomalies in time series data has been an active area of research with a long history of development and a variety of approaches. In particular, reconstruction-based unsupervised anomaly…

Artificial Intelligence · Computer Science 2023-02-21 Jinsheng Yang , Yuanhai Shao , ChunNa Li

Recently the deep learning has shown its advantage in representation learning and clustering for time series data. Despite the considerable progress, the existing deep time series clustering approaches mostly seek to train the deep neural…

Machine Learning · Computer Science 2023-01-02 Ying Zhong , Dong Huang , Chang-Dong Wang

This paper introduces Relative Predictive Coding (RPC), a new contrastive representation learning objective that maintains a good balance among training stability, minibatch size sensitivity, and downstream task performance. The key to the…

Machine Learning · Computer Science 2021-04-14 Yao-Hung Hubert Tsai , Martin Q. Ma , Muqiao Yang , Han Zhao , Louis-Philippe Morency , Ruslan Salakhutdinov

High-dimensional observations are a major challenge in the application of model-based reinforcement learning (MBRL) to real-world environments. To handle high-dimensional sensory inputs, existing approaches use representation learning to…

Machine Learning · Computer Science 2021-06-15 Tung Nguyen , Rui Shu , Tuan Pham , Hung Bui , Stefano Ermon

Attempt to fully discover the temporal diversity and chronological characteristics for self-supervised video representation learning, this work takes advantage of the temporal dependencies within videos and further proposes a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yang Liu , Keze Wang , Haoyuan Lan , Liang Lin

Modern language models can generate high-quality short texts. However, they often meander or are incoherent when generating longer texts. These issues arise from the next-token-only language modeling objective. Recent work in…

Computation and Language · Computer Science 2023-05-12 Rose E Wang , Esin Durmus , Noah Goodman , Tatsunori Hashimoto

Dynamic graph modeling has recently attracted much attention due to its extensive applications in many real-world scenarios, such as recommendation systems, financial transactions, and social networks. Although many works have been proposed…

Machine Learning · Computer Science 2021-05-18 Lu Wang , Xiaofu Chang , Shuang Li , Yunfei Chu , Hui Li , Wei Zhang , Xiaofeng He , Le Song , Jingren Zhou , Hongxia Yang

Contrastive learning (CL) has emerged as a promising approach for representation learning in time series data by embedding similar pairs closely while distancing dissimilar ones. However, existing CL methods often introduce false negative…

Machine Learning · Computer Science 2024-10-15 Yu Wu , Ting Dang , Dimitris Spathis , Hong Jia , Cecilia Mascolo

Conformal prediction has been explored as a general and efficient way to provide uncertainty quantification for time series. However, current methods struggle to handle time series data with change points - sudden shifts in the underlying…

Machine Learning · Computer Science 2025-12-02 Sophia Sun , Rose Yu

Contrastive Predictive Coding (CPC) is a representation learning method that maximizes the mutual information between intermediate latent representations and the output of a given model. It can be used to effectively initialize the encoder…

Computation and Language · Computer Science 2023-02-06 Aparna Khare , Minhua Wu , Saurabhchand Bhati , Jasha Droppo , Roland Maas

Detecting anomalies in multivariate time-series data is essential in many real-world applications. Recently, various deep learning-based approaches have shown considerable improvements in time-series anomaly detection. However, existing…

Machine Learning · Computer Science 2022-01-31 Kyeong-Joong Jeong , Yong-Min Shin

Univariate time series (UTS), where each timestamp records a single variable, serve as crucial indicators in web systems and cloud servers. Anomaly detection in UTS plays an essential role in both data mining and system reliability…

Machine Learning · Computer Science 2026-02-11 Lingpei Zhang , Qingming Li , Yong Yang , Jiahao Chen , Rui Zeng , Chenyang Lyu , Shouling Ji

This thesis describes our ongoing work on Contrastive Predictive Coding (CPC) features for speaker verification. CPC is a recently proposed representation learning framework based on predictive coding and noise contrastive estimation. We…

Computation and Language · Computer Science 2019-04-04 Cheng-I Lai

Evaluating anomaly detection in multivariate time series (MTS) requires careful consideration of temporal dependencies, particularly when detecting subsequence anomalies common in fault detection scenarios. While time series…

Machine Learning · Statistics 2025-06-17 Steven C. Hespeler , Pablo Moriano , Mingyan Li , Samuel C. Hollifield

This paper investigates unsupervised anomaly detection in multivariate time-series data using reinforcement learning (RL) in the latent space of an autoencoder. A significant challenge is the limited availability of anomalous data, often…

Machine Learning · Computer Science 2025-02-11 Saba Sanami , Amir G. Aghdam

Representation learning for time series using contrastive learning has emerged as a critical technique for improving the performance of downstream tasks. To advance this effective approach, we introduce CaTT (\textit{Contrast All The…

Machine Learning · Computer Science 2025-07-16 Abdul-Kazeem Shamba , Kerstin Bach , Gavin Taylor