English
Related papers

Related papers: Unsupervised Time Series Anomaly Prediction with I…

200 papers

In this work, we investigate the time series representation learning problem using self-supervised techniques. Contrastive learning is well-known in this area as it is a powerful method for extracting information from the series and…

Machine Learning · Computer Science 2024-10-08 Duy A. Nguyen , Trang H. Tran , Huy Hieu Pham , Phi Le Nguyen , Lam M. Nguyen

Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Chen Feng , Ioannis Patras

Detecting anomalies in multivariate time-series data is essential in many real-world applications. Recently, various deep learning-based approaches have shown considerable improvements in time-series anomaly detection. However, existing…

Machine Learning · Computer Science 2022-01-31 Kyeong-Joong Jeong , Yong-Min Shin

Continual learning requires a model to adapt to ongoing changes in the data distribution, and often to the set of tasks to be performed. It is rare, however, that the data and task changes are completely unpredictable. Given a description…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Mark D. McDonnell , Dong Gong , Ehsan Abbasnejad , Anton van den Hengel

Representation learning plays a critical role in the analysis of time series data and has high practical value across a wide range of applications. including trend analysis, time series data retrieval and forecasting. In practice, data…

Machine Learning · Computer Science 2023-12-13 Chengyang Ye , Qiang Ma

Graph augmentations are essential for graph contrastive learning. Most existing works use pre-defined random augmentations, which are usually unable to adapt to different input graphs and fail to consider the impact of different nodes and…

Machine Learning · Computer Science 2023-03-28 Yifu Chen , Qianqian Ren , Liu Yong

Graph contrastive learning (GCL) has recently emerged as an effective learning paradigm to alleviate the reliance on labelling information for graph representation learning. The core of GCL is to maximise the mutual information between the…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Yu Zheng , Xiaofei Zhou , Chen Gong , Vincent CS Lee , Shirui Pan

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Large language models (LLMs) have demonstrated remarkable in-context learning (ICL) abilities. However, existing theoretical analysis of ICL primarily exhibits two limitations: (a) Limited i.i.d. Setting. Most studies focus on supervised…

Computation and Language · Computer Science 2025-02-25 Zixuan Gong , Xiaolin Hu , Huayi Tang , Yong Liu

This paper explores the problem of Generalist Anomaly Detection (GAD), aiming to train one single detection model that can generalize to detect anomalies in diverse datasets from different application domains without any further training on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Jiawen Zhu , Guansong Pang

Anomaly detection of multivariate time series is meaningful for system behavior monitoring. This paper proposes an anomaly detection method based on unsupervised Short- and Long-term Mask Representation learning (SLMR). The main idea is to…

Machine Learning · Computer Science 2022-08-24 Qiucheng Miao , Chuanfu Xu , Jun Zhan , Dong Zhu , Chengkun Wu

Anomaly detection in time-series has a wide range of practical applications. While numerous anomaly detection methods have been proposed in the literature, a recent survey concluded that no single method is the most accurate across various…

Machine Learning · Computer Science 2023-03-14 Mononito Goswami , Cristian Challu , Laurent Callot , Lenon Minorics , Andrey Kan

Developing efficient time series anomaly detection techniques is important to maintain service quality and provide early alarms. Generative neural network methods are one class of the unsupervised approaches that are achieving increasing…

Machine Learning · Computer Science 2022-10-07 Yueyan Gu , Farrokh Jazizadeh

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua

Graph neural networks (GNNs) have recently emerged as an effective collaborative filtering (CF) approaches for recommender systems. The key idea of GNN-based recommender systems is to recursively perform message passing along user-item…

Information Retrieval · Computer Science 2023-07-14 Yangqin Jiang , Chao Huang , Lianghao Xia

A new Lossy Causal Temporal Convolutional Neural Network Autoencoder for anomaly detection is proposed in this work. Our framework uses a rate-distortion loss and an entropy bottleneck to learn a compressed latent representation for the…

Machine Learning · Computer Science 2022-12-06 Christopher P. Ley , Jorge F. Silva

In this paper, we address the incremental classifier learning problem, which suffers from catastrophic forgetting. The main reason for catastrophic forgetting is that the past data are not available during learning. Typical approaches keep…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yue Wu , Yinpeng Chen , Lijuan Wang , Yuancheng Ye , Zicheng Liu , Yandong Guo , Zhengyou Zhang , Yun Fu

Recent years have witnessed many successful applications of contrastive learning in diverse domains, yet its self-supervised version still remains many exciting challenges. As the negative samples are drawn from unlabeled datasets, a…

Machine Learning · Computer Science 2024-02-01 Bin Liu , Bang Wang , Tianrui Li

Continuous efforts are being made to advance anomaly detection in various manufacturing processes to increase the productivity and safety of industrial sites. Deep learning replaced rule-based methods and recently emerged as a promising…

Machine Learning · Computer Science 2024-06-28 Kukjin Choi , Jihun Yi , Jisoo Mok , Sungroh Yoon

With various facial manipulation techniques arising, face forgery detection has drawn growing attention due to security concerns. Previous works always formulate face forgery detection as a classification problem based on cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Ke Sun , Taiping Yao , Shen Chen , Shouhong Ding , Jilin L , Rongrong Ji