English
Related papers

Related papers: Surprised by Attention: Predictable Query Dynamics…

200 papers

Time series anomaly detection plays a critical role in a wide range of real-world applications. Among unsupervised approaches, self-supervised learning has gained traction for modeling normal behavior without the need of labeled data.…

Machine Learning · Computer Science 2025-08-05 Aitor Sánchez-Ferrera , Usue Mori , Borja Calvo , Jose A. Lozano

Multivariate time-series anomaly detection (MTSAD) aims to identify deviations from normality in multivariate time-series and is critical in real-world applications. However, in real-world deployments, distribution shifts are ubiquitous and…

Machine Learning · Computer Science 2026-04-03 HyunGi Kim , Jisoo Mok , Hyungyu Lee , Juhyeon Shin , Sungroh Yoon

This paper introduces a hybrid attention and autoencoder (AE) model for unsupervised online anomaly detection in time series. The autoencoder captures local structural patterns in short embeddings, while the attention model learns long-term…

Machine Learning · Computer Science 2024-01-09 Seyed Amirhossein Najafi , Mohammad Hassan Asemani , Peyman Setoodeh

Time series anomaly detection (TSAD) is critical for maintaining the reliability of modern IT infrastructures, where complex anomalies frequently arise in highly dynamic environments. In this paper, we present TShape, a novel framework…

Software Engineering · Computer Science 2025-10-02 Hang Cui , Jingjing Li , Haotian Si , Quan Zhou , Changhua Pei , Gaogang Xie , Dan Pei

The recently proposed xLSTM is a powerful model that leverages expressive multiplicative gating and residual connections, providing the temporal capacity needed for long-horizon forecasting and representation learning. This architecture has…

Machine Learning · Computer Science 2026-03-03 Kamil Faber , Marcin Pietroń , Dominik Żurek , Roberto Corizzo

Time series anomaly detection is a challenging problem due to the complex temporal dependencies and the limited label data. Although some algorithms including both traditional and deep models have been proposed, most of them mainly focus on…

Machine Learning · Computer Science 2023-03-28 Chaoli Zhang , Tian Zhou , Qingsong Wen , Liang Sun

In this paper, we aim to improve multivariate anomaly detection (AD) by modeling the \textit{time-varying non-linear spatio-temporal correlations} found in multivariate time series data . In multivariate time series data, an anomaly may be…

Machine Learning · Computer Science 2025-09-19 Padmaksha Roy , Almuatazbellah Boker , Lamine Mili

Anomaly detection in multivariate time series is an important problem across various fields such as healthcare, financial services, manufacturing or physics detector monitoring. Accurately identifying when unexpected errors or faults occur…

Machine Learning · Computer Science 2025-06-26 Laura Boggia , Rafael Teixeira de Lima , Bogdan Malaescu

Multivariate time series anomaly detection has numerous real-world applications and is being extensively studied. Modeling pairwise correlations between variables is crucial. Existing methods employ learnable graph structures and graph…

Machine Learning · Computer Science 2025-01-24 Zehao Liu , Mengzhou Gao , Pengfei Jiao

Despite the notable advancements in numerous Transformer-based models, the task of long multi-horizon time series forecasting remains a persistent challenge, especially towards explainability. Focusing on commonly used saliency maps in…

Machine Learning · Computer Science 2023-09-18 Nghia Duong-Trung , Duc-Manh Nguyen , Danh Le-Phuoc

Recent advancements in sequence prediction have significantly improved the accuracy of video data interpretation; however, existing models often overlook the potential of attention-based mechanisms for next-frame prediction. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yiqiao Yin

This paper presents a new method for anomaly detection in automated systems with time and compute sensitive requirements, such as autonomous driving, with unparalleled efficiency. As systems like autonomous driving become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Andrew Gao , Jun Liu

We develop a distribution-free, unsupervised anomaly detection method called ECAD, which wraps around any regression algorithm and sequentially detects anomalies. Rooted in conformal prediction, ECAD does not require data exchangeability…

Applications · Statistics 2021-06-04 Chen Xu , Yao Xie

Many organisations manage service quality and monitor a large set devices and servers where each entity is associated with telemetry or physical sensor data series. Recently, various methods have been proposed to detect behavioural…

Social and Information Networks · Computer Science 2023-05-10 Len Feremans , Boris Cule , Bart Goethals

In this paper, we present the Sub-Adjacent Transformer with a novel attention mechanism for unsupervised time series anomaly detection. Unlike previous approaches that rely on all the points within some neighborhood for time point…

Machine Learning · Computer Science 2024-05-01 Wenzhen Yue , Xianghua Ying , Ruohao Guo , DongDong Chen , Ji Shi , Bowei Xing , Yuqing Zhu , Taiyan Chen

Time series anomaly detection plays a critical role in automated monitoring systems. Most previous deep learning efforts related to time series anomaly detection were based on recurrent neural networks (RNN). In this paper, we propose a…

Machine Learning · Computer Science 2019-06-03 Tailai Wen , Roy Keyes

Detecting anomalies for multivariate time-series without manual supervision continues a challenging problem due to the increased scale of dimensions and complexity of today's IT monitoring systems. Recent progress of unsupervised…

Machine Learning · Computer Science 2021-10-19 Qinfeng Xiao , Shikuan Shao , Jing Wang

While anomaly detection in time series has been an active area of research for several years, most recent approaches employ an inadequate evaluation criterion leading to an inflated F1 score. We show that a rudimentary Random Guess method…

Machine Learning · Computer Science 2022-03-11 Keval Doshi , Shatha Abudalou , Yasin Yilmaz

Traditional deep learning models often lack annotated data, especially in cross-domain applications such as anomaly detection, which is critical for early disease diagnosis in medicine and defect detection in industry. To address this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Wahyu Rahmaniar , Kenji Suzuki

Anomaly detection on time series data is increasingly common across various industrial domains that monitor metrics in order to prevent potential accidents and economic losses. However, a scarcity of labeled data and ambiguous definitions…

Machine Learning · Computer Science 2022-12-29 Lawrence Wong , Dongyu Liu , Laure Berti-Equille , Sarah Alnegheimish , Kalyan Veeramachaneni