English
Related papers

Related papers: Decomposition-based multi-scale transformer framew…

200 papers

Time series anomaly detection presents various challenges due to the sequential and dynamic nature of time-dependent data. Traditional unsupervised methods frequently encounter difficulties in generalization, often overfitting to known…

Machine Learning · Statistics 2025-07-30 Aitor Sánchez-Ferrera , Borja Calvo , Jose A. Lozano

Modeling dynamic temporal dependencies is a critical challenge in time series pre-training, which evolve due to distribution shifts and multi-scale patterns. This temporal variability severely impairs the generalization of pre-trained…

Machine Learning · Computer Science 2025-09-19 Yuemin Wu , Zhongze Wu , Xiu Su , Feng Yang , Hongyan Xu , Xi Lin , Wenti Huang , Shan You , Chang Xu

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…

Due to effective pattern mining and feature representation, neural forecasting models based on deep learning have achieved great progress. The premise of effective learning is to collect sufficient data. However, in time series forecasting,…

Machine Learning · Computer Science 2023-07-04 Yan Gao , Yan Wang , Qiang Wang

Anomaly detection plays a critical role in modern data-driven applications, from identifying fraudulent transactions and safeguarding network infrastructure to monitoring sensor systems for irregular patterns. Traditional approaches, such…

Machine Learning · Computer Science 2025-03-05 Bowen Su

Anomaly detection in spatiotemporal data is a challenging problem encountered in a variety of applications including hyperspectral imaging, video surveillance, and urban traffic monitoring. Existing anomaly detection methods are most suited…

Machine Learning · Computer Science 2020-10-27 Seyyid Emre Sofuoglu , Selin Aviyente

We present a transformer-based image anomaly detection and localization network. Our proposed model is a combination of a reconstruction-based approach and patch embedding. The use of transformer networks helps to preserve the spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Pankaj Mishra , Riccardo Verk , Daniele Fornasier , Claudio Piciarelli , Gian Luca Foresti

This paper introduces a framework specifically designed for sparse and irregular time series {risk estimation}. It is based on a Transformer Autoencoder with local attention, which leverages the powerful pattern identification capabilities…

Machine Learning · Computer Science 2026-05-12 Panteleimon Rodis

Automated crash reporting systems generate large volumes of duplicate reports, overwhelming issue-tracking systems and increasing developer workload. Traditional stack trace-based deduplication methods, relying on string similarity,…

Software Engineering · Computer Science 2025-08-28 Md Afif Al Mamun , Gias Uddin , Lan Xia , Longyu Zhang

The main difficulty in high-dimensional anomaly detection tasks is the lack of anomalous data for training. And simply collecting anomalous data from the real world, common distributions, or the boundary of normal data manifold may face the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Songmin Dai , Jide Li , Lu Wang , Congcong Zhu , Yifan Wu , Xiaoqiang Li

Anomaly detection in time series is a complex task that has been widely studied. In recent years, the ability of unsupervised anomaly detection algorithms has received much attention. This trend has led researchers to compare only…

Machine Learning · Computer Science 2022-09-13 Julien Audibert , Pietro Michiardi , Frédéric Guyard , Sébastien Marti , Maria A. Zuluaga

DEtection TRansformer (DETR) for object detection reaches competitive performance compared with Faster R-CNN via a transformer encoder-decoder architecture. However, trained with scratch transformers, DETR needs large-scale training data…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Zhigang Dai , Bolun Cai , Yugeng Lin , Junying Chen

Anomaly detection in graph-structured data is an inherently challenging problem, as it requires the identification of rare nodes that deviate from the majority in both their structural and behavioral characteristics. Existing methods, such…

Machine Learning · Computer Science 2025-09-16 Mingkang Li , Xuexiong Luo , Yue Zhang , Yaoyang Li , Fu Lin

Multivariate time-series forecasting holds immense value across diverse applications, requiring methods to effectively capture complex temporal and inter-variable dynamics. A key challenge lies in uncovering the intrinsic patterns that…

Machine Learning · Computer Science 2025-03-12 Liang Yu , Lai Tu , Xiang Bai

Reconstruction-based anomaly detection models achieve their purpose by suppressing the generalization ability for anomaly. However, diverse normal patterns are consequently not well reconstructed as well. Although some efforts have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wenrui Liu , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Anomaly detection is represented as an unsupervised learning to identify deviated images from normal images. In general, there are two main challenges of anomaly detection tasks, i.e., the class imbalance and the unexpectedness of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Shuting Yan , Pingping Chen , Honghui Chen , Huan Mao , Feng Chen , Zhijian Lin

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Deep learning promises performant anomaly detection on time-variant datasets, but greatly suffers from low availability of suitable training datasets and frequently changing tasks. Deep transfer learning offers mitigation by letting…

Machine Learning · Computer Science 2021-06-10 Benjamin Maschler , Tim Knodel , Michael Weyrich

This paper presents an extensive empirical study on the integration of dimensionality reduction techniques with advanced unsupervised time series anomaly detection models, focusing on the MUTANT and Anomaly-Transformer models. The study…

Machine Learning · Computer Science 2024-03-08 Mahsun Altin , Altan Cakir

Time-series anomaly detection plays a vital role in monitoring complex operation conditions. However, the detection accuracy of existing approaches is heavily influenced by pattern distribution, existence of multiple normal patterns,…

Machine Learning · Computer Science 2022-02-08 Min Hu , Yi Wang , Xiaowei Feng , Shengchen Zhou , Zhaoyu Wu , Yuan Qin