English
Related papers

Related papers: Mamba Adaptive Anomaly Transformer with associatio…

200 papers

Evaluating anomaly detection algorithms in time series data is critical as inaccuracies can lead to flawed decision-making in various domains where real-time analytics and data-driven strategies are essential. Traditional performance…

Machine Learning · Computer Science 2024-05-21 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Ensuring the reliability and user satisfaction of cloud services necessitates prompt anomaly detection followed by diagnosis. Existing techniques for anomaly detection focus solely on real-time detection, meaning that anomaly alerts are…

Software Engineering · Computer Science 2023-08-16 Cheryl Lee , Tianyi Yang , Zhuangbin Chen , Yuxin Su , Michael R. Lyu

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

Effective anomaly detection in time series is pivotal for modern industrial applications and financial systems. Due to the scarcity of anomaly labels and the high cost of manual labeling, reconstruction-based unsupervised approaches have…

Machine Learning · Computer Science 2025-09-25 Tiejun Wang , Rui Wang , Xudong Mou , Mengyuan Ma , Tianyu Wo , Renyu Yang , Xudong Liu

Time series forecasting has made significant advances, including with Transformer-based models. The attention mechanism in Transformer effectively captures temporal dependencies by attending to all past inputs simultaneously. However, its…

Machine Learning · Computer Science 2025-11-04 Xiongxiao Xu , Canyu Chen , Yueqing Liang , Baixiang Huang , Guangji Bai , Liang Zhao , Kai Shu

Mechanical defects in real situations affect observation values and cause abnormalities in multivariate time series, such as sensor values or network data. To perceive abnormalities in such data, it is crucial to understand the temporal…

Machine Learning · Computer Science 2023-05-09 Yungi Jeong , Eunseok Yang , Jung Hyun Ryu , Imseong Park , Myungjoo Kang

Anomaly detection in multivariate time series is an important problem across various fields such as healthcare, financial services, manufacturing or physics detector monitoring. Accurately identifying when unexpected errors or faults occur…

Machine Learning · Computer Science 2025-06-26 Laura Boggia , Rafael Teixeira de Lima , Bogdan Malaescu

Accurate detection and diagnosis of abnormal behaviors such as network attacks from multivariate time series (MTS) are crucial for ensuring the stable and effective operation of industrial cyber-physical systems (CPS). However, existing…

Machine Learning · Computer Science 2024-03-06 Haili Sun , Yan Huang , Lansheng Han , Cai Fu , Chunjie Zhou

Multivariate time series anomaly detection (MTAD) plays a vital role in a wide variety of real-world application domains. Over the past few years, MTAD has attracted rapidly increasing attention from both academia and industry. Many deep…

Machine Learning · Computer Science 2023-06-13 Feng Xia , Xin Chen , Shuo Yu , Mingliang Hou , Mujie Liu , Linlin You

Sequence models like Transformers and RNNs often overallocate attention to irrelevant context, leading to noisy intermediate representations. This degrades LLM capabilities by promoting hallucinations, weakening long-range and retrieval…

Machine Learning · Computer Science 2025-10-30 Nadav Schneider , Itamar Zimerman , Eliya Nachmani

Accurate traffic forecasting is crucial for intelligent transportation systems, supporting effective traffic management, congestion reduction, and informed urban planning. However, traditional models often fail to adequately capture the…

Artificial Intelligence · Computer Science 2026-04-21 Dongyi He , Yuanquan Gao , Bin Jiang , He Yan

The surge in real-time data collection across various industries has underscored the need for advanced anomaly detection in both univariate and multivariate time series data. This paper introduces TransNAS-TSAD, a framework that synergizes…

Machine Learning · Computer Science 2024-03-06 Ijaz Ul Haq , Byung Suk Lee , Donna M. Rizzo

Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a…

Machine Learning · Computer Science 2022-05-17 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

Multivariate time-series anomaly detection (MTSAD) aims to identify deviations from normality in multivariate time-series and is critical in real-world applications. However, in real-world deployments, distribution shifts are ubiquitous and…

Machine Learning · Computer Science 2026-04-03 HyunGi Kim , Jisoo Mok , Hyungyu Lee , Juhyeon Shin , Sungroh Yoon

Time series forecasting in real world environments faces significant challenges non stationarity, multi scale temporal patterns, and distributional shifts that degrade model stability and accuracy. This study propose AdaMamba, a unified…

Machine Learning · Computer Science 2025-12-09 MinCheol Jeon

Despite their frequent use for change detection, both ConvNets and Vision transformers (ViT) exhibit well-known limitations, namely the former struggle to model long-range dependencies while the latter are computationally inefficient,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Elman Ghazaei , Erchan Aptoula

Recent advancements in anomaly detection have seen the efficacy of CNN- and transformer-based approaches. However, CNNs struggle with long-range dependencies, while transformers are burdened by quadratic computational complexity.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Haoyang He , Yuhu Bai , Jiangning Zhang , Qingdong He , Hongxu Chen , Zhenye Gan , Chengjie Wang , Xiangtai Li , Guanzhong Tian , Lei Xie

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

Diffusion models (DMs) embark a new era of generative modeling and offer more opportunities for efficient generating high-quality and realistic data samples. However, their widespread use has also brought forth new challenges in model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jingyao Xu , Yuetong Lu , Yandong Li , Siyang Lu , Dongdong Wang , Xiang Wei