English
Related papers

Related papers: TransNAS-TSAD: Harnessing Transformers for Multi-O…

200 papers

In this paper, we introduce Masked Anomaly Detection (MAD), a general self-supervised learning task for multivariate time series anomaly detection. With the increasing availability of sensor data from industrial systems, being able to…

Machine Learning · Computer Science 2022-10-04 Yiwei Fu , Feng Xue

Multi-task neural architecture search (NAS) enables transferring architectural knowledge among different tasks. However, ranking disorder between the source task and the target task degrades the architecture performance on the downstream…

Neural and Evolutionary Computing · Computer Science 2026-02-03 TingJie Zhang , HaiLin Liu

One main challenge in time series anomaly detection for industrial IoT lies in the complex spatio-temporal couplings within multivariate data. However, traditional anomaly detection methods focus on modeling spatial or temporal dependencies…

Machine Learning · Computer Science 2025-09-30 Tao Yin , Xiaohong Zhang , Shaochen Fu , Zhibin Zhang , Li Huang , Yiyuan Yang , Kaixiang Yang , Meng Yan

Organizations rely heavily on time series metrics to measure and model key aspects of operational and business performance. The ability to reliably detect issues with these metrics is imperative to identifying early indicators of major…

Machine Learning · Computer Science 2020-11-11 Sayan Chakraborty , Smit Shah , Kiumars Soltani , Anna Swigart , Luyao Yang , Kyle Buckingham

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detection models have…

Machine Learning · Computer Science 2023-12-05 Jie Liu , Qilin Li , Senjian An , Bradley Ezard , Ling Li

Unsupervised anomaly detection in time-series has been extensively investigated in the literature. Notwithstanding the relevance of this topic in numerous application fields, a comprehensive and extensive evaluation of recent…

Machine Learning · Computer Science 2024-08-13 Nesryne Mejri , Laura Lopez-Fuentes , Kankana Roy , Pavel Chernakov , Enjie Ghorbel , Djamila Aouada

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

Machine Learning · Computer Science 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

We develop a distribution-free, unsupervised anomaly detection method called ECAD, which wraps around any regression algorithm and sequentially detects anomalies. Rooted in conformal prediction, ECAD does not require data exchangeability…

Applications · Statistics 2021-06-04 Chen Xu , Yao Xie

Anomaly detection is crucial for ensuring the stability and reliability of web service systems. Logs and metrics contain multiple information that can reflect the system's operational state and potential anomalies. Thus, existing anomaly…

Software Engineering · Computer Science 2025-01-29 Xixuan Yang , Xin Huang , Chiming Duan , Tong Jia , Shandong Dong , Ying Li , Gang Huang

Time series anomaly detection (TSAD) has been a long-standing pillar problem in Web-scale systems and online infrastructures, such as service reliability monitoring, system fault diagnosis, and performance optimization. Large language…

Computation and Language · Computer Science 2026-02-18 Xiongxiao Xu , Haoran Wang , Yueqing Liang , Philip S. Yu , Yue Zhao , Kai Shu

Recently, numerous efficient Transformers have been proposed to reduce the quadratic computational complexity of standard Transformers caused by the Softmax attention. However, most of them simply swap Softmax with an efficient attention…

Computation and Language · Computer Science 2022-07-29 Zexiang Liu , Dong Li , Kaiyue Lu , Zhen Qin , Weixuan Sun , Jiacheng Xu , Yiran Zhong

In the field of complex action recognition in videos, the quality of the designed model plays a crucial role in the final performance. However, artificially designed network structures often rely heavily on the researchers' knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Pengzhen Ren , Gang Xiao , Xiaojun Chang , Yun Xiao , Zhihui Li , Xiaojiang Chen

Time series anomaly detection is extensively studied in statistics, economics, and computer science. Over the years, numerous methods have been proposed for time series anomaly detection using deep learning-based methods. Many of these…

Machine Learning · Computer Science 2022-08-25 Shahroz Tariq , Binh M. Le , Simon S. Woo

Anomaly Detection in multivariate time series is a major problem in many fields. Due to their nature, anomalies sparsely occur in real data, thus making the task of anomaly detection a challenging problem for classification algorithms to…

Machine Learning · Computer Science 2023-08-08 Anastasios Iliopoulos , John Violos , Christos Diou , Iraklis Varlamis

Time series anomaly detection is crucial for maintaining stable systems. Existing methods face two main challenges. First, it is difficult to directly model the dependencies of diverse and complex patterns within the sequences. Second, many…

Machine Learning · Computer Science 2025-04-22 Wenxin Zhang , Cuicui Luo

Neural Architecture Search (NAS) methods have been shown to outperform hand-designed models and help to democratize AI. However, NAS methods often start from scratch with each new task, making them computationally expensive and limiting…

Machine Learning · Computer Science 2025-07-15 Prabhant Singh , Joaquin Vanschoren

Anomaly detection in multivariate time series (MTS) is crucial for various applications in data mining and industry. Current industrial methods typically approach anomaly detection as an unsupervised learning task, aiming to identify…

Machine Learning · Computer Science 2024-10-14 Yuanyi Wang , Haifeng Sun , Chengsen Wang , Mengde Zhu , Jingyu Wang , Wei Tang , Qi Qi , Zirui Zhuang , Jianxin Liao

Time-series anomaly detection (TSAD) requires identifying both immediate Point Anomalies and long-range Context Anomalies. However, existing foundation models face a fundamental trade-off: 1D temporal models provide fine-grained pointwise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yingyuan Yang , Tian Lan , Yifei Gao , Yimeng Lu , Wenjun He , Meng Wang , Chenghao Liu , Chen Zhang

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

Machine Learning · Computer Science 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

Time series anomaly detection (TSAD) has traditionally focused on binary classification and often lacks the fine-grained categorization and explanatory reasoning required for transparent decision-making. To address these limitations, we…

Machine Learning · Computer Science 2026-04-17 Yiyuan Yang , Zichuan Liu , Lei Song , Kai Ying , Zhiguang Wang , Tom Bamford , Svitlana Vyetrenko , Jiang Bian , Qingsong Wen