English
Related papers

Related papers: Time Series Anomaly Detection via Reinforcement Le…

200 papers

Recent advancements in time-series anomaly detection have relied on deep learning models to handle the diverse behaviors of time-series data. However, these models often suffer from unstable training and require extensive hyperparameter…

Machine Learning · Computer Science 2024-08-28 Nobuo Namura , Yuma Ichikawa

Multivariate time series anomaly detection is a very common problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anomaly detection process…

Machine Learning · Computer Science 2021-11-24 Kamil Faber , Dominik Żurek , Marcin Pietroń , Kamil Piętak

In this paper, we aim to improve multivariate anomaly detection (AD) by modeling the \textit{time-varying non-linear spatio-temporal correlations} found in multivariate time series data . In multivariate time series data, an anomaly may be…

Machine Learning · Computer Science 2025-09-19 Padmaksha Roy , Almuatazbellah Boker , Lamine Mili

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

It has been shown that deep learning models can under certain circumstances outperform traditional statistical methods at forecasting. Furthermore, various techniques have been developed for quantifying the forecast uncertainty (prediction…

Machine Learning · Computer Science 2021-10-08 Thabang Mathonsi , Terence L. van Zyl

Unsupervised detection of anomaly points in time series is a challenging problem, which requires the model to derive a distinguishable criterion. Previous methods tackle the problem mainly through learning pointwise representation or…

Machine Learning · Computer Science 2022-06-30 Jiehui Xu , Haixu Wu , Jianmin Wang , Mingsheng Long

Unsupervised anomaly detection in time series has been a pivotal research area for decades. Current mainstream approaches focus on learning normality, on the assumption that all or most of the samples in the training set are normal.…

Machine Learning · Computer Science 2025-05-28 Kohei Obata , Yasuko Matsubara , Yasushi Sakurai

Although recent studies on time-series anomaly detection have increasingly adopted ever-larger neural network architectures such as transformers and foundation models, they incur high computational costs and memory usage, making them…

Machine Learning · Computer Science 2026-05-15 Jinju Park , Seokho Kang

Delays frequently occur in real-world environments, yet standard reinforcement learning (RL) algorithms often assume instantaneous perception of the environment. We study random sensor delays in POMDPs, where observations may arrive…

Machine Learning · Computer Science 2026-04-17 Armin Karamzade , Kyungmin Kim , JB Lanier , Davide Corsi , Roy Fox

Time series anomaly detection is a critical machine learning task for numerous applications, such as finance, healthcare, and industrial systems. However, even high-performing models may exhibit potential issues such as biases, leading to…

Human-Computer Interaction · Computer Science 2025-06-24 Ziquan Deng , Xiwei Xuan , Kwan-Liu Ma , Zhaodan Kong

In the research area of anomaly detection, novel and promising methods are frequently developed. However, most existing studies exclusively focus on the detection task only and ignore the interpretability of the underlying models as well as…

Machine Learning · Computer Science 2023-01-16 Cheng Feng , Pingge Hu

Subsequence-based time series classification algorithms provide accurate and interpretable models, but training these models is extremely computation intensive. The asymptotic time complexity of subsequence-based algorithms remains a…

Machine Learning · Computer Science 2021-02-18 Atif Raza , Stefan Kramer

We propose an outlier robust multivariate time series model which can be used for detecting previously unseen anomalous sounds based on noisy training data. The presented approach doesn't assume the presence of labeled anomalies in the…

Sound · Computer Science 2022-02-07 Wo Jae Lee , Karim Helwani , Arvindh Krishnaswamy , Srikanth Tenneti

In recent years, specific evaluation metrics for time series anomaly detection algorithms have been developed to handle the limitations of the classical precision and recall. However, such metrics are heuristically built as an aggregate of…

Machine Learning · Computer Science 2022-10-13 Alexis Huet , Jose Manuel Navarro , Dario Rossi

With the sweeping digitalization of societal, medical, industrial, and scientific processes, sensing technologies are being deployed that produce increasing volumes of time series data, thus fueling a plethora of new or improved…

Machine Learning · Computer Science 2024-04-23 David Campos , Tung Kieu , Chenjuan Guo , Feiteng Huang , Kai Zheng , Bin Yang , Christian S. Jensen

Time series anomaly detection is a challenging problem due to the complex temporal dependencies and the limited label data. Although some algorithms including both traditional and deep models have been proposed, most of them mainly focus on…

Machine Learning · Computer Science 2023-03-28 Chaoli Zhang , Tian Zhou , Qingsong Wen , Liang Sun

Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a…

Machine Learning · Computer Science 2022-05-17 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

The anomaly detection problem for univariate or multivariate time series is a critical question in many practical applications as industrial processes control, biological measures, engine monitoring, supervision of all kinds of behavior. In…

Statistics Theory · Mathematics 2020-10-16 Marie Cottrell , Cynthia Faure , Jérôme Lacaille , Madalina Olteanu

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Time series anomaly detection plays a critical role in a wide range of real-world applications. Among unsupervised approaches, self-supervised learning has gained traction for modeling normal behavior without the need of labeled data.…

Machine Learning · Computer Science 2025-08-05 Aitor Sánchez-Ferrera , Usue Mori , Borja Calvo , Jose A. Lozano