English
Related papers

Related papers: MOMEMTO: Patch-based Memory Gate Model in Time Ser…

200 papers

Despite recent breakthroughs in the applications of deep neural networks, one setting that presents a persistent challenge is that of "one-shot learning." Traditional gradient-based networks require a lot of data to learn, often through…

Machine Learning · Computer Science 2016-05-20 Adam Santoro , Sergey Bartunov , Matthew Botvinick , Daan Wierstra , Timothy Lillicrap

Linear sequence modeling methods, such as linear attention, state space modeling, and linear RNNs, offer significant efficiency improvements by reducing the complexity of training and inference. However, these methods typically compress the…

Computation and Language · Computer Science 2025-11-19 Jusen Du , Weigao Sun , Disen Lan , Jiaxi Hu , Yu Cheng

Autoencoder and its variants have been widely applicated in anomaly detection.The previous work memory-augmented deep autoencoder proposed memorizing normality to detect anomaly, however it neglects the feature discrepancy between different…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Yifei Yang , Shibing Xiang , Ruixiang Zhang

Time series foundation models (TSFMs) have recently achieved remarkable success in universal forecasting by leveraging large-scale pretraining on diverse time series data. Complementing this progress, incorporating frequency-domain…

Machine Learning · Computer Science 2026-04-14 Shunyu Wu , Jiawei Huang , Weibin Feng , Boxin Li , Xiao Zhang , Erli Meng , Dan Li , Jian Lou , See-Kiong Ng

Forecasting Multivariate Time Series (MTS) involves significant challenges in various application domains. One immediate challenge is modeling temporal patterns with the finite length of the input. These temporal patterns usually involve…

Machine Learning · Computer Science 2024-09-30 Muyao Wang , Wenchao Chen , Zhibin Duan , Bo Chen

Memory units have been widely used to enrich the capabilities of deep networks on capturing long-term dependencies in reasoning and prediction tasks, but little investigation exists on deep generative models (DGMs) which are good at…

Machine Learning · Computer Science 2016-05-31 Chongxuan Li , Jun Zhu , Bo Zhang

Multi-object tracking (MOT) has profound applications in a variety of fields, including surveillance, sports analytics, self-driving, and cooperative robotics. Despite considerable advancements, existing MOT methodologies tend to falter…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Hamza Mukhtar , Muhammad Usman Ghani Khan

Anomaly detection on multivariate time-series is of great importance in both data mining research and industrial applications. Recent approaches have achieved significant progress in this topic, but there is remaining limitations. One major…

Machine Learning · Computer Science 2020-09-07 Hang Zhao , Yujing Wang , Juanyong Duan , Congrui Huang , Defu Cao , Yunhai Tong , Bixiong Xu , Jing Bai , Jie Tong , Qi Zhang

Detecting anomalies for multivariate time-series without manual supervision continues a challenging problem due to the increased scale of dimensions and complexity of today's IT monitoring systems. Recent progress of unsupervised…

Machine Learning · Computer Science 2021-10-19 Qinfeng Xiao , Shikuan Shao , Jing Wang

Industrial anomaly detection faces significant challenges due to the scarcity of anomalous samples and the complexity of real-world anomalies. In this paper, we propose a foundation model-based anomaly synthesis pipeline (FMAS) that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Wensheng Wu , Zheming Lu , Ziqian Lu , Zewei He , Xuecheng Sun , Zhao Wang , Jungong Han , Yunlong Yu

As automation advances in manufacturing, the demand for precise and sophisticated defect detection technologies grows. Existing vision models for defect recognition methods are insufficient for handling the complexities and variations of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Qianning Wang , He Hu , Yucheng Zhou

In this paper, we present a memory-augmented algorithm for anomaly detection. Classical anomaly detection algorithms focus on learning to model and generate normal data, but typically guarantees for detecting anomalous data are weak. The…

Machine Learning · Computer Science 2020-02-10 Ziyi Yang , Teng Zhang , Iman Soltani Bozchalooi , Eric Darve

Industrial anomaly detection is increasingly relying on foundation models, aiming for strong out-of-distribution generalization and rapid adaptation in real-world deployments. Notably, past studies have primarily focused on textual prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Po-Han Huang , Jeng-Lin Li , Po-Hsuan Huang , Ming-Ching Chang , Wei-Chao Chen

Recent advances in digitization have led to the availability of multivariate time series data in various domains, enabling real-time monitoring of operations. Identifying abnormal data patterns and detecting potential failures in these…

Machine Learning · Computer Science 2023-10-10 Fan Wang , Keli Wang , Boyu Yao

Existing large language models (LLMs) can only afford fix-sized inputs due to the input length limit, preventing them from utilizing rich long-context information from past inputs. To address this, we propose a framework, Language Models…

Computation and Language · Computer Science 2023-06-13 Weizhi Wang , Li Dong , Hao Cheng , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Time series foundation models excel at diverse time series forecasting tasks, but their capacity for continuous improvement through incremental learning remains unexplored. We present the first comprehensive study investigating these…

Machine Learning · Computer Science 2025-04-22 Jia Liu , Cheng Jinguo , Xia Fang , Zhenyuan Ma , Yuankai Wu

We investigate anomaly detection in an unsupervised framework and introduce Long Short Term Memory (LSTM) neural network based algorithms. In particular, given variable length data sequences, we first pass these sequences through our LSTM…

Signal Processing · Electrical Eng. & Systems 2020-02-25 Tolga Ergen , Ali Hassan Mirza , Suleyman Serdar Kozat

We propose an outlier robust multivariate time series model which can be used for detecting previously unseen anomalous sounds based on noisy training data. The presented approach doesn't assume the presence of labeled anomalies in the…

Sound · Computer Science 2022-02-07 Wo Jae Lee , Karim Helwani , Arvindh Krishnaswamy , Srikanth Tenneti

Time-series anomaly detection (TSAD) with multimodal large language models (MLLMs) is an emerging area, yet a persistent challenge remains: MLLMs rely on coarse time-series heuristics but struggle with multi-dimensional, detailed reasoning,…

Machine Learning · Computer Science 2026-02-10 Junru Zhang , Lang Feng , Haoran Shi , Xu Guo , Han Yu , Yabo Dong , Duanqing Xu

The recurrent neural network and its variants have shown great success in processing sequences in recent years. However, this deep neural network has not aroused much attention in anomaly detection through predictively process monitoring.…

Machine Learning · Computer Science 2023-09-06 Jiaqi Qiu , Yu Lin , Inez Zwetsloot