English
Related papers

Related papers: MOMEMTO: Patch-based Memory Gate Model in Time Ser…

200 papers

Unsupervised Continuous Anomaly Detection (UCAD) is gaining attention for effectively addressing the catastrophic forgetting and heavy computational burden issues in traditional Unsupervised Anomaly Detection (UAD). However, existing UCAD…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Mingle Zhou , Jiahui Liu , Jin Wan , Gang Li , Min Li

Time series data are often corrupted by outliers or other kinds of anomalies. Identifying the anomalous points can be a goal on its own (anomaly detection), or a means to improving performance of other time series tasks (e.g. forecasting).…

Machine Learning · Computer Science 2021-12-30 François-Xavier Aubet , Daniel Zügner , Jan Gasthaus

The present study explores the interpretability of latent spaces produced by time series foundation models, focusing on their potential for visual analysis tasks. Specifically, we evaluate the MOMENT family of models, a set of…

Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data.…

Machine Learning · Computer Science 2026-04-07 Liwei Deng , Qingxiang Liu , Xinhe Niu , Shengchao Chen , Sheng Sun , Yuankai Wu , Guodong Long , Yuxuan Liang

Traffic forecasting is a challenging problem due to complex road networks and sudden speed changes caused by various events on roads. A number of models have been proposed to solve this challenging problem with a focus on learning…

Machine Learning · Computer Science 2022-03-09 Hyunwook Lee , Seungmin Jin , Hyeshin Chu , Hongkyu Lim , Sungahn Ko

Frame prediction based on AutoEncoder plays a significant role in unsupervised video anomaly detection. Ideally, the models trained on the normal data could generate larger prediction errors of anomalies. However, the correlation between…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Xiangyu Huang , Caidan Zhao , Jinghui Yu , Chenxing Gao , Zhiqiang Wu

Attention-based models have been widely used in many areas, such as computer vision and natural language processing. However, relevant applications in time series classification (TSC) have not been explored deeply yet, causing a significant…

Machine Learning · Computer Science 2022-07-18 Bowen Zhao , Huanlai Xing , Xinhan Wang , Fuhong Song , Zhiwen Xiao

Camouflaged object detection (COD) primarily focuses on learning subtle yet discriminative representations from complex scenes. Existing methods predominantly follow the parametric feedforward architecture based on static visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Chenxi Zhang , Jiayun Wu , Qing Zhang , Yazhe Zhai , Youwei Pang

Multivariate time series anomaly detection is a very common problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anomaly detection process…

Machine Learning · Computer Science 2021-11-24 Kamil Faber , Dominik Żurek , Marcin Pietroń , Kamil Piętak

Irregular multivariate time series forecasting (IMTSF) is challenging due to non-uniform sampling and variable asynchronicity. These irregularities violate the equidistant assumptions of standard models, hindering local temporal modeling…

Machine Learning · Computer Science 2026-02-03 Xiangfei Qiu , Kangjia Yan , Xvyuan Liu , Xingjian Wu , Jilin Hu

Despite the prevalence of reconstruction-based deep learning methods, time series anomaly detection remains a tremendous challenge. Existing approaches often struggle with limited temporal contexts, insufficient representation of normal…

Machine Learning · Computer Science 2025-07-16 Zhijie Zhong , Zhiwen Yu , Xing Xi , Yue Xu , Wenming Cao , Yiyuan Yang , Kaixiang Yang , Jane You

Time series foundation models have shown impressive performance on a variety of tasks, across a wide range of domains, even in zero-shot settings. However, most of these models are designed to handle short univariate time series as an…

Machine Learning · Computer Science 2024-09-23 Nina Żukowska , Mononito Goswami , Michał Wiliński , Willa Potosnak , Artur Dubrawski

Time series anomaly detection is a pivotal task in data analysis, yet it poses the challenge of discerning normal and abnormal patterns in label-deficient scenarios. While prior studies have largely employed reconstruction-based approaches,…

Machine Learning · Computer Science 2025-08-05 Zhijie Zhong , Zhiwen Yu , Yiyuan Yang , Weizheng Wang , Kaixiang Yang

In this work, we leverage informative embeddings from foundational models for unsupervised anomaly detection in medical imaging. For small datasets, a memory-bank of normative features can directly be used for anomaly detection which has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Nico Schulthess , Ender Konukoglu

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention.…

Computation and Language · Computer Science 2016-08-10 Baskaran Sankaran , Haitao Mi , Yaser Al-Onaizan , Abe Ittycheriah

In this paper, a new model-free anomaly detection framework is proposed for time-series induced by industrial dynamical systems.The framework lies in the category of conventional approaches which enable appealing features such as a learning…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Mazen Alamir , Raphaël Dion

In this paper, we introduce Masked Feature Modelling (MFM), a novel approach for the unsupervised pre-training of a Graph Attention Network (GAT) block. MFM utilizes a pretrained Visual Tokenizer to reconstruct masked features of objects…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Dimitrios Daskalakis , Nikolaos Gkalelis , Vasileios Mezaris

Despite recent progress in time-series foundation models, challenges persist in improving representation learning and adapting to diverse downstream tasks. We introduce a General Time-series Model (GTM), which advances representation…

Machine Learning · Computer Science 2026-03-13 Cheng He , Xu Huang , Gangwei Jiang , Zhaoyi Li , Defu Lian , Hong Xie , Enhong Chen , Xijie Liang , Zengrong Zheng , Patrick P. C. Lee

Achieving resilient and high-quality manufacturing requires reliable data-driven anomaly detection methods that are capable of addressing differences in behaviors among different individual machines which are nominally the same and are…

Machine Learning · Computer Science 2026-04-08 Yangmeng Li , Kei Sano , Toshihiro Kitao , Ryoji Anzaki , Yukiya Saitoh , Hironori Moki , Dragan Djurdjanovic

Traditional three-dimensional magnetotelluric (MT) numerical forward modeling methods, such as the finite element method (FEM) and finite volume method (FVM), suffer from high computational costs and low efficiency due to limitations in…

Machine Learning · Computer Science 2025-03-17 Xin Zhong , Weiwei Ling , Kejia Pan , Pinxia Wu , Jiajing Zhang , Zhiliang Zhan , Wenbo Xiao