English
Related papers

Related papers: STAR: Boosting Time Series Foundation Models for A…

200 papers

Foundation models (FMs) have transformed natural language processing, but their success has not yet translated to time series forecasting. Existing time series foundation models (TSFMs), often based on transformer variants, struggle with…

Machine Learning · Computer Science 2025-08-20 Lars Graf , Thomas Ortner , Stanisław Woźniak , Angeliki Pantazi

Self-Taught Reasoners (STaR), synonymously known as Rejection sampling Fine-Tuning (RFT), is an integral part of the training pipeline of self-improving reasoning Language Models (LMs). The self-improving mechanism often employs random…

Machine Learning · Computer Science 2025-10-07 Woosung Koh , Wonbeen Oh , Jaein Jang , MinHyung Lee , Hyeongjin Kim , Ah Yeon Kim , Joonkee Kim , Junghyun Lee , Taehyeon Kim , Se-Young Yun

Recent advances in digitization have led to the availability of multivariate time series data in various domains, enabling real-time monitoring of operations. Identifying abnormal data patterns and detecting potential failures in these…

Machine Learning · Computer Science 2023-10-10 Fan Wang , Keli Wang , Boyu Yao

Large language models (LLMs) rely on self-attention for contextual understanding, demanding high-throughput inference and large-scale token parallelism (LTPP). Existing dynamic sparsity accelerators falter under LTPP scenarios due to…

Hardware Architecture · Computer Science 2025-12-25 Huizheng Wang , Taiquan Wei , Hongbin Wang , Zichuan Wang , Xinru Tang , Zhiheng Yue , Shaojun Wei , Yang Hu , Shouyi Yin

The surge in real-time data collection across various industries has underscored the need for advanced anomaly detection in both univariate and multivariate time series data. This paper introduces TransNAS-TSAD, a framework that synergizes…

Machine Learning · Computer Science 2024-03-06 Ijaz Ul Haq , Byung Suk Lee , Donna M. Rizzo

Anomaly detection in Industrial Internet of Things (IIoT) environments is essential to protect the Industrial Control Systems (ICS) and Cyber-Physical Systems (CPS) from occuring run time false data injection and other malicious attacks.…

Machine Learning · Computer Science 2026-05-26 Rai Ali Yar , Umaisa Lail , Anwar Shah

This study proposes an anomaly detection method based on the Transformer architecture with integrated multiscale feature perception, aiming to address the limitations of temporal modeling and scale-aware feature representation in cloud…

Machine Learning · Computer Science 2025-08-26 Lian Lian , Yilin Li , Song Han , Renzi Meng , Sibo Wang , Ming Wang

Problem of adaptive state observer synthesis for linear time-varying (LTV) system with unknown time-varying parameter and delayed output measurements is considered. State observation problem has attracted the attention of many researchers…

Dynamical Systems · Mathematics 2022-07-26 Alexey Bobtsov , Nikolay Nikolaev , Olga Slita , Olga Kozachek

Model merging is an efficient way of obtaining a multi-task model from several pretrained models without further fine-tuning, and it has gained attention in various domains, including natural language processing (NLP). Despite the…

Computation and Language · Computer Science 2025-02-17 Yu-Ang Lee , Ching-Yun Ko , Tejaswini Pedapati , I-Hsin Chung , Mi-Yen Yeh , Pin-Yu Chen

Multimodal time series (MTS) anomaly detection is crucial for maintaining the safety and stability of working devices (e.g., water treatment system and spacecraft), whose data are characterized by multivariate time series with diverse…

Machine Learning · Computer Science 2023-10-18 Chaoyue Ding , Shiliang Sun , Jing Zhao

Time series anomaly detection plays a crucial role in a wide range of fields, such as healthcare and internet traffic monitoring. The emergence of large language models (LLMs) offers new opportunities for detecting anomalies in the…

Machine Learning · Computer Science 2025-10-07 Hanzhe Wei , Jiajun Wu , Jialin Yang , Henry Leung , Steve Drew

For modern industrial applications, accurately detecting and diagnosing anomalies in multivariate time series data is essential. Despite such need, most state-of-the-art methods often prioritize detection performance over model…

Machine Learning · Computer Science 2024-10-31 Minha Kim , Kishor Kumar Bhaumik , Amin Ahsan Ali , Simon S. Woo

Distribution shifts between training and test data are inevitable over the lifecycle of a deployed model, leading to performance decay. Adapting a model on test samples can help mitigate this drop in performance. However, most test-time…

Machine Learning · Computer Science 2025-11-18 Mona Schirmer , Dan Zhang , Eric Nalisnick

In this paper, we aim to improve multivariate anomaly detection (AD) by modeling the \textit{time-varying non-linear spatio-temporal correlations} found in multivariate time series data . In multivariate time series data, an anomaly may be…

Machine Learning · Computer Science 2025-09-19 Padmaksha Roy , Almuatazbellah Boker , Lamine Mili

Fault diagnosis in multimode processes plays a critical role in ensuring the safe operation of industrial systems across multiple modes. It faces a great challenge yet to be addressed - that is, the significant distributional differences…

Machine Learning · Computer Science 2025-07-24 Guangqiang Li , M. Amine Atoui , Xiangshun Li

Multivariate time series forecasting plays a crucial role in various fields such as finance, traffic management, energy, and healthcare. Recent studies have highlighted the advantages of channel independence to resist distribution drift but…

Machine Learning · Computer Science 2024-11-19 Lu Han , Xu-Yang Chen , Han-Jia Ye , De-Chuan Zhan

Spatio-Temporal Multivariate time series Forecast (STMF) uses the time series of $n$ spatially distributed variables in a period of recent past to forecast their values in a period of near future. It has important applications in…

Machine Learning · Computer Science 2025-10-29 Zibo Liu , Zhe Jiang , Zelin Xu , Tingsong Xiao , Yupu Zhang , Zhengkun Xiao , Haibo Wang , Shigang Chen

Time series anomaly detection (TSAD) is becoming increasingly vital due to the rapid growth of time series data across various sectors. Anomalies in web service data, for example, can signal critical incidents such as system failures or…

Machine Learning · Computer Science 2024-11-06 Jiaxin Zhuang , Leon Yan , Zhenwei Zhang , Ruiqi Wang , Jiawei Zhang , Yuantao Gu

Time-of-flight (ToF) distance measurement devices such as ultrasonics, LiDAR and radar are widely used in autonomous vehicles for environmental perception, navigation and assisted braking control. Despite their relative importance in making…

Systems and Control · Electrical Eng. & Systems 2022-12-16 Martin Higgins , Devki Jha , David Wallom

Multivariate time series modeling and prediction problems are abundant in many machine learning application domains. Accurate interpretation of such prediction outcomes from a machine learning model that explicitly captures temporal…

Machine Learning · Computer Science 2020-10-27 Tryambak Gangopadhyay , Sin Yong Tan , Zhanhong Jiang , Rui Meng , Soumik Sarkar