English
Related papers

Related papers: Self-Supervised Transformer for Sparse and Irregul…

200 papers

In this work, we investigate unsupervised representation learning on medical time series, which bears the promise of leveraging copious amounts of existing unlabeled data in order to eventually assist clinical decision making. By evaluating…

Machine Learning · Computer Science 2018-12-04 Xinrui Lyu , Matthias Hueser , Stephanie L. Hyland , George Zerveas , Gunnar Raetsch

Multivariate time series modeling and prediction problems are abundant in many machine learning application domains. Accurate interpretation of such prediction outcomes from a machine learning model that explicitly captures temporal…

Machine Learning · Computer Science 2020-10-27 Tryambak Gangopadhyay , Sin Yong Tan , Zhanhong Jiang , Rui Meng , Soumik Sarkar

The accurate prediction of survival times for patients with severe diseases remains a critical challenge despite recent advances in artificial intelligence. This study introduces "SurvTimeSurvival: Survival Analysis On Patients With…

Machine Learning · Computer Science 2023-11-17 Hung Le , Ong Eng-Jon , Bober Miroslaw

Efficient anomaly detection and diagnosis in multivariate time-series data is of great importance for modern industrial applications. However, building a system that is able to quickly and accurately pinpoint anomalous observations is a…

Machine Learning · Computer Science 2022-05-17 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

Multivariate time series anomaly detection (MTSAD) aims to accurately identify and localize complex abnormal patterns in the large-scale industrial control systems. While existing approaches excel in recognizing the distinct patterns under…

Machine Learning · Computer Science 2025-12-17 Xuechun Liu , Heli Sun , Xuecheng Wu , Ruichen Cao , Yunyun Shi , Dingkang Yang , Haoran Li

Real-world multivariate time series anomalies are rare and often unlabeled. Additionally, prevailing methods rely on increasingly complex architectures tuned to benchmarks, detecting only fragments of anomalous segments and overstating…

Machine Learning · Computer Science 2025-10-21 Dongchan Cho , Jiho Han , Keumyeong Kang , Minsang Kim , Honggyu Ryu , Namsoon Jung

Medical time series are often irregular and face significant missingness, posing challenges for data analysis and clinical decision-making. Existing methods typically adopt a single modeling perspective, either treating series data as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Liuqing Chen , Shuhong Xiao , Shixian Ding , Shanhai Hu , Lingyun Sun

Accurate detection and diagnosis of abnormal behaviors such as network attacks from multivariate time series (MTS) are crucial for ensuring the stable and effective operation of industrial cyber-physical systems (CPS). However, existing…

Machine Learning · Computer Science 2024-03-06 Haili Sun , Yan Huang , Lansheng Han , Cai Fu , Chunjie Zhou

Time series analysis remains a major challenge due to its sparse characteristics, high dimensionality, and inconsistent data quality. Recent advancements in transformer-based techniques have enhanced capabilities in forecasting and…

Machine Learning · Computer Science 2024-05-29 Robert Leppich , Vanessa Borst , Veronika Lesch , Samuel Kounev

We introduce Contrastive Multivariate Singular Spectrum Analysis, a novel unsupervised method for dimensionality reduction and signal decomposition of time series data. By utilizing an appropriate background dataset, the method transforms a…

Machine Learning · Statistics 2018-11-01 Abdi-Hakin Dirie , Abubakar Abid , James Zou

Irregular multivariate time series (IMTS) are prevalent in real-world applications across many fields, where varying sensor frequencies and asynchronous measurements pose significant modeling challenges. Existing solutions often rely on a…

Machine Learning · Computer Science 2025-05-08 Yulong Wang , Xiaofeng Hu , Xiaojian Cui , Kai Wang

Interpretable classification of time series presents significant challenges in high dimensions. Traditional feature selection methods in the frequency domain often assume sparsity in spectral density matrices (SDMs) or their inverses, which…

Machine Learning · Statistics 2024-08-19 Sarbojit Roy , Malik Shahid Sultan , Hernando Ombao

Self-supervised learning (SSL) has driven impressive advances in speech processing by adopting time-domain prediction objectives, while audio representation learning frameworks operate on time-frequency spectrograms. Models optimized for…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-09 Ameenudeen P E , Charumathi Narayanan , Sriram Ganapathy

Limited availability of labeled physiological data often prohibits the use of powerful supervised deep learning models in the biomedical machine intelligence domain. We approach this problem and propose a novel encoding framework that…

Machine Learning · Computer Science 2023-06-13 Philipp Hallgarten , David Bethge , Ozan Özdenizci , Tobias Grosse-Puppendahl , Enkelejda Kasneci

Time series are ubiquitous and therefore inherently hard to analyze and ultimately to label or cluster. With the rise of the Internet of Things (IoT) and its smart devices, data is collected in large amounts any given second. The collected…

Machine Learning · Computer Science 2022-07-14 Padraig Davidson , Michael Steininger , André Huhn , Anna Krause , Andreas Hotho

The ubiquity of dynamic data in domains such as weather, healthcare, and energy underscores a growing need for effective interpretation and retrieval of time-series data. These data are inherently tied to domain-specific contexts, such as…

Machine Learning · Computer Science 2026-02-03 Jialin Chen , Ziyu Zhao , Gaukhar Nurbek , Aosong Feng , Ali Maatouk , Leandros Tassiulas , Yifeng Gao , Rex Ying

Self-supervised learning has been shown to be very effective in learning useful representations, and yet much of the success is achieved in data types such as images, audio, and text. The success is mainly enabled by taking advantage of…

Machine Learning · Computer Science 2021-10-28 Talip Ucar , Ehsan Hajiramezanali , Lindsay Edwards

Transformer-based models have become state-of-the-art tools in various machine learning tasks, including time series classification, yet their complexity makes understanding their internal decision-making challenging. Existing…

Machine Learning · Computer Science 2025-11-27 Matīss Kalnāre , Sofoklis Kitharidis , Thomas Bäck , Niki van Stein

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

Time-series data is generated ubiquitously from Internet-of-Things (IoT) infrastructure, connected and wearable devices, remote sensing, autonomous driving research and, audio-video communications, in enormous volumes. This paper…

Machine Learning · Computer Science 2021-11-22 Gaurangi Anand , Richi Nayak