English
Related papers

Related papers: Self-Supervised Transformer for Sparse and Irregul…

200 papers

Multivariate time series (MTS) classification is widely applied in fields such as industry, healthcare, and finance, aiming to extract key features from complex time series data for accurate decision-making and prediction. However, existing…

Machine Learning · Computer Science 2025-06-19 Mingsen Du , Meng Chen , Yongjian Li , Cun Ji , Shoushui Wei

Machine learning has emerged as a powerful tool for time series analysis. Existing methods are usually customized for different analysis tasks and face challenges in tackling practical problems such as partial labeling and domain shift. To…

Machine Learning · Computer Science 2024-08-20 Zhiyu Liang , Chen Liang , Zheng Liang , Hongzhi Wang , Bo Zheng

Representation learning plays a critical role in the analysis of time series data and has high practical value across a wide range of applications. including trend analysis, time series data retrieval and forecasting. In practice, data…

Machine Learning · Computer Science 2023-12-13 Chengyang Ye , Qiang Ma

In medicine, survival analysis studies the time duration to events of interest such as mortality. One major challenge is how to deal with multiple competing events (e.g., multiple disease diagnoses). In this work, we propose a…

Machine Learning · Computer Science 2022-06-29 Zifeng Wang , Jimeng Sun

Multivariate time series classification is a crucial task in data mining, attracting growing research interest due to its broad applications. While many existing methods focus on discovering discriminative patterns in time series,…

Machine Learning · Computer Science 2024-12-24 Wenjie Xi , Rundong Zuo , Alejandro Alvarez , Jie Zhang , Byron Choi , Jessica Lin

We propose an efficient design of Transformer-based models for multivariate time series forecasting and self-supervised representation learning. It is based on two key components: (i) segmentation of time series into subseries-level patches…

Machine Learning · Computer Science 2023-03-07 Yuqi Nie , Nam H. Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

The supervised learning paradigm is limited by the cost - and sometimes the impracticality - of data collection and labeling in multiple domains. Self-supervised learning, a paradigm which exploits the structure of unlabeled data to create…

Time series analysis has gained significant attention due to its critical applications in diverse fields such as healthcare, finance, and sensor networks. The complexity and non-stationarity of time series make it challenging to capture the…

Machine Learning · Computer Science 2024-10-31 Guancen Lin , Cong Shen , Aijing Lin

Irregularly sampled time series (ISTS) data has irregular temporal intervals between observations and different sampling rates between sequences. ISTS commonly appears in healthcare, economics, and geoscience. Especially in the medical…

Machine Learning · Computer Science 2020-10-27 Chenxi Sun , Shenda Hong , Moxian Song , Hongyan Li

Conventional time series classification approaches based on bags of patterns or shapelets face significant challenges in dealing with a vast amount of feature candidates from high-dimensional multivariate data. In contrast, deep neural…

Machine Learning · Computer Science 2023-06-07 Raneen Younis , Abdul Hakmeh , Zahra Ahmadi

Event time series are sequences of discrete events occurring at irregular time intervals, each associated with a domain-specific observational modality. They are common in domains such as high-energy astrophysics, computational social…

Machine Learning · Computer Science 2025-10-14 Steven Dillmann , Juan Rafael Martínez-Galarza

Unsupervised Domain Adaptation (UDA) leverages labeled source data to train models for unlabeled target data. Given the prevalence of multivariate time series (MTS) data across various domains, the UDA task for MTS classification has…

Machine Learning · Computer Science 2025-04-08 Xiao Lin , Zhichen Zeng , Tianxin Wei , Zhining Liu , Yuzhong chen , Hanghang Tong

Linear Dynamical System (LDS) is an elegant mathematical framework for modeling and learning multivariate time series. However, in general, it is difficult to set the dimension of its hidden state space. A small number of hidden states may…

Artificial Intelligence · Computer Science 2013-12-04 Zitao Liu , Milos Hauskrecht

Learning compressed representations of multivariate time series (MTS) facilitates data analysis in the presence of noise and redundant information, and for a large number of variates and time steps. However, classical dimensionality…

Neural and Evolutionary Computing · Computer Science 2019-07-17 Filippo Maria Bianchi , Lorenzo Livi , Karl Øyvind Mikalsen , Michael Kampffmeyer , Robert Jenssen

Trajectory Representation Learning (TRL) is a powerful tool for spatial-temporal data analysis and management. TRL aims to convert complicated raw trajectories into low-dimensional representation vectors, which can be applied to various…

Machine Learning · Computer Science 2024-03-08 Jiawei Jiang , Dayan Pan , Houxing Ren , Xiaohan Jiang , Chao Li , Jingyuan Wang

Learning transferable representations from unlabeled time series is crucial for improving performance in data-scarce classification. Existing self-supervised methods often operate at the point level and rely on unidirectional encoding,…

Machine Learning · Computer Science 2026-03-02 Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Qi Liu , Hao Zhang , Rujiao Zhang , Enhong Chen

Deep models for Multivariate Time Series (MTS) forecasting have recently demonstrated significant success. Channel-dependent models capture complex dependencies that channel-independent models cannot capture. However, the number of channels…

Machine Learning · Computer Science 2024-08-09 Xin Zhou , Weiqing Wang , Wray Buntine , Shilin Qu , Abishek Sriramulu , Weicong Tan , Christoph Bergmeir

Missing data in time series is a pervasive problem that puts obstacles in the way of advanced analysis. A popular solution is imputation, where the fundamental challenge is to determine what values should be filled in. This paper proposes…

Machine Learning · Computer Science 2023-07-06 Wenjie Du , David Cote , Yan Liu

In this work, we tackle two widespread challenges in real applications for time-series forecasting that have been largely understudied: distribution shifts and missing data. We propose SpectraNet, a novel multivariate time-series…

Machine Learning · Computer Science 2022-10-26 Cristian Challu , Peihong Jiang , Ying Nian Wu , Laurent Callot

Self-supervision is one of the hallmarks of representation learning in the increasingly popular suite of foundation models including large language models such as BERT and GPT-3, but it has not been pursued in the context of multivariate…

Machine Learning · Computer Science 2024-02-05 Xiao Shou , Dharmashankar Subramanian , Debarun Bhattacharjya , Tian Gao , Kristin P. Bennet