English
Related papers

Related papers: Self-Supervised Transformer for Sparse and Irregul…

200 papers

Multivariate time series (MTS) are ubiquitous in domains such as healthcare, climate science, and industrial monitoring, but their high dimensionality, limited labeled data, and non-stationary nature pose significant challenges for…

Machine Learning · Computer Science 2025-09-09 Jia Wang , Xiao Wang , Chi Zhang

Self-supervised representation learning of Multivariate Time Series (MTS) is a challenging task and attracts increasing research interests in recent years. Many previous works focus on the pretext task of self-supervised learning and…

Machine Learning · Computer Science 2022-03-10 Yijiang Chen , Xiangdong Zhou , Zhen Xing , Zhidan Liu , Minyang Xu

Unsupervised/self-supervised representation learning in time series is critical since labeled samples are usually scarce in real-world scenarios. Existing approaches mainly leverage the contrastive learning framework, which automatically…

Machine Learning · Computer Science 2023-07-10 Wenrui Zhang , Ling Yang , Shijia Geng , Shenda Hong

Self-supervised learning has garnered increasing attention in time series analysis for benefiting various downstream tasks and reducing reliance on labeled data. Despite its effectiveness, existing methods often struggle to comprehensively…

Machine Learning · Computer Science 2025-06-12 Daoyu Wang , Mingyue Cheng , Zhiding Liu , Qi Liu

Multivariate time-series data in fields like healthcare and industry are informative but challenging due to high dimensionality and lack of labels. Recent self-supervised learning methods excel in learning rich representations without…

Machine Learning · Computer Science 2024-10-22 Ching Chang , Chiao-Tung Chan , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Finding effective representations for time series data is a useful but challenging task. Several works utilize self-supervised or unsupervised learning methods to address this. However, there still remains the open question of how to…

Machine Learning · Computer Science 2024-03-19 Yuansan Liu , Sudanthi Wijewickrema , Christofer Bester , Stephen O'Leary , James Bailey

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

Machine Learning · Computer Science 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das

A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are…

Machine Learning · Computer Science 2022-08-22 William T. Ng , K. Siu , Albert C. Cheung , Michael K. Ng

Multivariate time-series data in numerous real-world applications (e.g., healthcare and industry) are informative but challenging due to the lack of labels and high dimensionality. Recent studies in self-supervised learning have shown their…

Machine Learning · Computer Science 2024-07-18 Ching Chang , Chiao-Tung Chan , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Time series data often contain latent temporal structure, transitions between locally stationary regimes, repeated motifs, and bursts of variability, that are rarely leveraged in standard representation learning pipelines. Existing models…

Machine Learning · Computer Science 2025-10-13 Disharee Bhowmick , Ranjith Ramanathan , Sathyanarayanan N. Aakur

Learning from Multivariate Time Series (MTS) has attracted widespread attention in recent years. In particular, label shortage is a real challenge for the classification task on MTS, considering its complex dimensional and sequential data…

Machine Learning · Computer Science 2021-10-12 Jingwei Zuo , Karine Zeitouni , Yehia Taher

Time series constitute a challenging data type for machine learning algorithms, due to their highly variable lengths and sparse labeling in practice. In this paper, we tackle this challenge by proposing an unsupervised method to learn…

Machine Learning · Computer Science 2020-01-06 Jean-Yves Franceschi , Aymeric Dieuleveut , Martin Jaggi

Accurate medical time series (MedTS) classification is essential for effective clinical diagnosis, yet remains challenging due to complex multi-channel temporal dependencies, information redundancy, and label scarcity. While…

Machine Learning · Computer Science 2025-08-19 Jiexia Ye , Weiqi Zhang , Ziyue Li , Jia Li , Fugee Tsung

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

Time-series classification is one of the most frequently performed tasks in industrial data science, and one of the most widely used data representation in the industrial setting is tabular representation. In this work, we propose a novel…

Machine Learning · Computer Science 2021-10-06 Sharath M Shankaranarayana , Davor Runje

Multivariate time series (MTS) data are becoming increasingly ubiquitous in diverse domains, e.g., IoT systems, health informatics, and 5G networks. To obtain an effective representation of MTS data, it is not only essential to consider…

Machine Learning · Computer Science 2020-10-06 Yang Jiao , Kai Yang , Shaoyu Dou , Pan Luo , Sijia Liu , Dongjin Song

In many domains, such as healthcare, time-series data is often irregularly sampled with varying intervals between observations. This poses challenges for classical time-series models that require equally spaced data. To address this, we…

Machine Learning · Computer Science 2024-10-04 Ziyang Song , Qingcheng Lu , He Zhu , David Buckeridge , Yue Li

Multivariate time series (MTS) data, when sampled irregularly and asynchronously, often present extensive missing values. Conventional methodologies for MTS analysis tend to rely on temporal embeddings based on timestamps that necessitate…

Machine Learning · Computer Science 2024-05-28 Chun-Kai Huang , Yi-Hsien Hsieh , Ta-Jung Chien , Li-Cheng Chien , Shao-Hua Sun , Tung-Hung Su , Jia-Horng Kao , Che Lin

Unsupervised representation learning approaches aim to learn discriminative feature representations from unlabeled data, without the requirement of annotating every sample. Enabling unsupervised representation learning is extremely crucial…

Machine Learning · Computer Science 2023-08-04 Qianwen Meng , Hangwei Qian , Yong Liu , Yonghui Xu , Zhiqi Shen , Lizhen Cui

Recent advances in deep forecasting models have achieved remarkable performance, yet most approaches still struggle to provide both accurate predictions and interpretable insights into temporal dynamics. This paper proposes CaReTS, a novel…

Machine Learning · Computer Science 2025-11-14 Fulong Yao , Wanqing Zhao , Chao Zheng , Xiaofei Han
‹ Prev 1 2 3 10 Next ›