English
Related papers

Related papers: Unsupervised Time-Series Representation Learning w…

200 papers

Time series analysis faces significant challenges in handling variable-length data and achieving robust generalization. While Transformer-based models have advanced time series tasks, they often struggle with feature redundancy and limited…

Machine Learning · Computer Science 2025-09-23 Kai Zhang , Siming Sun , Zhengyu Fan , Qinmin Yang , Xuejun Jiang

Recent advances in supervised deep learning methods are enabling remote measurements of photoplethysmography-based physiological signals using facial videos. The performance of these supervised methods, however, are dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Hao Wang , Euijoon Ahn , Jinman Kim

Self-supervised learning (SSL) has emerged as a powerful paradigm for learning representations without labeled data. Most SSL approaches rely on strong, well-established, handcrafted data augmentations to generate diverse views for…

Machine Learning · Computer Science 2026-01-16 Berken Utku Demirel , Christian Holz

Accurate workload forecasting is critical for efficient resource management in cloud computing systems, enabling effective scheduling and autoscaling. Despite recent advances with transformer-based forecasting models, challenges remain due…

Machine Learning · Computer Science 2024-08-20 Shiyu Wang , Zhixuan Chu , Yinbo Sun , Yu Liu , Yuliang Guo , Yang Chen , Huiyang Jian , Lintao Ma , Xingyu Lu , Jun Zhou

Learning universal time series representations applicable to various types of downstream tasks is challenging but valuable in real applications. Recently, researchers have attempted to leverage the success of self-supervised contrastive…

Machine Learning · Computer Science 2023-12-27 Jiexi Liu , Songcan Chen

As a fundamental data mining task, unsupervised time series anomaly detection (TSAD) aims to build a model for identifying abnormal timestamps without assuming the availability of annotations. A key challenge in unsupervised TSAD is that…

Machine Learning · Computer Science 2026-02-10 Dezheng Wang , Tong Chen , Guansong Pang , Congyan Chen , Shihua Li , Hongzhi Yin

Benefiting from high capacity for capturing complex temporal patterns, deep learning (DL) has significantly advanced time series forecasting (TSF). However, deep models tend to suffer from severe overfitting due to the inherent…

Machine Learning · Computer Science 2025-10-30 Yisong Fu , Zezhi Shao , Chengqing Yu , Yujie Li , Zhulin An , Qi Wang , Yongjun Xu , Fei Wang

Recent unsupervised contrastive representation learning follows a Single Instance Multi-view (SIM) paradigm where positive pairs are usually constructed with intra-image data augmentation. In this paper, we propose an effective approach…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xiangxiang Chu , Xiaohang Zhan , Bo Zhang

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Time series constitute a challenging data type for machine learning algorithms, due to their highly variable lengths and sparse labeling in practice. In this paper, we tackle this challenge by proposing an unsupervised method to learn…

Machine Learning · Computer Science 2020-01-06 Jean-Yves Franceschi , Aymeric Dieuleveut , Martin Jaggi

There have been several recent efforts towards developing representations for multivariate time-series in an unsupervised learning framework. Such representations can prove beneficial in tasks such as activity recognition, health…

Machine Learning · Computer Science 2022-09-23 Yitian Zhang , Florence Regol , Antonios Valkanas , Mark Coates

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

Classification of multi-dimensional time series from real-world systems require fine-grained learning of complex features such as cross-dimensional dependencies and intra-class variations-all under the practical challenge of low training…

Machine Learning · Computer Science 2025-05-16 Anushiya Arunan , Yan Qin , Xiaoli Li , Yuen Chau

Multivariate time series classification (MTSC) plays a crucial role in various domains, including biomedical signal analysis and motion monitoring. However, existing approaches, particularly deep learning models, often require high…

Machine Learning · Computer Science 2026-04-20 Fernando Moro , Vinicius M. A. Souza

Time series (TS) data are ubiquitous across various application areas, rendering time series forecasting (TSF) a fundamental task. With the astounding advances in large language models (LLMs), a variety of methods have been developed to…

Artificial Intelligence · Computer Science 2025-08-25 Zhuomin Chen , Dan Li , Jiahui Zhou , Shunyu Wu , Haozheng Ye , Jian Lou , See-Kiong Ng

Bayesian neural networks (BNNs) have become a principal approach to alleviate overconfident predictions in deep learning, but they often suffer from scaling issues due to a large number of distribution parameters. In this paper, we discover…

Machine Learning · Computer Science 2021-12-14 Shiye Lei , Zhuozhuo Tu , Leszek Rutkowski , Feng Zhou , Li Shen , Fengxiang He , Dacheng Tao

Diffusion models have become a leading paradigm for image super-resolution (SR), but existing methods struggle to guarantee both the high-frequency perceptual quality and the low-frequency structural fidelity of generated images. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Hexin Zhang , Dong Li , Jie Huang , Bingzhou Wang , Xueyang Fu , Zhengjun Zha

Most of the proposed person re-identification algorithms conduct supervised training and testing on single labeled datasets with small size, so directly deploying these trained models to a large-scale real-world camera network may lead to…

Computer Vision and Pattern Recognition · Computer Science 2018-03-21 Jianming Lv , Weihang Chen , Qing Li , Can Yang

Multimodal time series forecasting is crucial in real-world applications, where decisions depend on both numerical data and contextual signals. The core challenge is to effectively combine temporal numerical patterns with the context…

Machine Learning · Computer Science 2026-02-04 Huu Hiep Nguyen , Minh Hoang Nguyen , Dung Nguyen , Hung Le

To deal with the exhausting annotations, self-supervised representation learning from unlabeled point clouds has drawn much attention, especially centered on augmentation-based contrastive methods. However, specific augmentations hardly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zhuheng Lu , Yuewei Dai , Weiqing Li , Zhiyong Su