English
Related papers

Related papers: TS2Vec: Towards Universal Representation of Time S…

200 papers

Relationships in scientific data, such as the numerical and spatial distribution relations of features in univariate data, the scalar-value combinations' relations in multivariate data, and the association of volumes in time-varying and…

Machine Learning · Computer Science 2022-07-25 Xiangyang He , Yubo Tao , Shuoliu Yang , Haoran Dai , Hai Lin

Neural networks have been shown to be an effective tool for learning algorithms over graph-structured data. However, graph representation techniques---that convert graphs to real-valued vectors for use with neural networks---are still in…

Machine Learning · Computer Science 2018-10-10 Shaileshh Bojja Venkatakrishnan , Mohammad Alizadeh , Pramod Viswanath

In this work, we focus on robust time series representation learning. Our assumption is that real-world time series is noisy and complementary information from different views of the same time series plays an important role while analyzing…

Machine Learning · Computer Science 2023-08-25 Weiqi Zhang , Jianfeng Zhang , Jia Li , Fugee Tsung

Deep learning has made significant advances in creating efficient representations of time series data by automatically identifying complex patterns. However, these approaches lack interpretability, as the time series is transformed into a…

Machine Learning · Computer Science 2023-10-26 Etienne Le Naour , Ghislain Agoua , Nicolas Baskiotis , Vincent Guigue

Representation learning for time series using contrastive learning has emerged as a critical technique for improving the performance of downstream tasks. To advance this effective approach, we introduce CaTT (\textit{Contrast All The…

Machine Learning · Computer Science 2025-07-16 Abdul-Kazeem Shamba , Kerstin Bach , Gavin Taylor

We propose TimeHUT, a novel method for learning time-series representations by hierarchical uniformity-tolerance balancing of contrastive representations. Our method uses two distinct losses to learn strong representations with the aim of…

Machine Learning · Computer Science 2025-10-06 Amin Jalali , Milad Soltany , Michael Greenspan , Ali Etemad

In this work, we investigate the time series representation learning problem using self-supervised techniques. Contrastive learning is well-known in this area as it is a powerful method for extracting information from the series and…

Machine Learning · Computer Science 2024-10-08 Duy A. Nguyen , Trang H. Tran , Huy Hieu Pham , Phi Le Nguyen , Lam M. Nguyen

We introduce a temporal feature encoding architecture called Time Series Representation Model (TSRM) for multivariate time series forecasting and imputation. The architecture is structured around CNN-based representation layers, each…

Machine Learning · Computer Science 2025-04-29 Robert Leppich , Michael Stenger , Daniel Grillmeyer , Vanessa Borst , Samuel Kounev

The core challenge in unsupervised anomaly detection is identifying abnormal patterns without prior knowledge of their characteristics. While existing methods have addressed aspects of this problem, they often struggle to learn a robust…

Machine Learning · Computer Science 2026-05-12 Prithul Sarker , Sushmita Sarker , Nicholas G. Murray , Alireza Tavakkoli

Time series data, characterized by its intrinsic long and short-range dependencies, poses a unique challenge across analytical applications. While Transformer-based models excel at capturing long-range dependencies, they face limitations in…

Machine Learning · Computer Science 2024-05-07 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Xiaoli Li

We study the use of a time series encoder to learn representations that are useful on data set types with which it has not been trained on. The encoder is formed of a convolutional neural network whose temporal output is summarized by a…

Machine Learning · Computer Science 2018-05-11 Joan Serrà , Santiago Pascual , Alexandros Karatzoglou

Time Series Anomaly Detection (TSAD) is essential for uncovering rare and potentially harmful events in unlabeled time series data. Existing methods are highly dependent on clean, high-quality inputs, making them susceptible to noise and…

Machine Learning · Computer Science 2025-04-04 Sinchee Chin , Fan Zhang , Xiaochen Yang , Jing-Hao Xue , Wenming Yang , Peng Jia , Guijin Wang , Luo Yingqun

Time-series classification is one of the most frequently performed tasks in industrial data science, and one of the most widely used data representation in the industrial setting is tabular representation. In this work, we propose a novel…

Machine Learning · Computer Science 2021-10-06 Sharath M Shankaranarayana , Davor Runje

Self-supervised learning has seen great success recently in unsupervised representation learning, enabling breakthroughs in natural language and image processing. However, these methods often rely on autoregressive and masked modeling,…

Machine Learning · Computer Science 2025-10-01 Sofiane Ennadir , Siavash Golkar , Leopoldo Sarra

Unsupervised domain adaptation (UDA) aims at learning a machine learning model using a labeled source domain that performs well on a similar yet different, unlabeled target domain. UDA is important in many applications such as medicine,…

Machine Learning · Computer Science 2023-02-08 Yilmazcan Ozyurt , Stefan Feuerriegel , Ce Zhang

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

Machine Learning · Computer Science 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

Contrastive learning has shown to be effective to learn representations from time series in a self-supervised way. However, contrasting similar time series instances or values from adjacent timestamps within a time series leads to ignore…

Machine Learning · Computer Science 2026-01-15 Seunghan Lee , Taeyoung Park , Kibok Lee

Time series analysis remains a major challenge due to its sparse characteristics, high dimensionality, and inconsistent data quality. Recent advancements in transformer-based techniques have enhanced capabilities in forecasting and…

Machine Learning · Computer Science 2024-05-29 Robert Leppich , Vanessa Borst , Veronika Lesch , Samuel Kounev

Labeling of multivariate biomedical time series data is a laborious and expensive process. Self-supervised contrastive learning alleviates the need for large, labeled datasets through pretraining on unlabeled data. However, for multivariate…

Machine Learning · Statistics 2023-07-21 Thea Brüsch , Mikkel N. Schmidt , Tommy S. Alstrøm

Unsupervised/self-supervised representation learning in time series is critical since labeled samples are usually scarce in real-world scenarios. Existing approaches mainly leverage the contrastive learning framework, which automatically…

Machine Learning · Computer Science 2023-07-10 Wenrui Zhang , Ling Yang , Shijia Geng , Shenda Hong