English
Related papers

Related papers: Time-Series Representation Learning via Temporal a…

200 papers

We introduce the Temporal Contrastive Transformer (TCT), a representation learning framework designed to capture contextual temporal dynamics in sequences of financial transactions. The model is trained using a self-supervised contrastive…

Machine Learning · Computer Science 2026-05-22 Danny Butvinik , Yonit Marcus , Nitzan Tal , Gabrielle Azoulay

Self-supervised learning achieves superior performance in many domains by extracting useful representations from the unlabeled data. However, most of traditional self-supervised methods mainly focus on exploring the inter-sample structure…

Machine Learning · Computer Science 2020-11-30 Haoyi Fan , Fengbin Zhang , Yue Gao

Unsupervised clustering of temporal data is both challenging and crucial in machine learning. In this paper, we show that neither traditional clustering methods, time series specific or even deep learning-based alternatives generalise well…

Machine Learning · Computer Science 2020-10-13 Nuno Mota Goncalves , Ioana Giurgiu , Anika Schumann

Unsupervised domain adaptation (UDA) aims at learning a machine learning model using a labeled source domain that performs well on a similar yet different, unlabeled target domain. UDA is important in many applications such as medicine,…

Machine Learning · Computer Science 2023-02-08 Yilmazcan Ozyurt , Stefan Feuerriegel , Ce Zhang

Contrastive learning has shown to be effective to learn representations from time series in a self-supervised way. However, contrasting similar time series instances or values from adjacent timestamps within a time series leads to ignore…

Machine Learning · Computer Science 2026-01-15 Seunghan Lee , Taeyoung Park , Kibok Lee

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

Machine Learning · Statistics 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios. Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an…

Machine Learning · Computer Science 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi

Learning representation from unlabeled time series data is a challenging problem. Most existing self-supervised and unsupervised approaches in the time-series domain do not capture low and high-frequency features at the same time. Further,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Vandan Gorade , Azad Singh , Deepak Mishra

We study time-series classification (TSC), a fundamental task of time-series data mining. Prior work has approached TSC from two major directions: (1) similarity-based methods that classify time-series based on the nearest neighbors, and…

Machine Learning · Computer Science 2022-01-07 Daochen Zha , Kwei-Herng Lai , Kaixiong Zhou , Xia Hu

Person re-identification (re-id) aims to match the same person from images taken across multiple cameras. Most existing person re-id methods generally require a large amount of identity labeled data to act as discriminative guideline for…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Usman Ali , Bayram Bayramli , Hongtao Lu

The widespread availability of complex time series data in various domains such as environmental science, epidemiology, and economics demands robust causal discovery methods that can identify intricate contemporaneous and lagged…

Machine Learning · Computer Science 2026-05-12 Omar Faruque , Sahara Ali , Xue Zheng , Jianwu Wang

Multivariate time series present challenges to standard machine learning techniques, as they are often unlabeled, high dimensional, noisy, and contain missing data. To address this, we propose T-Rep, a self-supervised method to learn time…

Machine Learning · Computer Science 2024-05-10 Archibald Fraikin , Adrien Bennetot , Stéphanie Allassonnière

Current state-of-the-art classification and detection algorithms rely on supervised training. In this work we study unsupervised feature learning in the context of temporally coherent video data. We focus on feature learning from unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2015-04-17 Ross Goroshin , Joan Bruna , Jonathan Tompson , David Eigen , Yann LeCun

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

Machine Learning · Computer Science 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

In this work, we investigate unsupervised representation learning on medical time series, which bears the promise of leveraging copious amounts of existing unlabeled data in order to eventually assist clinical decision making. By evaluating…

Machine Learning · Computer Science 2018-12-04 Xinrui Lyu , Matthias Hueser , Stephanie L. Hyland , George Zerveas , Gunnar Raetsch

The instance discrimination paradigm has become dominant in unsupervised learning. It always adopts a teacher-student framework, in which the teacher provides embedded knowledge as a supervision signal for the student. The student learns…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Weixin Feng , Yuanjiang Wang , Lihua Ma , Ye Yuan , Chi Zhang

We introduce a novel self-supervised contrastive learning method to learn representations from unlabelled videos. Existing approaches ignore the specifics of input distortions, e.g., by learning invariance to temporal transformations.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Simon Jenni , Hailin Jin

In low-level video analyses, effective representations are important to derive the correspondences between video frames. These representations have been learned in a self-supervised fashion from unlabeled images or videos, using carefully…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Rui Li , Dong Liu

Representation learning for time series using contrastive learning has emerged as a critical technique for improving the performance of downstream tasks. To advance this effective approach, we introduce CaTT (\textit{Contrast All The…

Machine Learning · Computer Science 2025-07-16 Abdul-Kazeem Shamba , Kerstin Bach , Gavin Taylor

We present a novel technique for self-supervised video representation learning by: (a) decoupling the learning objective into two contrastive subtasks respectively emphasizing spatial and temporal features, and (b) performing it…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Zehua Zhang , David Crandall