English
Related papers

Related papers: Time-Series Representation Learning via Temporal a…

200 papers

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hyungtae Lee , Heesung Kwon

Unsupervised/self-supervised time series representation learning is a challenging problem because of its complex dynamics and sparse annotations. Existing works mainly adopt the framework of contrastive learning with the time-based…

Machine Learning · Computer Science 2022-05-31 Ling Yang , Shenda Hong

Learning continuous representations from unlabeled textual data has been increasingly studied for benefiting semi-supervised learning. Although it is relatively easier to interpret discrete representations, due to the difficulty of…

Computation and Language · Computer Science 2020-04-29 Yau-Shian Wang , Hung-Yi Lee , Yun-Nung Chen

In time-series domains where both predictive performance and interpretability are essential, deep neural networks achieve strong results but provide limited insight into how their predictions are made. Projection-based prototype networks…

Machine Learning · Computer Science 2026-05-11 Steven Song , Sahil Sethi , Brett Beaulieu-Jones , Robert L. Grossman

Time-series data exists in every corner of real-world systems and services, ranging from satellites in the sky to wearable devices on human bodies. Learning representations by extracting and inferring valuable information from these time…

Machine Learning · Computer Science 2026-05-19 Patara Trirat , Yooju Shin , Junhyeok Kang , Youngeun Nam , Jihye Na , Minyoung Bae , Joeun Kim , Byunghyun Kim , Jae-Gil Lee

Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aadarsh Sahoo , Rutav Shah , Rameswar Panda , Kate Saenko , Abir Das

In this paper, we tackle the problem of learning visual representations from unlabeled scene-centric data. Existing works have demonstrated the potential of utilizing the underlying complex structure within scene-centric data; still, they…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xin Wen , Bingchen Zhao , Anlin Zheng , Xiangyu Zhang , Xiaojuan Qi

Correlated time series analysis plays an important role in many real-world industries. Learning an efficient representation of this large-scale data for further downstream tasks is necessary but challenging. In this paper, we propose a…

Machine Learning · Computer Science 2023-06-21 Luxuan Wang , Lei Bai , Ziyue Li , Rui Zhao , Fugee Tsung

Contrastive learning is a highly effective method for learning representations from unlabeled data. Recent works show that contrastive representations can transfer across domains, leading to simple state-of-the-art algorithms for…

Machine Learning · Computer Science 2022-05-25 Jeff Z. HaoChen , Colin Wei , Ananya Kumar , Tengyu Ma

Creating separable representations via representation learning and clustering is critical in analyzing large unstructured datasets with only a few labels. Separable representations can lead to supervised models with better classification…

Machine Learning · Computer Science 2022-10-17 Praveen Ravirathinam , Rahul Ghosh , Ke Wang , Keyang Xuan , Ankush Khandelwal , Hilary Dugan , Paul Hanson , Vipin Kumar

A principal barrier to training temporal relation extraction models in new domains is the lack of varied, high quality examples and the challenge of collecting more. We present a method of automatically collecting distantly-supervised…

Computation and Language · Computer Science 2021-09-16 Xinyu Zhao , Shih-ting Lin , Greg Durrett

Time-series analysis plays a pivotal role across a range of critical applications, from finance to healthcare, which involves various tasks, such as forecasting and classification. To handle the inherent complexities of time-series data,…

Machine Learning · Computer Science 2024-05-20 Jiawei Li , Jingshu Peng , Haoyang Li , Lei Chen

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Given the abundance of unlabeled Satellite Image Time Series (SITS) and the scarcity of labeled data, contrastive self-supervised pretraining emerges as a natural tool to leverage this vast quantity of unlabeled data. However, designing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Antoine Saget , Baptiste Lafabregue , Antoine Cornuéjols , Pierre Gançarski

Deep learning has been actively studied for time series forecasting, and the mainstream paradigm is based on the end-to-end training of neural network architectures, ranging from classical LSTM/RNNs to more recent TCNs and Transformers.…

Machine Learning · Computer Science 2022-05-06 Gerald Woo , Chenghao Liu , Doyen Sahoo , Akshat Kumar , Steven Hoi

Time Series Forecasting (TSF) is a crucial task in various domains, yet existing TSF models rely heavily on high-quality data and insufficiently exploit all available data. This paper explores a novel self-supervised approach to re-label…

Machine Learning · Computer Science 2025-12-17 Yuxuan Yang , Dalin Zhang , Yuxuan Liang , Hua Lu , Gang Chen , Huan Li

Recent work has shown the efficiency of deep learning models such as Fully Convolutional Networks (FCN) or Recurrent Neural Networks (RNN) to deal with Time Series Regression (TSR) problems. These models sometimes need a lot of data to be…

Machine Learning · Computer Science 2021-11-03 Sebastian Pineda Arango , Felix Heinrich , Kiran Madhusudhanan , Lars Schmidt-Thieme

Multimodal acoustic event classification plays a key role in audio-visual systems. Although combining audio and visual signals improves recognition, it is still difficult to align them over time and to reduce the effect of noise across…

Sound · Computer Science 2025-09-19 Yuanjian Chen , Yang Xiao , Jinjie Huang

This paper presents a semi-supervised learning framework that is new in being designed for automatic modulation classification (AMC). By carefully utilizing unlabeled signal data with a self-supervised contrastive-learning pre-training…

Machine Learning · Computer Science 2022-03-31 Dongxin Liu , Peng Wang , Tianshi Wang , Tarek Abdelzaher