English
Related papers

Related papers: Soft Contrastive Learning for Time Series

200 papers

Self-supervised contrastive learning has become a key technique in deep learning, particularly in time series analysis, due to its ability to learn meaningful representations without explicit supervision. Augmentation is a critical…

Machine Learning · Computer Science 2024-07-15 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

In recent times, contrastive learning based loss functions have become increasingly popular for visual self-supervised representation learning owing to their state-of-the-art (SOTA) performance. Most of the modern contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Chaitanya Animesh , Manmohan Chandraker

Semi-supervised action recognition aims to improve spatio-temporal reasoning ability with a few labeled data in conjunction with a large amount of unlabeled data. Albeit recent advancements, existing powerful methods are still prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yu Wang , Sanping Zhou , Kun Xia , Le Wang

Contrastive Language-Image Pretraining (CLIP) models excel at understanding image-text relationships but struggle with adapting to new data without forgetting prior knowledge. To address this, models are typically fine-tuned using both new…

Machine Learning · Computer Science 2026-05-06 Ryan King , Gang Li , Bobak Mortazavi , Tianbao Yang

Unsupervised feature learning has made great strides with contrastive learning based on instance discrimination and invariant mapping, as benchmarked on curated class-balanced datasets. However, natural data could be highly correlated and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Xudong Wang , Ziwei Liu , Stella X. Yu

Asset retrieval--finding similar assets in a financial universe--is central to quantitative investment decision-making. Existing approaches define similarity through historical price patterns or sector classifications, but such…

Computational Engineering, Finance, and Science · Computer Science 2026-02-12 Hyeongmin Lee , Chanyeol Choi , Jihoon Kwon , Yoon Kim , Alejandro Lopez-Lira , Wonbin Ahn , Yongjae Lee

Unsupervised representation learning approaches aim to learn discriminative feature representations from unlabeled data, without the requirement of annotating every sample. Enabling unsupervised representation learning is extremely crucial…

Machine Learning · Computer Science 2023-08-04 Qianwen Meng , Hangwei Qian , Yong Liu , Yonghui Xu , Zhiqi Shen , Lizhen Cui

Existing adversarial learning approaches mostly use class labels to generate adversarial samples that lead to incorrect predictions, which are then used to augment the training of the model for improved robustness. While some recent works…

Machine Learning · Computer Science 2020-10-27 Minseon Kim , Jihoon Tack , Sung Ju Hwang

We target at the task of weakly-supervised action localization (WSAL), where only video-level action labels are available during model training. Despite the recent progress, existing methods mainly embrace a localization-by-classification…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Junyu Gao , Mengyuan Chen , Changsheng Xu

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

Machine Learning · Computer Science 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder representations…

Computation and Language · Computer Science 2021-09-20 Haoxiang Shi , Cen Wang

Video representation learning has been successful in video-text pre-training for zero-shot transfer, where each sentence is trained to be close to the paired video clips in a common feature space. For long videos, given a paragraph of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yuncong Yang , Jiawei Ma , Shiyuan Huang , Long Chen , Xudong Lin , Guangxing Han , Shih-Fu Chang

Novelty detection, i.e., identifying whether a given sample is drawn from outside the training distribution, is essential for reliable machine learning. To this end, there have been many attempts at learning a representation well-suited for…

Machine Learning · Computer Science 2020-10-22 Jihoon Tack , Sangwoo Mo , Jongheon Jeong , Jinwoo Shin

This paper presents CLaSP, a novel model for retrieving time-series signals using natural language queries that describe signal characteristics. The ability to search time-series signals based on descriptive queries is essential in domains…

Computation and Language · Computer Science 2025-08-07 Aoi Ito , Kota Dohi , Yohei Kawaguchi

Obtaining labelled ECG data for developing supervised models is challenging. Contrastive learning (CL) has emerged as a promising pretraining approach that enables effective transfer learning with limited labelled data. However, existing CL…

Machine Learning · Computer Science 2026-01-23 Muhammad Ilham Rizqyawan , Peter Macfarlane , Stathis Hadjidemetriou , Fani Deligianni

Sign language translation (SLT) converts continuous sign videos into spoken-language text, yet it remains challenging due to the intrinsic modality mismatch between visual signs and written text, particularly in gloss-free settings. Recent…

Computation and Language · Computer Science 2026-04-27 Changhao Lai , Rui Zhao , Xuewen Zhong , Jinsong Su , Yidong Chen

Existing deep trackers are typically trained with largescale video frames with annotated bounding boxes. However, these bounding boxes are expensive and time-consuming to annotate, in particular for large scale datasets. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Qiangqiang Wu , Antoni B. Chan

A considerable amount of clustering algorithms take instance-feature matrices as their inputs. As such, they cannot directly analyze time series data due to its temporal nature, usually unequal lengths, and complex properties. This is a…

Artificial Intelligence · Computer Science 2019-06-04 Qi Lei , Jinfeng Yi , Roman Vaculin , Lingfei Wu , Inderjit S. Dhillon

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros