English
Related papers

Related papers: Rank Supervised Contrastive Learning for Time Seri…

200 papers

Contrastive learning has shown effectiveness in improving sequential recommendation models. However, existing methods still face challenges in generating high-quality contrastive pairs: they either rely on random perturbations that corrupt…

Information Retrieval · Computer Science 2025-12-23 Ziqiang Cui , Yunpeng Weng , Xing Tang , Xiaokun Zhang , Shiwei Li , Peiyang Liu , Bowei He , Dugang Liu , Weihong Luo , Xiuqiang He , Chen Ma

Personalized search plays a crucial role in improving user search experience owing to its ability to build user profiles based on historical behaviors. Previous studies have made great progress in extracting personal signals from the query…

Information Retrieval · Computer Science 2021-11-25 Yujia Zhou , Zhicheng Dou , Yutao Zhu , Ji-Rong Wen

Meta-reinforcement learning typically requires orders of magnitude more samples than single task reinforcement learning methods. This is because meta-training needs to deal with more diverse distributions and train extra components such as…

Machine Learning · Computer Science 2021-03-12 Bernie Wang , Simon Xu , Kurt Keutzer , Yang Gao , Bichen Wu

Contrastive learning (CL) benefits the training of sequential recommendation models with informative self-supervision signals. Existing solutions apply general sequential data augmentation strategies to generate positive pairs and encourage…

Information Retrieval · Computer Science 2024-03-19 Peilin Zhou , Jingqi Gao , Yueqi Xie , Qichen Ye , Yining Hua , Jae Boum Kim , Shoujin Wang , Sunghun Kim

We present an approach that incorporates expert knowledge for time-series representation learning. Our method employs expert features to replace the commonly used data transformations in previous contrastive learning approaches. We do this…

Machine Learning · Computer Science 2023-09-26 Manuel Nonnenmacher , Lukas Oldenburg , Ingo Steinwart , David Reeb

We propose a framework for sequence-to-sequence contrastive learning (SeqCLR) of visual representations, which we apply to text recognition. To account for the sequence-to-sequence structure, each feature map is divided into different…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Aviad Aberdam , Ron Litman , Shahar Tsiper , Oron Anschel , Ron Slossberg , Shai Mazor , R. Manmatha , Pietro Perona

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

Machine Learning · Computer Science 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

Real-world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researchers have…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Tianhong Li , Peng Cao , Yuan Yuan , Lijie Fan , Yuzhe Yang , Rogerio Feris , Piotr Indyk , Dina Katabi

Learning visual representation of high quality is essential for image classification. Recently, a series of contrastive representation learning methods have achieved preeminent success. Particularly, SupCon outperformed the dominant methods…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Sungho Park , Jewook Lee , Pilhyeon Lee , Sunhee Hwang , Dohyung Kim , Hyeran Byun

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Recent years have witnessed many successful applications of contrastive learning in diverse domains, yet its self-supervised version still remains many exciting challenges. As the negative samples are drawn from unlabeled datasets, a…

Machine Learning · Computer Science 2024-02-01 Bin Liu , Bang Wang , Tianrui Li

Universal time series representation learning is challenging but valuable in real-world applications such as classification, anomaly detection, and forecasting. Recently, contrastive learning (CL) has been actively explored to tackle time…

Machine Learning · Computer Science 2025-02-06 Namwoo Kim , Hyungryul Baik , Yoonjin Yoon

Contrastive learning has nearly closed the gap between supervised and self-supervised learning of image representations, and has also been explored for videos. However, prior work on contrastive learning for video data has not explored the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ishan Dave , Rohit Gupta , Mamshad Nayeem Rizve , Mubarak Shah

Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Chen Feng , Ioannis Patras

Contrastive learning has demonstrated great effectiveness in representation learning especially for image classification tasks. However, there is still a shortage in the studies targeting regression tasks, and more specifically applications…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mohamad Dhaini , Maxime Berar , Paul Honeine , Antonin Van Exem

Sequential recommendation (SR) aims to predict the subsequent behaviors of users by understanding their successive historical behaviors. Recently, some methods for SR are devoted to alleviating the data sparsity problem (i.e., limited…

Information Retrieval · Computer Science 2022-08-30 Ziyang Wang , Huoyu Liu , Wei Wei , Yue Hu , Xian-Ling Mao , Shaojian He , Rui Fang , Dangyang chen

Various contrastive learning approaches have been proposed in recent years and achieve significant empirical success. While effective and prevalent, contrastive learning has been less explored for time series data. A key component of…

Graph contrastive learning (GCL), as a popular approach to graph self-supervised learning, has recently achieved a non-negligible effect. To achieve superior performance, the majority of existing GCL methods elaborate on graph data…

Machine Learning · Computer Science 2022-05-03 Yuansheng Wang , Wangbin Sun , Kun Xu , Zulun Zhu , Liang Chen , Zibin Zheng

Recommender systems (RecSys) are essential for online platforms, providing personalized suggestions to users within a vast sea of information. Self-supervised graph learning seeks to harness high-order collaborative filtering signals…

Information Retrieval · Computer Science 2025-07-18 Weizhi Zhang , Liangwei Yang , Zihe Song , Henrry Peng Zou , Ke Xu , Yuanjie Zhu , Philip S. Yu