English
Related papers

Related papers: Contrastive Similarity Learning for Market Forecas…

200 papers

Dense prediction tasks such as segmentation and detection of pathological entities hold crucial clinical value in computational pathology workflows. However, obtaining dense annotations on large cohorts is usually tedious and expensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Maria Vakalopoulou , Joel Saltz , Dimitris Samaras

Monitoring sustainable development goals requires accurate and timely socioeconomic statistics, while ubiquitous and frequently-updated urban imagery in web like satellite/street view images has emerged as an important source for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Yu Liu , Xin Zhang , Jingtao Ding , Yanxin Xi , Yong Li

As growing usage of social media websites in the recent decades, the amount of news articles spreading online rapidly, resulting in an unprecedented scale of potentially fraudulent information. Although a plenty of studies have applied the…

Machine Learning · Computer Science 2023-04-21 Hao Chen , Peng Zheng , Xin Wang , Shu Hu , Bin Zhu , Jinrong Hu , Xi Wu , Siwei Lyu

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Continual learning (CL) involves acquiring and accumulating knowledge from evolving tasks while alleviating catastrophic forgetting. Recently, leveraging contrastive loss to construct more transferable and less forgetful representations has…

Machine Learning · Computer Science 2025-09-22 Jia Tang , Xinrui Wang , Songcan Chen

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Instruction tuning has been used as a promising approach to improve the performance of large language models (LLMs) on unseen tasks. However, current LLMs exhibit limited robustness to unseen instructions, generating inconsistent outputs…

Computation and Language · Computer Science 2024-06-07 Tianyi Lorena Yan , Fei Wang , James Y. Huang , Wenxuan Zhou , Fan Yin , Aram Galstyan , Wenpeng Yin , Muhao Chen

Session-based recommendation, which aims to predict the next item of users' interest as per an existing sequence interaction of items, has attracted growing applications of Contrastive Learning (CL) with improved user and item…

Information Retrieval · Computer Science 2023-12-21 Zhengxiang Shi , Xi Wang , Aldo Lipani

Learning representations that generalize well to unknown downstream tasks is a central challenge in representation learning. Existing approaches such as contrastive learning, self-supervised masking, and denoising auto-encoders address this…

Machine Learning · Computer Science 2025-09-10 Micha Livne

Link prediction is the task of inferring missing links between entities in knowledge graphs. Embedding-based methods have shown effectiveness in addressing this problem by modeling relational patterns in triples. However, the link…

Computation and Language · Computer Science 2024-03-05 Miao Peng , Ben Liu , Qianqian Xie , Wenjie Xu , Hua Wang , Min Peng

Contrastive learning has been studied for improving the performance of learning sentence embeddings. The current state-of-the-art method is the SimCSE, which takes dropout as the data augmentation method and feeds a pre-trained transformer…

Computation and Language · Computer Science 2021-11-25 Junlei Zhang , Zhenzhong lan

This paper finds that contrastive learning can produce superior sentence embeddings for pre-trained models but is also vulnerable to backdoor attacks. We present the first backdoor attack framework, BadCSE, for state-of-the-art sentence…

Computation and Language · Computer Science 2022-10-21 Xiaoyi Chen , Baisong Xin , Shengfang Zhai , Shiqing Ma , Qingni Shen , Zhonghai Wu

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

Information Retrieval · Computer Science 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Tianyu Guo , Hong Liu , Zhan Chen , Mengyuan Liu , Tao Wang , Runwei Ding

Dense retrieval conducts text retrieval in the embedding space and has shown many advantages compared to sparse retrieval. Existing dense retrievers optimize representations of queries and documents with contrastive training and map them to…

Information Retrieval · Computer Science 2021-07-19 Yizhi Li , Zhenghao Liu , Chenyan Xiong , Zhiyuan Liu

Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result in a more…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Jianwei Yang , Chunyuan Li , Pengchuan Zhang , Bin Xiao , Ce Liu , Lu Yuan , Jianfeng Gao

Making decent multi-lingual sentence representations is critical to achieve high performances in cross-lingual downstream tasks. In this work, we propose a novel method to align multi-lingual embeddings based on the similarity of sentences…

Computation and Language · Computer Science 2024-05-29 Minsu Park , Seyeon Choi , Chanyeol Choi , Jun-Seong Kim , Jy-yong Sohn

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Detecting lane markings in road scenes poses a challenge due to their intricate nature, which is susceptible to unfavorable conditions. While lane markings have strong shape priors, their visibility is easily compromised by lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ali Zoljodi , Sadegh Abadijou , Mina Alibeigi , Masoud Daneshtalab

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski