English
Related papers

Related papers: SimCPSR: Simple Contrastive Learning for Paper Sub…

200 papers

The successful integration of large language models (LLMs) into recommendation systems has proven to be a major breakthrough in recent studies, paving the way for more generic and transferable recommendations. However, LLMs struggle to…

Information Retrieval · Computer Science 2023-11-29 Junyan Qiu , Haitao Wang , Zhaolin Hong , Yiping Yang , Qiang Liu , Xingxing Wang

Cross-modal retrieval (CMR) has been extensively applied in various domains, such as multimedia search engines and recommendation systems. Most existing CMR methods focus on image-to-text retrieval, whereas audio-to-text retrieval, a less…

Sound · Computer Science 2023-09-19 Kaiyi Luo , Xulong Zhang , Jianzong Wang , Huaxiong Li , Ning Cheng , Jing Xiao

Identifying related entities and events within and across documents is fundamental to natural language understanding. We present an approach to entity and event coreference resolution utilizing contrastive representation learning. Earlier…

Computation and Language · Computer Science 2022-05-24 Benjamin Hsu , Graham Horwood

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

With the recent advancements in information technology there has been a huge surge in amount of data available. But information retrieval technology has not been able to keep up with this pace of information generation resulting in over…

Computation and Language · Computer Science 2017-10-24 Nishant Nikhil , Muktabh Mayank Srivastava

Self-supervised representation learning (SSRL) methods have shown great success in computer vision. In recent studies, augmentation-based contrastive learning methods have been proposed for learning representations that are invariant or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xia Xu , Jochen Triesch

Contrastive learning is an efficient approach to self-supervised representation learning. Although recent studies have made progress in the theoretical understanding of contrastive learning, the investigation of how to characterize the…

Machine Learning · Computer Science 2023-08-21 Hiroki Waida , Yuichiro Wada , Léo Andéol , Takumi Nakagawa , Yuhui Zhang , Takafumi Kanamori

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

Machine Learning · Computer Science 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

Large language models (LLMs) have achieved remarkable progress in the field of natural language processing (NLP), demonstrating remarkable abilities in producing text that resembles human language for various tasks. This opens up new…

Information Retrieval · Computer Science 2024-06-05 Jianghao Lin , Xinyi Dai , Rong Shan , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

Noise contrastive learning is a popular technique for unsupervised representation learning. In this approach, a representation is obtained via reduction to supervised learning, where given a notion of semantic similarity, the learner tries…

Machine Learning · Computer Science 2021-06-21 Jordan T. Ash , Surbhi Goel , Akshay Krishnamurthy , Dipendra Misra

This paper presents novel techniques for enhancing the performance of knowledge tracing (KT) models by focusing on the crucial factor of question and concept difficulty level. Despite the acknowledged significance of difficulty, previous KT…

Computation and Language · Computer Science 2023-12-20 Unggi Lee , Sungjun Yoon , Joon Seo Yun , Kyoungsoo Park , YoungHoon Jung , Damji Stratton , Hyeoncheol Kim

Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Anurag Roy , Riddhiman Moulick , Vinay K. Verma , Saptarshi Ghosh , Abir Das

In this paper, we study contrastive learning from an optimization perspective, aiming to analyze and address a fundamental issue of existing contrastive learning methods that either rely on a large batch size or a large dictionary of…

Machine Learning · Computer Science 2022-09-22 Zhuoning Yuan , Yuexin Wu , Zi-Hao Qiu , Xianzhi Du , Lijun Zhang , Denny Zhou , Tianbao Yang

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Recommending cold-start items is a long-standing and fundamental challenge in recommender systems. Without any historical interaction on cold-start items, CF scheme fails to use collaborative signals to infer user preference on these items.…

Information Retrieval · Computer Science 2021-07-16 Yinwei Wei , Xiang Wang , Qi Li , Liqiang Nie , Yan Li , Xuanping Li , Tat-Seng Chua

Sequential Recommendationdescribes a set of techniques to model dynamic user behavior in order to predict future interactions in sequential user data. At their core, such approaches model transition probabilities between items in a…

Information Retrieval · Computer Science 2021-08-17 Zhiwei Liu , Yongjun Chen , Jia Li , Philip S. Yu , Julian McAuley , Caiming Xiong

In sequential recommendation systems, data augmentation and contrastive learning techniques have recently been introduced using diffusion models to achieve robust representation learning. However, most of the existing approaches use random…

Information Retrieval · Computer Science 2025-07-17 Jinkyeong Choi , Yejin Noh , Donghyeon Park

This paper investigates Cross-Domain Sequential Recommendation (CDSR), a promising method that uses information from multiple domains (more than three) to generate accurate and diverse recommendations, and takes into account the sequential…

Artificial Intelligence · Computer Science 2023-11-23 Chung Park , Taesan Kim , Taekyoon Choi , Junui Hong , Yelim Yu , Mincheol Cho , Kyunam Lee , Sungil Ryu , Hyungjun Yoon , Minsung Choi , Jaegul Choo

Assigning qualified, unbiased and interested reviewers to paper submissions is vital for maintaining the integrity and quality of the academic publishing system and providing valuable reviews to authors. However, matching thousands of…

Information Retrieval · Computer Science 2022-11-09 Omer Anjum , Alok Kamatar , Toby Liang , Jinjun Xiong , Wen-mei Hwu