English
Related papers

Related papers: Rethinking Contrastive Learning in Session-based R…

200 papers

Since the meaning representations are detailed and accurate annotations which express fine-grained sequence-level semtantics, it is usually hard to train discriminative semantic parsers via Maximum Likelihood Estimation (MLE) in an…

Computation and Language · Computer Science 2023-01-20 Shan Wu , Chunlei Xin , Bo Chen , Xianpei Han , Le Sun

Affect modeling is viewed, traditionally, as the process of mapping measurable affect manifestations from multiple modalities of user input to affect labels. That mapping is usually inferred through end-to-end (manifestation-to-affect)…

Human-Computer Interaction · Computer Science 2022-08-26 Kosmas Pinitas , Konstantinos Makantasis , Antonios Liapis , Georgios N. Yannakakis

Pre-trained language models have proven their unique powers in capturing implicit language features. However, most pre-training approaches focus on the word-level training objective, while sentence-level objectives are rarely studied. In…

Computation and Language · Computer Science 2021-01-01 Zhuofeng Wu , Sinong Wang , Jiatao Gu , Madian Khabsa , Fei Sun , Hao Ma

Human Activity Recognition is a field of research where input data can take many forms. Each of the possible input modalities describes human behaviour in a different way, and each has its own strengths and weaknesses. We explore the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Razvan Brinzea , Bulat Khaertdinov , Stylianos Asteriadis

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

Machine Learning · Computer Science 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Multimodal representation learning, exemplified by multimodal contrastive learning (MMCL) using image-text pairs, aims to learn powerful representations by aligning cues across modalities. This approach relies on the core assumption that…

Machine Learning · Computer Science 2025-09-29 Yichao Cai , Yuhang Liu , Erdun Gao , Tianjiao Jiang , Zhen Zhang , Anton van den Hengel , Javen Qinfeng Shi

User modeling, which aims to capture users' characteristics or interests, heavily relies on task-specific labeled data and suffers from the data sparsity issue. Several recent studies tackled this problem by pre-training the user model on…

Information Retrieval · Computer Science 2023-10-25 Yang Yu , Qi Liu , Kai Zhang , Yuren Zhang , Chao Song , Min Hou , Yuqing Yuan , Zhihao Ye , Zaixi Zhang , Sanshi Lei Yu

The impressive performance of GPT-3 using natural language prompts and in-context learning has inspired work on better fine-tuning of moderately-sized models under this paradigm. Following this line of work, we present a contrastive…

Computation and Language · Computer Science 2022-05-04 Yiren Jian , Chongyang Gao , Soroush Vosoughi

Self-supervised learning has recently shown great potential in vision tasks through contrastive learning, which aims to discriminate each image, or instance, in the dataset. However, such instance-level learning ignores the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Tsai-Shien Chen , Wei-Chih Hung , Hung-Yu Tseng , Shao-Yi Chien , Ming-Hsuan Yang

The user purchase behaviors are mainly influenced by their intentions (e.g., buying clothes for decoration, buying brushes for painting, etc.). Modeling a user's latent intention can significantly improve the performance of recommendations.…

Information Retrieval · Computer Science 2023-11-28 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Guanfeng Liu , Fuzhen Zhuang , Victor S. Sheng

Session-based recommendation (SBR) systems aim to utilize the user's short-term behavior sequence to predict the next item without the detailed user profile. Most recent works try to model the user preference by treating the sessions as…

Information Retrieval · Computer Science 2024-02-20 Zhongwei Wan , Xin Liu , Benyou Wang , Jiezhong Qiu , Boyu Li , Ting Guo , Guangyong Chen , Yang Wang

Self-supervised learning based on instance discrimination has shown remarkable progress. In particular, contrastive learning, which regards each image as well as its augmentations as an individual class and tries to distinguish them from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Haohang Xu , Xiaopeng Zhang , Hao Li , Lingxi Xie , Hongkai Xiong , Qi Tian

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

The effectiveness of a model is heavily reliant on the quality of the fusion representation of multiple modalities in multimodal sentiment analysis. Moreover, each modality is extracted from raw input and integrated with the rest to…

Machine Learning · Computer Science 2023-12-06 Cong-Duy Nguyen , Thong Nguyen , Duc Anh Vu , Luu Anh Tuan

Contrastive learning has emerged as a pivotal framework for representation learning, underpinning advances in both unimodal and bimodal applications like SimCLR and CLIP. To address fundamental limitations like large batch size dependency…

Machine Learning · Computer Science 2024-12-12 Ajay Jagannath , Aayush Upadhyay , Anant Mehta

Sequential Recommendation (SR) has received increasing attention due to its ability to capture user dynamic preferences. Recently, Contrastive Learning (CL) provides an effective approach for sequential recommendation by learning invariance…

Information Retrieval · Computer Science 2023-10-24 Yongjing Hao , Pengpeng Zhao , Junhua Fang , Jianfeng Qu , Guanfeng Liu , Fuzhen Zhuang , Victor S. Sheng , Xiaofang Zhou

Learning reinforcement learning (RL)-based recommenders from historical user-item interaction sequences is vital to generate high-reward recommendations and improve long-term cumulative benefits. However, existing RL recommendation methods…

Information Retrieval · Computer Science 2023-05-19 Zhaochun Ren , Na Huang , Yidan Wang , Pengjie Ren , Jun Ma , Jiahuan Lei , Xinlei Shi , Hengliang Luo , Joemon M Jose , Xin Xin

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

Machine Learning · Computer Science 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov

In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method for learning region-level feature representation for dense prediction tasks. Our method is motivated by the three…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Qiushan Guo , Yizhou Yu , Yi Jiang , Jiannan Wu , Zehuan Yuan , Ping Luo

Graph neural network (GNN) is a powerful learning approach for graph-based recommender systems. Recently, GNNs integrated with contrastive learning have shown superior performance in recommendation with their data augmentation schemes,…

Information Retrieval · Computer Science 2023-06-16 Xuheng Cai , Chao Huang , Lianghao Xia , Xubin Ren