English
Related papers

Related papers: Contrastive State Augmentations for Reinforcement …

200 papers

Recent advancements in state-of-the-art (SOTA) offline reinforcement learning (RL) have primarily focused on addressing function approximation errors, which contribute to the overestimation of Q-values for out-of-distribution actions, a…

Machine Learning · Computer Science 2025-05-01 Pulkit Agrawal , Rukma Talwadker , Aditya Pareek , Tridib Mukherjee

Session-based recommendation aims to predict intents of anonymous users based on limited behaviors. With the ability in alleviating data sparsity, contrastive learning is prevailing in the task. However, we spot that existing contrastive…

Information Retrieval · Computer Science 2025-06-06 Xiaokun Zhang , Bo Xu , Fenglong Ma , Zhizheng Wang , Liang Yang , Hongfei Lin

Contrastive learning (CL) recently has spurred a fruitful line of research in the field of recommendation, since its ability to extract self-supervised signals from the raw data is well-aligned with recommender systems' needs for tackling…

Information Retrieval · Computer Science 2022-05-10 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Lizhen Cui , Quoc Viet Hung Nguyen

This paper presents a solution to the challenges faced by contrastive learning in sequential recommendation systems. In particular, it addresses the issue of false negative, which limits the effectiveness of recommendation algorithms. By…

Information Retrieval · Computer Science 2023-07-12 Jaeheyoung Jeon , Jung Hyun Ryu , Jewoong Cho , Myungjoo Kang

Recently, various auxiliary tasks have been proposed to accelerate representation learning and improve sample efficiency in deep reinforcement learning (RL). However, existing auxiliary tasks do not take the characteristics of RL problems…

Machine Learning · Computer Science 2021-02-23 Guoqing Liu , Chuheng Zhang , Li Zhao , Tao Qin , Jinhua Zhu , Jian Li , Nenghai Yu , Tie-Yan Liu

In offline reinforcement learning-based recommender systems (RLRS), learning effective state representations is crucial for capturing user preferences that directly impact long-term rewards. However, raw state representations often contain…

Information Retrieval · Computer Science 2025-02-05 Siyu Wang , Xiaocong Chen , Lina Yao

Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from their past…

Computation and Language · Computer Science 2020-05-05 Ruiyi Zhang , Tong Yu , Yilin Shen , Hongxia Jin , Changyou Chen , Lawrence Carin

The performance of offline reinforcement learning (RL) is sensitive to the proportion of high-return trajectories in the offline dataset. However, in many simulation environments and real-world scenarios, there are large ratios of…

Machine Learning · Computer Science 2024-06-18 Yixiang Shan , Zhengbang Zhu , Ting Long , Qifan Liang , Yi Chang , Weinan Zhang , Liang Yin

Techniques that learn improved representations via offline data or self-supervised objectives have shown impressive results in traditional reinforcement learning (RL). Nevertheless, it is unclear how improved representation learning can…

Computation and Language · Computer Science 2024-10-25 Vaskar Nath , Dylan Slack , Jeff Da , Yuntao Ma , Hugh Zhang , Spencer Whitehead , Sean Hendryx

Despite recent progress in reinforcement learning (RL) from raw pixel data, sample inefficiency continues to present a substantial obstacle. Prior works have attempted to address this challenge by creating self-supervised auxiliary tasks,…

Machine Learning · Computer Science 2024-05-27 Ruijie Zheng , Xiyao Wang , Yanchao Sun , Shuang Ma , Jieyu Zhao , Huazhe Xu , Hal Daumé , Furong Huang

Session-based recommendation, which aims to predict the next item of users' interest as per an existing sequence interaction of items, has attracted growing applications of Contrastive Learning (CL) with improved user and item…

Information Retrieval · Computer Science 2023-12-21 Zhengxiang Shi , Xi Wang , Aldo Lipani

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

Information Retrieval · Computer Science 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

Self-supervised contrastive learning has become a key technique in deep learning, particularly in time series analysis, due to its ability to learn meaningful representations without explicit supervision. Augmentation is a critical…

Machine Learning · Computer Science 2024-07-15 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

In sequential decision-making problems, Return-Conditioned Supervised Learning (RCSL) has gained increasing recognition for its simplicity and stability in modern decision-making tasks. Unlike traditional offline reinforcement learning (RL)…

Machine Learning · Computer Science 2025-06-11 Zhishuai Liu , Yu Yang , Ruhan Wang , Pan Xu , Dongruo Zhou

Offline reinforcement learning (RL) aims to learn an effective policy from a static dataset. To alleviate extrapolation errors, existing studies often uniformly regularize the value function or policy updates across all states. However, due…

Machine Learning · Computer Science 2025-05-27 Qin-Wen Luo , Ming-Kun Xie , Ye-Wen Wang , Sheng-Jun Huang

The capacity for rapid domain adaptation is important to increasing the applicability of reinforcement learning (RL) to real world problems. Generalization of RL agents is critical to success in the real world, yet zero-shot policy transfer…

Machine Learning · Computer Science 2022-09-13 Taylor Hearn , Sravan Jayanthi , Sehoon Ha

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

This paper introduces a novel approach Counterfactual Shapley Values (CSV), which enhances explainability in reinforcement learning (RL) by integrating counterfactual analysis with Shapley Values. The approach aims to quantify and compare…

Artificial Intelligence · Computer Science 2024-08-07 Yiwei Shi , Qi Zhang , Kevin McAreavey , Weiru Liu

Most existing contrastive learning-based sequential recommendation (SR) methods rely on random operations (e.g., crop, reorder, and substitute) to generate augmented sequences. These methods often struggle to create positive sample pairs…

Information Retrieval · Computer Science 2025-03-27 Wei Wang , Yujie Lin , Jianli Zhao , Moyan Zhang , Pengjie Ren , Xianye Ben , Yujun Li

Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even…

Information Retrieval · Computer Science 2022-07-08 Abhijit Anand , Jurek Leonhardt , Koustav Rudra , Avishek Anand