English
Related papers

Related papers: CTR is not Enough: a Novel Reinforcement Learning …

200 papers

Online travel platforms (OTPs), e.g., Ctrip.com or Fliggy.com, can effectively provide travel-related products or services to users. In this paper, we focus on the multi-scenario click-through rate (CTR) prediction, i.e., training a unified…

Information Retrieval · Computer Science 2023-04-18 Peilin Chen , Hong Wen , Jing Zhang , Fuyu Lv , Zhao Li , Qijie Shen , Wanjie Tao , Ying Zhou , Chao Zhang

As Learning-to-Rank (LTR) approaches primarily seek to improve ranking quality, their output scores are not scale-calibrated by design. This fundamentally limits LTR usage in score-sensitive applications. Though a simple multi-objective…

Information Retrieval · Computer Science 2023-08-23 Aijun Bai , Rolf Jagerman , Zhen Qin , Le Yan , Pratyush Kar , Bing-Rong Lin , Xuanhui Wang , Michael Bendersky , Marc Najork

Talent search is a cornerstone of modern recruitment systems, yet existing approaches often struggle to capture nuanced job-specific preferences, model recruiter behavior at a fine-grained level, and mitigate noise from subjective human…

Information Retrieval · Computer Science 2025-12-02 Jihang Li , Bing Xu , Zulong Chen , Chuanfei Xu , Minping Chen , Suyu Liu , Ying Zhou , Zeyi Wen

Click-Through Rate (CTR) prediction is a core task in nowadays commercial recommender systems. Feature crossing, as the mainline of research on CTR prediction, has shown a promising way to enhance predictive performance. Even though various…

Information Retrieval · Computer Science 2021-04-23 Runlong Yu , Yuyang Ye , Qi Liu , Zihan Wang , Chunfeng Yang , Yucheng Hu , Enhong Chen

Reinforcement learning has shown great promise in the training of robot behavior due to the sequential decision making characteristics. However, the required enormous amount of interactive and informative training data provides the major…

Artificial Intelligence · Computer Science 2020-12-22 Sha Luo , Hamidreza Kasaei , Lambert Schomaker

Multimodal click-through rate (CTR) prediction is a key technique in industrial recommender systems. It leverages heterogeneous modalities such as text, images, and behavioral logs to capture high-order feature interactions between users…

Information Retrieval · Computer Science 2025-04-28 Honghao Li , Hanwei Li , Jing Zhang , Yi Zhang , Ziniu Yu , Lei Sang , Yiwen Zhang

Deep learning-based sequential recommender systems have recently attracted increasing attention from both academia and industry. Most of industrial Embedding-Based Retrieval (EBR) system for recommendation share the similar ideas with…

Information Retrieval · Computer Science 2022-04-01 Fuyu Lv , Mengxue Li , Tonglei Guo , Changlong Yu , Fei Sun , Taiwei Jin , Wilfred Ng

The inputs and preferences of human users are important considerations in situations where these users interact with autonomous cyber or cyber-physical systems. In these scenarios, one is often interested in aligning behaviors of the system…

Machine Learning · Computer Science 2021-04-02 Bhaskar Ramasubramanian , Luyao Niu , Andrew Clark , Radha Poovendran

Click-through rate (CTR) is a key signal of relevance for search engine results, both organic and sponsored. CTR of a result has two core components: (a) the probability of examination of a result by a user, and (b) the perceived relevance…

Machine Learning · Computer Science 2018-10-22 Muhammad Asiful Islam , Ramakrishnan Srikant , Sugato Basu

We consider a recommender system that takes into account the interplay between recommendations, the evolution of user interests, and harmful content. We model the impact of recommendations on user behavior, particularly the tendency to…

Information Retrieval · Computer Science 2024-06-17 Jerry Chee , Shankar Kalyanaraman , Sindhu Kiranmai Ernala , Udi Weinsberg , Sarah Dean , Stratis Ioannidis

Sequential recommendation methods are increasingly important in cutting-edge recommender systems. Through leveraging historical records, the systems can capture user interests and perform recommendations accordingly. State-of-the-art…

Information Retrieval · Computer Science 2023-08-10 Chong Liu , Xiaoyang Liu , Rongqin Zheng , Lixin Zhang , Xiaobo Liang , Juntao Li , Lijun Wu , Min Zhang , Leyu Lin

Click-Through Rate (CTR) prediction is a pivotal task in product and content recommendation, where learning effective feature embeddings is of great significance. However, traditional methods typically learn fixed feature representations…

Information Retrieval · Computer Science 2023-09-06 Chen Zhu , Liang Du , Hong Chen , Shuang Zhao , Zixun Sun , Xin Wang , Wenwu Zhu

An ultimate goal of recommender systems (RS) is to improve user engagement. Reinforcement learning (RL) is a promising paradigm for this goal, as it directly optimizes overall performance of sequential recommendation. However, many existing…

Information Retrieval · Computer Science 2023-04-06 Guoxi Zhang , Xing Yao , Xuanji Xiao

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

Despite the development of ranking optimization techniques, pointwise loss remains the dominating approach for click-through rate prediction. It can be attributed to the calibration ability of the pointwise loss since the prediction can be…

Information Retrieval · Computer Science 2023-05-30 Xiang-Rong Sheng , Jingyue Gao , Yueyao Cheng , Siran Yang , Shuguang Han , Hongbo Deng , Yuning Jiang , Jian Xu , Bo Zheng

Existing dialogue systems rely on Query Suggestion (QS) to enhance user engagement. Recent efforts typically employ large language models with Click-Through Rate (CTR) model, yet fail in cold-start scenarios due to their heavy reliance on…

Computation and Language · Computer Science 2026-03-25 Qi Sun , Kejun Xiao , Huaipeng Zhao , Tao Luo , Xiaoyi Zeng

Click-through rate (CTR) prediction is a critical task for many industrial systems, such as display advertising and recommender systems. Recently, modeling user behavior sequences attracts much attention and shows great improvements in the…

Information Retrieval · Computer Science 2020-08-27 Yufei Feng , Fuyu Lv , Binbin Hu , Fei Sun , Kun Kuang , Yang Liu , Qingwen Liu , Wenwu Ou

Modern recommender systems aim to improve user experience. As reinforcement learning (RL) naturally fits this objective -- maximizing an user's reward per session -- it has become an emerging topic in recommender systems. Developing…

Information Retrieval · Computer Science 2022-06-16 Xin Xin , Tiago Pimentel , Alexandros Karatzoglou , Pengjie Ren , Konstantina Christakopoulou , Zhaochun Ren

Click-Through Rate (CTR) prediction plays an important role in many industrial applications, such as online advertising and recommender systems. How to capture users' dynamic and evolving interests from their behavior sequences remains a…

Information Retrieval · Computer Science 2019-05-17 Yufei Feng , Fuyu Lv , Weichen Shen , Menghan Wang , Fei Sun , Yu Zhu , Keping Yang

The search engine plays a fundamental role in online e-commerce systems, to help users find the products they want from the massive product collections. Relevance is an essential requirement for e-commerce search, since showing products…

Information Retrieval · Computer Science 2021-02-16 Shaowei Yao , Jiwei Tan , Xi Chen , Keping Yang , Rong Xiao , Hongbo Deng , Xiaojun Wan