English
Related papers

Related papers: CTR is not Enough: a Novel Reinforcement Learning …

200 papers

Reinforcement learning (RL) requires skillful definition and remarkable computational efforts to solve optimization and control problems, which could impair its prospect. Introducing human guidance into reinforcement learning is a promising…

Machine Learning · Computer Science 2022-11-30 Jingda Wu , Zhiyu Huang , Wenhui Huang , Chen Lv

In industrial large-scale search systems, such as Taobao.com search for commodities, the quality of the ranking result is getting continually improved by introducing more factors from complex procedures, e.g., deep neural networks for…

Information Retrieval · Computer Science 2018-03-15 Yusen Zhan , Qing Da , Fei Xiao , An-xiang Zeng , Yang Yu

In recent years, live streaming platforms have gained immense popularity as they allow users to broadcast their videos and interact in real-time with hosts and peers. Due to the dynamic changes of live content, accurate recommendation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jiaxin Deng , Dong Shen , Shiyao Wang , Xiangyu Wu , Fan Yang , Guorui Zhou , Gaofeng Meng

Learning-to-rank (LTR) has become a key technology in E-commerce applications. Most existing LTR approaches follow a supervised learning paradigm from offline labeled data collected from the online system. However, it has been noticed that…

Machine Learning · Computer Science 2021-01-01 Guangda Huzhang , Zhen-Jia Pang , Yongqing Gao , Yawen Liu , Weijie Shen , Wen-Ji Zhou , Qing Da , An-Xiang Zeng , Han Yu , Yang Yu , Zhi-Hua Zhou

In this work, we introduce the notion of Context-Based Prediction Models. A Context-Based Prediction Model determines the probability of a user's action (such as a click or a conversion) solely by relying on user and contextual features,…

Information Retrieval · Computer Science 2023-08-03 Jan Hartman , Assaf Klein , Davorin Kopič , Natalia Silberstein

Ranking is a core task in recommender systems, which aims at providing an ordered list of items to users. Typically, a ranking function is learned from the labeled dataset to optimize the global performance, which produces a ranking score…

Information Retrieval · Computer Science 2019-07-24 Changhua Pei , Yi Zhang , Yongfeng Zhang , Fei Sun , Xiao Lin , Hanxiao Sun , Jian Wu , Peng Jiang , Wenwu Ou

Click-through rate (CTR) prediction is a critical task in recommendation systems, serving as the ultimate filtering step to sort items for a user. Most recent cutting-edge methods primarily focus on investigating complex implicit and…

Information Retrieval · Computer Science 2024-05-13 Song-Li Wu , Liang Du , Jia-Qi Yang , Yu-Ai Wang , De-Chuan Zhan , Shuang Zhao , Zi-Xun Sun

Dividing ads ranking system into retrieval, early, and final stages is a common practice in large scale ads recommendation to balance the efficiency and accuracy. The early stage ranking often uses efficient models to generate candidates…

Information Retrieval · Computer Science 2023-07-24 Xuewei Wang , Qiang Jin , Shengyu Huang , Min Zhang , Xi Liu , Zhengli Zhao , Yukun Chen , Zhengyu Zhang , Jiyan Yang , Ellie Wen , Sagar Chordia , Wenlin Chen , Qin Huang

Click-through rate~(CTR) prediction, whose goal is to estimate the probability of the user clicks, has become one of the core tasks in advertising systems. For CTR prediction model, it is necessary to capture the latent user interest behind…

Machine Learning · Statistics 2018-11-19 Guorui Zhou , Na Mou , Ying Fan , Qi Pi , Weijie Bian , Chang Zhou , Xiaoqiang Zhu , Kun Gai

This paper introduces Consistency Trajectory Planning (CTP), a novel offline model-based reinforcement learning method that leverages the recently proposed Consistency Trajectory Model (CTM) for efficient trajectory optimization. While…

Artificial Intelligence · Computer Science 2025-07-15 Guanquan Wang , Takuya Hiraoka , Yoshimasa Tsuruoka

Product ranking is the core problem for revenue-maximizing online retailers. To design proper product ranking algorithms, various consumer choice models are proposed to characterize the consumers' behaviors when they are provided with a…

Machine Learning · Computer Science 2023-01-03 Renzhe Xu , Xingxuan Zhang , Bo Li , Yafeng Zhang , Xiaolong Chen , Peng Cui

Recommendation systems (RecSys) are designed to connect users with relevant items from a vast pool of candidates while aligning with the business goals of the platform. A typical industrial RecSys is composed of two main stages, retrieval…

Information Retrieval · Computer Science 2024-12-19 Chi Liu , Jiangxia Cao , Rui Huang , Kuo Cai , Weifeng Ding , Qiang Luo , Kun Gai , Guorui Zhou

We present the Learned Ranking Function (LRF), a system that takes short-term user-item behavior predictions as input and outputs a slate of recommendations that directly optimizes for long-term user satisfaction. Most previous work is…

Machine Learning · Computer Science 2024-08-14 Yi Wu , Daryl Chang , Jennifer She , Zhe Zhao , Li Wei , Lukasz Heldt

Recommending a sequence of activities for an ongoing case requires that the recommendations conform to the underlying business process and meet the performance goal of either completion time or process outcome. Existing work on next…

Artificial Intelligence · Computer Science 2022-05-09 Prerna Agarwal , Avani Gupta , Renuka Sindhgatta , Sampath Dechu

Click-Through Rate (CTR) prediction, which aims to estimate the probability that a user will click an item, is an essential component of online advertising. Existing methods mainly attempt to mine user interests from users' historical…

Information Retrieval · Computer Science 2022-07-25 Erxue Min , Yu Rong , Tingyang Xu , Yatao Bian , Peilin Zhao , Junzhou Huang , Da Luo , Kangyi Lin , Sophia Ananiadou

Traditional click-through rate (CTR) prediction models convert the tabular data into one-hot vectors and leverage the collaborative relations among features for inferring the user's preference over items. This modeling paradigm discards…

Information Retrieval · Computer Science 2023-12-19 Xiangyang Li , Bo Chen , Lu Hou , Ruiming Tang

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

Natural content and advertisement coexist in industrial recommendation systems but differ in data distribution. Concretely, traffic related to the advertisement is considerably sparser compared to that of natural content, which motivates…

Information Retrieval · Computer Science 2024-08-30 Qi Liu , Xingyuan Tang , Jianqiang Huang , Xiangqian Yu , Haoran Jin , Jin Chen , Yuanhao Pu , Defu Lian , Tan Qu , Zhe Wang , Jia Cheng , Jun Lei

With the continuous development of machine learning technology, major e-commerce platforms have launched recommendation systems based on it to serve a large number of customers with different needs more efficiently. Compared with…

Machine Learning · Computer Science 2020-12-14 Yang Yu , Zhenhao Gu , Rong Tao , Jingtian Ge , Kenglun Chang

With the recent prevalence of Reinforcement Learning (RL), there have been tremendous interests in developing RL-based recommender systems. In practical recommendation sessions, users will sequentially access multiple scenarios, such as the…

Information Retrieval · Computer Science 2020-08-18 Xiangyu Zhao , Long Xia , Linxin Zou , Hui Liu , Dawei Yin , Jiliang Tang