English
Related papers

Related papers: De-Biased Modelling of Search Click Behavior with …

200 papers

Deep reinforcement learning (DRL) has shown success in diverse domains such as robotics, computer games, and recommendation systems. However, like any other software system, DRL-based software systems are susceptible to faults that pose…

Software Engineering · Computer Science 2024-10-08 Rached Bouchoucha , Ahmed Haj Yahmed , Darshan Patil , Janarthanan Rajendran , Amin Nikanjam , Sarath Chandar , Foutse Khomh

Model-based offline reinforcement learning (RL) has emerged as a promising approach for recommender systems, enabling effective policy learning by interacting with frozen world models. However, the reward functions in these world models,…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Xuwei Xu , Jiajun Liu , Sen Wang

Ranking is a crucial module using in the recommender system. In particular, the ranking module using in our YoungTao recommendation scenario is to provide an ordered list of items to users, to maximize the click number throughout the…

Information Retrieval · Computer Science 2023-08-29 Shaowei Liu , Yangjun Liu

Learning to Rank (LTR) models learn from historical user interactions, such as user clicks. However, there is an inherent bias in the clicks of users due to position bias, i.e., users are more likely to click highly-ranked documents than…

Information Retrieval · Computer Science 2025-07-11 Zeyan Liang , Graham McDonald , Iadh Ounis

We develop and evaluate neural architectures to model the user behavior in recommender systems (RS) inspired by click models for Web search but going beyond standard click models. Proposed architectures include recurrent networks,…

Information Retrieval · Computer Science 2024-10-01 Mikhail Shirokikh , Ilya Shenbin , Anton Alekseev , Anna Volodkevich , Alexey Vasilev , Andrey V. Savchenko , Sergey Nikolenko

Reinforcement learning algorithms based on Q-learning are driving Deep Reinforcement Learning (DRL) research towards solving complex problems and achieving super-human performance on many of them. Nevertheless, Q-Learning is known to be…

Machine Learning · Computer Science 2022-06-14 Andrea Cini , Carlo D'Eramo , Jan Peters , Cesare Alippi

Recommender systems (RSs) have become an inseparable part of our everyday lives. They help us find our favorite items to purchase, our friends on social networks, and our favorite movies to watch. Traditionally, the recommendation problem…

Information Retrieval · Computer Science 2022-06-09 M. Mehdi Afsar , Trafford Crump , Behrouz Far

Click-through-rate (CTR) prediction plays an important role in online advertising and ad recommender systems. In the past decade, maximizing CTR has been the main focus of model development and solution creation. Therefore, researchers and…

Information Retrieval · Computer Science 2024-09-16 Dogukan Aksu , Ismail Hakki Toroslu , Hasan Davulcu

This paper explores an improved Adaboost algorithm based on Long Short-Term Memory Networks (LSTMs), which aims to improve the prediction accuracy of user clicks on web page advertisements. By comparing it with several common machine…

Machine Learning · Computer Science 2024-08-13 Qixuan Yu , Xirui Tang , Feiyang Li , Zinan Cao

Search and recommendation (S&R) are fundamental components of modern online platforms, yet effectively leveraging search behaviors to improve recommendation remains a challenging problem. User search histories often contain noisy or…

Information Retrieval · Computer Science 2025-08-07 Teng Shi , Weicong Qin , Weijie Yu , Xiao Zhang , Ming He , Jianping Fan , Jun Xu

Modern search engine result pages often provide immediate value to users and organize information in such a way that it is easy to navigate. The core ranking function contributes to this and so do result snippets, smart organization of…

Information Retrieval · Computer Science 2016-09-05 Aleksandr Chuklin , Maarten de Rijke

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

For many reinforcement learning (RL) applications, specifying a reward is difficult. This paper considers an RL setting where the agent obtains information about the reward only by querying an expert that can, for example, evaluate…

Machine Learning · Computer Science 2022-02-01 David Lindner , Matteo Turchetta , Sebastian Tschiatschek , Kamil Ciosek , Andreas Krause

The increasing popularity of e-learning has created demand for improving online education through techniques such as predictive analytics and content recommendations. In this paper, we study learner outcome predictions, i.e., predictions of…

Machine Learning · Computer Science 2020-01-24 Yuwei Tu , Weiyu Chen , Christopher G. Brinton

Evaluating retrieval performance without editorial relevance judgments is challenging, but instead, user interactions can be used as relevance signals. Living labs offer a way for small-scale platforms to validate information retrieval…

Information Retrieval · Computer Science 2023-10-12 Timo Breuer , Norbert Fuhr , Philipp Schaer

Improved search quality enhances users' satisfaction, which directly impacts sales growth of an E-Commerce (E-Com) platform. Traditional Learning to Rank (LTR) algorithms require relevance judgments on products. In E-Com, getting such…

Information Retrieval · Computer Science 2020-07-10 Muhammad Umer Anwaar , Dmytro Rybalko , Martin Kleinsteuber

Transformer networks, particularly those achieving performance comparable to GPT models, are well known for their robust feature extraction abilities. However, the nature of these extracted features and their alignment with human-engineered…

Information Retrieval · Computer Science 2025-07-23 Tanya Chowdhury , Atharva Nijasure , James Allan

Nowadays, recommender systems already impact almost every facet of peoples lives. To provide personalized high quality recommendation results, conventional systems usually train pointwise rankers to predict the absolute value of objectives…

Information Retrieval · Computer Science 2021-12-01 Yi Ren , Hongyan Tang , Siwen Zhu

Recommendation models are predominantly trained using implicit user feedback, since explicit feedback is often costly to obtain. However, implicit feedback, such as clicks, does not always reflect users' real preferences. For example, a…

Information Retrieval · Computer Science 2025-10-06 Mengchen Zhao , Yifan Gao , Yaqing Hou , Xiangyang Li , Pengjie Gu , Zhenhua Dong , Ruiming Tang , Yi Cai

Learning to rank systems has become an important aspect of our daily life. However, the implicit user feedback that is used to train many learning to rank models is usually noisy and suffered from user bias (i.e., position bias). Thus,…

Information Retrieval · Computer Science 2021-08-12 Anh Tran , Tao Yang , Qingyao Ai