English
Related papers

Related papers: Do Not Wait: Learning Re-Ranking Model Without Use…

200 papers

Recent advances in deep neural networks, language modeling and language generation have introduced new ideas to the field of conversational agents. As a result, deep neural models such as sequence-to-sequence, Memory Networks, and the…

Computation and Language · Computer Science 2019-02-27 Momchil Hardalov , Ivan Koychev , Preslav Nakov

Collaborative filtering problems are commonly solved based on matrix completion techniques which recover the missing values of user-item interaction matrices. In a matrix, the rating position specifically represents the user given and the…

Information Retrieval · Computer Science 2022-10-11 Taejun Lim , Siqu Long , Josiah Poon , Soyeon Caren Han

In the random-order model for online learning, the sequence of losses is chosen upfront by an adversary and presented to the learner after a random permutation. Any random-order input is \emph{asymptotically} equivalent to a stochastic…

Machine Learning · Computer Science 2025-10-06 Martino Bernasconi , Andrea Celli , Riccardo Colini-Baldeschi , Federico Fusco , Stefano Leonardi , Matteo Russo

Latent reasoning represents a new development in Transformer language models that has shown potential in compressing reasoning lengths compared to chain-of-thought reasoning. By directly passing the information-rich previous final latent…

Machine Learning · Computer Science 2025-11-27 Alex Ning , Yen-Ling Kuo , Gabe Gomes

Recently, pre-trained language models such as BERT have been applied to document ranking for information retrieval, which first pre-train a general language model on an unlabeled large corpus and then conduct ranking-specific fine-tuning on…

Information Retrieval · Computer Science 2021-08-13 Lin Bo , Liang Pang , Gang Wang , Jun Xu , XiuQiang He , Ji-Rong Wen

This paper studies the problem of learning interactive recommender systems from logged feedbacks without any exploration in online environments. We address the problem by proposing a general offline reinforcement learning framework for…

Machine Learning · Computer Science 2023-10-03 Teng Xiao , Donglin Wang

We consider a setting where a system learns to rank a fixed set of $m$ items. The goal is produce good item rankings for users with diverse interests who interact online with the system for $T$ rounds. We consider a novel top-$1$ feedback…

Machine Learning · Computer Science 2016-08-24 Sougata Chaudhuri , Ambuj Tewari

Model-based offline reinforcement learning (RL) has emerged as a promising approach for recommender systems, enabling effective policy learning by interacting with frozen world models. However, the reward functions in these world models,…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Xuwei Xu , Jiajun Liu , Sen Wang

Learning-to-rank is a core technique in the top-N recommendation task, where an ideal ranker would be a mapping from an item set to an arrangement (a.k.a. permutation). Most existing solutions fall in the paradigm of probabilistic ranking…

Information Retrieval · Computer Science 2023-08-28 Jiarui Jin , Xianyu Chen , Weinan Zhang , Mengyue Yang , Yang Wang , Yali Du , Yong Yu , Jun Wang

For industrial learning-to-rank (LTR) systems, it is common that the output of a ranking model is modified, either as a results of post-processing logic that enforces business requirements, or as a result of unforeseen design flaws or bugs…

Information Retrieval · Computer Science 2023-11-06 Matej Jakimov , Alexander Buchholz , Yannik Stein , Thorsten Joachims

Robust Trust Reputation Systems (TRS) provide a most trustful reputation score for a specific product or service so as to support relying parties taking the right decision while interacting with an e-commerce application. Thus, TRS must…

Cryptography and Security · Computer Science 2014-05-14 Hasnae Rahimi , Hanan EL Bakkali

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

AfterLearnER (After Learning Evolutionary Retrofitting) consists in applying evolutionary optimization to refine fully trained machine learning models by optimizing a set of carefully chosen parameters or hyperparameters of the model, with…

Machine Learning · Computer Science 2025-11-17 Mathurin Videau , Mariia Zameshina , Alessandro Leite , Laurent Najman , Marc Schoenauer , Olivier Teytaud

E-commerce platforms generate vast volumes of user feedback, such as star ratings, written reviews, and comments. However, most recommendation engines rely primarily on numerical scores, often overlooking the nuanced opinions embedded in…

Information Retrieval · Computer Science 2025-05-08 Yogesh Gajula

Recommender systems have been widely applied in different real-life scenarios to help us find useful information. In particular, Reinforcement Learning (RL) based recommender systems have become an emerging research topic in recent years,…

Information Retrieval · Computer Science 2023-06-13 Yuanguo Lin , Yong Liu , Fan Lin , Lixin Zou , Pengcheng Wu , Wenhua Zeng , Huanhuan Chen , Chunyan Miao

Offline reinforcement learning (RL) is an effective tool for real-world recommender systems with its capacity to model the dynamic interest of users and its interactive nature. Most existing offline RL recommender systems focus on…

Information Retrieval · Computer Science 2025-05-13 Yi Zhang , Ruihong Qiu , Jiajun Liu , Sen Wang

Traditional approaches to ranking in web search follow the paradigm of rank-by-score: a learned function gives each query-URL combination an absolute score and URLs are ranked according to this score. This paradigm ensures that if the score…

Machine Learning · Computer Science 2012-07-03 Or Sheffet , Nina Mishra , Samuel Ieong

Model-free RL-based recommender systems have recently received increasing research attention due to their capability to handle partial feedback and long-term rewards. However, most existing research has ignored a critical feature in…

Machine Learning · Computer Science 2023-08-28 Tianchi Cai , Shenliao Bao , Jiyan Jiang , Shiji Zhou , Wenpeng Zhang , Lihong Gu , Jinjie Gu , Guannan Zhang

Most if not all on-line item-to-item recommendation systems rely on estimation of a distance like measure (rank) of similarity between items. For on-line recommendation systems, time sensitivity of this similarity measure is extremely…

Numerical Analysis · Mathematics 2023-02-06 Alexander Kushkuley , Joshua Correa

The scarcity of high-quality training data presents a fundamental bottleneck to scaling machine learning models. This challenge is particularly acute in recommendation systems, where extreme sparsity in user interactions leads to rugged…

Information Retrieval · Computer Science 2026-05-12 Luankang Zhang , Hao Wang , Zhongzhou Liu , Mingjia Yin , Yonghao Huang , Jiaqi Li , Wei Guo , Yong Liu , Huifeng Guo , Defu Lian , Enhong Chen