English
Related papers

Related papers: Experimentation Accelerator: Interpretable Insight…

200 papers

The ranking stage serves as the central optimization and allocation hub in advertising systems, governing economic value distribution through eCPM and orchestrating the user-centric blending of organic and advertising content. Prevailing…

Recommender systems often struggle with over-specialization, which severely limits users' exposure to diverse content and creates filter bubbles that reduce serendipitous discovery. To address this fundamental limitation, this paper…

Information Retrieval · Computer Science 2026-05-27 Edoardo Bianchi

In many online platforms, customers' decisions are substantially influenced by product rankings as most customers only examine a few top-ranked products. Concurrently, such platforms also use the same data corresponding to customers'…

Machine Learning · Computer Science 2020-09-14 Negin Golrezaei , Vahideh Manshadi , Jon Schneider , Shreyas Sekar

Online controlled experiments are the primary tool for measuring the causal impact of product changes in digital businesses. It is increasingly common for digital products and services to interact with customers in a personalised way. Using…

Methodology · Statistics 2021-07-02 C. H. Bryan Liu , Benjamin Paul Chamberlain

Reward modeling is essential for aligning Large Language Models(LLMs) with human preferences, yet conventional reward models suffer from poor interpretability and heavy reliance on costly expert annotations. While recent rubric-based…

Artificial Intelligence · Computer Science 2026-03-10 Dengcan Liu , Fengkai Yang , Xiaohan Wang , Shurui Yan , Jiajun Chai , Jiahao Li , Yikun Ban , Zhendong Mao , Wei Lin , Guojun Yin

The recent literature on online learning to rank (LTR) has established the utility of prior knowledge to Bayesian ranking bandit algorithms. However, a major limitation of existing work is the requirement for the prior used by the algorithm…

Machine Learning · Computer Science 2023-02-27 Javad Azizi , Ofer Meshi , Masrour Zoghi , Maryam Karimzadehgan

Progress on many Natural Language Processing (NLP) tasks, such as text classification, is driven by objective, reproducible and scalable evaluation via publicly available benchmarks. However, these are not always representative of…

Computation and Language · Computer Science 2022-11-11 Viktor Schlegel , Erick Mendez-Guzman , Riza Batista-Navarro

With the rapid development of modern technology, the Web has become an important platform for users to make friends and acquire information. However, since information on the Web is over-abundant, information filtering becomes a key task…

Social and Information Networks · Computer Science 2022-07-28 Hao Liao , Qi-xin Liu , Ze-cheng Huang , Chi Ho Yeung , Yi-Cheng Zhang

Online experiments (A/B tests) are widely regarded as the gold standard for evaluating recommender system variants and guiding launch decisions. However, a variety of biases can distort the results of the experiment and mislead…

Information Retrieval · Computer Science 2025-09-03 Chen Zheng , Zhenyu Zhao

A/B testing, a widely used form of Randomized Controlled Trial (RCT), is a fundamental tool in business data analysis and experimental design. However, despite its intent to maintain randomness, A/B testing often faces challenges that…

Methodology · Statistics 2024-08-13 Zihao Zheng , Carol Liu

The rapid evolution of e-commerce has exposed the limitations of traditional product retrieval systems in managing complex, multi-turn user interactions. Recent advances in multimodal generative retrieval -- particularly those leveraging…

The unbiased learning to rank (ULTR) problem has been greatly advanced by recent deep learning techniques and well-designed debias algorithms. However, promising results on the existing benchmark datasets may not be extended to the…

Artificial Intelligence · Computer Science 2022-09-21 Lixin Zou , Haitao Mao , Xiaokai Chu , Jiliang Tang , Wenwen Ye , Shuaiqiang Wang , Dawei Yin

Ranking algorithms are fundamental to various online platforms across e-commerce sites to content streaming services. Our research addresses the challenge of adaptively ranking items from a candidate pool for heterogeneous users, a key…

Machine Learning · Computer Science 2024-06-10 Jingyuan Wang , Perry Dong , Ying Jin , Ruohan Zhan , Zhengyuan Zhou

Ranking is a crucial module using in the recommender system. In particular, the ranking module using in our YoungTao recommendation scenario is to provide an ordered list of items to users, to maximize the click number throughout the…

Information Retrieval · Computer Science 2023-08-29 Shaowei Liu , Yangjun Liu

Reinforcement learning (RL) requires access to a reward function that incentivizes the right behavior, but these are notoriously hard to specify for complex tasks. Preference-based RL provides an alternative: learning policies using a…

Machine Learning · Computer Science 2021-11-05 Kimin Lee , Laura Smith , Anca Dragan , Pieter Abbeel

Recommender systems must balance personalization, diversity, and robustness to cold-start scenarios to remain effective in dynamic content environments. This paper introduces an adaptive, exploration-based recommendation framework that…

Information Retrieval · Computer Science 2025-03-26 Edoardo Bianchi

Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit…

Industrial recommendation systems are typically composed of multiple stages, including retrieval, ranking, and blending. The retrieval stage plays a critical role in generating a high-recall set of candidate items that covers a wide range…

Information Retrieval · Computer Science 2025-07-01 Zhibo Fan , Hongtao Lin , Haoyu Chen , Bowen Deng , Hedi Xia , Yuke Yan , James Li

Modern Code Review (MCR) is a standard in all kinds of organizations that develop software. MCR pays for itself through perceived and proven benefits in quality assurance and knowledge transfer. However, the time invest in MCR is generally…

Software Engineering · Computer Science 2021-04-20 Robert Heumüller

We present a novel approach for training small language models for reasoning-intensive document ranking that combines knowledge distillation with reinforcement learning optimization. While existing methods often rely on expensive human…

Information Retrieval · Computer Science 2025-07-01 Chris Samarinas , Hamed Zamani