English
Related papers

Related papers: Inference-time Stochastic Ranking with Risk Contro…

200 papers

Large language models (LLMs) demand considerable computational, energy, and financial resources during both training and deployment. While scaling laws for training have guided much of the field's recent progress, inference costs now…

Machine Learning · Computer Science 2025-07-11 Austin R. Ellis-Mohr , Anuj K. Nayak , Lav R. Varshney

Individualized treatment rules (ITRs) have gained significant attention due to their wide-ranging applications in fields such as precision medicine, ridesharing, and advertising recommendations. However, when ITRs are influenced by…

Machine Learning · Statistics 2025-08-01 Wenhai Cui , Xiaoting Ji , Wen Su , Xiaodong Yan , Xingqiu Zhao

Approaches for estimating preferences from human annotated data typically involves inducing a distribution over a ranked list of choices such as the Plackett-Luce model. Indeed, modern AI alignment tools such as Reward Modelling and Direct…

Machine Learning · Statistics 2025-08-20 Chirag Nagpal

Designing a competent meta-reinforcement learning (meta-RL) algorithm in terms of data usage remains a central challenge to be tackled for its successful real-world applications. In this paper, we propose a sample-efficient meta-RL…

Machine Learning · Computer Science 2023-12-12 Jaeuk Shin , Giho Kim , Howon Lee , Joonho Han , Insoon Yang

The forward order assumption postulates that the ranking process of the items is carried out by sequentially assigning the positions from the top (most-liked) to the bottom (least-liked) alternative. This assumption has been recently…

Methodology · Statistics 2020-03-17 Cristina Mollica , Luca Tardella

Ranked search results and recommendations have become the main mechanism by which we find content, products, places, and people online. With hiring, selecting, purchasing, and dating being increasingly mediated by algorithms, rankings may…

Information Retrieval · Computer Science 2020-04-24 Meike Zehlike , Tom Sühr , Carlos Castillo , Ivan Kitanovski

Local explanations of learning-to-rank (LTR) models are thought to extract the most important features that contribute to the ranking predicted by the LTR model for a single data point. Evaluating the accuracy of such explanations is…

Machine Learning · Statistics 2022-03-17 Amir Hossein Akhavan Rahnama , Judith Butepage

We introduce Probabilistic Rank and Reward (PRR), a scalable probabilistic model for personalized slate recommendation. Our approach allows off-policy estimation of the reward in the scenario where the user interacts with at most one item…

Information Retrieval · Computer Science 2024-07-08 Imad Aouali , Achraf Ait Sidi Hammou , Otmane Sakhi , David Rohde , Flavian Vasile

The theory of greedy low-rank learning (GLRL) aims to explain the impressive generalization capabilities of deep learning. It proves that stochastic gradient-based training implicitly regularizes neural networks towards low-rank solutions…

Machine Learning · Computer Science 2024-01-02 Jiawei Zhao , Yifei Zhang , Beidi Chen , Florian Schäfer , Anima Anandkumar

Reinforcement Learning (RL) has achieved state-of-the-art results in domains such as robotics and games. We build on this previous work by applying RL algorithms to a selection of canonical online stochastic optimization problems with a…

Online learning to rank (OLTR) interactively learns to choose lists of items from a large collection based on certain click models that describe users' click behaviors. Most recent works for this problem focus on the stochastic environment…

Machine Learning · Computer Science 2022-07-13 Cheng Chen , Canzhe Zhao , Shuai Li

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard RL. At the…

Optimization and Control · Mathematics 2023-03-27 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

Given the abundance of applications of ranking in recent years, addressing fairness concerns around automated ranking systems becomes necessary for increasing the trust among end-users. Previous work on fair ranking has mostly focused on…

Machine Learning · Computer Science 2021-06-09 Nikola Konstantinov , Christoph H. Lampert

Fairness of recommender systems (RS) has attracted increasing attention recently. Based on the involved stakeholders, the fairness of RS can be divided into user fairness, item fairness, and two-sided fairness which considers both user and…

Information Retrieval · Computer Science 2024-02-16 Yifan Wang , Peijie Sun , Weizhi Ma , Min Zhang , Yuan Zhang , Peng Jiang , Shaoping Ma

Effective machine learning models can automatically learn useful information from a large quantity of data and provide decisions in a high accuracy. These models may, however, lead to unfair predictions in certain sense among the population…

Machine Learning · Computer Science 2020-06-19 Mingliang Chen , Min Wu

In Online Learning to Rank (OLTR) the aim is to find an optimal ranking model by interacting with users. When learning from user behavior, systems must interact with users while simultaneously learning from those interactions. Unlike other…

Information Retrieval · Computer Science 2017-11-28 Harrie Oosterhuis , Maarten de Rijke

When building recommendation systems, we seek to output a helpful set of items to the user. Under the hood, a ranking model predicts which of two candidate items is better, and we must distill these pairwise comparisons into the user-facing…

Information Retrieval · Computer Science 2022-07-05 Anastasios N. Angelopoulos , Karl Krauth , Stephen Bates , Yixin Wang , Michael I. Jordan

Societal biases that are contained in retrieved documents have received increased interest. Such biases, which are often prevalent in the training data and learned by the model, can cause societal harms, by misrepresenting certain groups,…

Information Retrieval · Computer Science 2023-09-19 Maria Heuss , Daniel Cohen , Masoud Mansoury , Maarten de Rijke , Carsten Eickhoff

Information Retrieval (IR) systems used in search and recommendation platforms frequently employ Learning-to-Rank (LTR) models to rank items in response to user queries. These models heavily rely on features derived from user interactions,…

Information Retrieval · Computer Science 2024-12-11 Randy Ardywibowo , Rakesh Sunki , Lucy Kuo , Sankalp Nayak

Search engines answer users' queries by listing relevant items (e.g. documents, songs, products, web pages, ...). These engines rely on algorithms that learn to rank items so as to present an ordered list maximizing the probability that it…

Machine Learning · Computer Science 2021-09-14 Stefan Magureanu , Alexandre Proutiere , Marcus Isaksson , Boxun Zhang