English
Related papers

Related papers: Ranking Policy Learning via Marketplace Expected V…

200 papers

The study of online decision-making problems that leverage contextual information has drawn notable attention due to their significant applications in fields ranging from healthcare to autonomous systems. In modern applications, contextual…

Machine Learning · Statistics 2025-04-22 Qiyu Han , Will Wei Sun , Yichen Zhang

Motivated by online settings where users can provide explicit feedback about the relevance of products that are sequentially presented to them, we look at the recommendation process as a problem of dynamically optimizing this relevance…

Machine Learning · Computer Science 2015-03-09 Vijay Kamble , Nadia Fawaz , Fernando Silveira

We study online learning for optimal allocation when the resource to be allocated is time. %Examples of possible applications include job scheduling for a computing server, a driver filling a day with rides, a landlord renting an estate,…

Machine Learning · Statistics 2021-11-05 Etienne Boursier , Tristan Garrec , Vianney Perchet , Marco Scarsini

Algorithmic predictions are increasingly used to inform the allocations of goods and interventions in the public sphere. In these domains, predictions serve as a means to an end. They provide stakeholders with insights into likelihood of…

Computers and Society · Computer Science 2024-05-31 Juan Carlos Perdomo

Most of the research in the recommender systems domain is focused on the optimization of the metrics based on historical data such as Mean Average Precision (MAP) or Recall. However, there is a gap between the research and industry since…

Information Retrieval · Computer Science 2022-03-24 Michal Kompan , Peter Gaspar , Jakub Macina , Matus Cimerman , Maria Bielikova

Resource allocation plays a critical role in minimizing cycle time and improving the efficiency of business processes. Recently, Deep Reinforcement Learning (DRL) has emerged as a powerful technique to optimize resource allocation policies…

Machine Learning · Computer Science 2025-09-03 Jeroen Middelhuis , Zaharah Bukhsh , Ivo Adan , Remco Dijkman

Ranking, recommendation, and retrieval systems are widely used in online platforms and other societal systems, including e-commerce, media-streaming, admissions, gig platforms, and hiring. In the recent past, a large "fair ranking" research…

Information Retrieval · Computer Science 2022-02-01 Gourab K Patro , Lorenzo Porcaro , Laura Mitchell , Qiuyue Zhang , Meike Zehlike , Nikhil Garg

Object ranking is an important problem in the realm of preference learning. On the basis of training data in the form of a set of rankings of objects, which are typically represented as feature vectors, the goal is to learn a ranking…

Machine Learning · Statistics 2018-12-07 Karlson Pfannschmidt , Pritha Gupta , Eyke Hüllermeier

We study the problem of position allocation in job marketplaces, where the platform determines the ranking of the jobs for each seeker. The design of ranking mechanisms is critical to marketplace efficiency, as it influences both short-term…

Computer Science and Game Theory · Computer Science 2025-04-07 Farzad Pourbabaee , Sophie Yanying Sheng , Peter McCrory , Luke Simon , Di Mo

Many current applications use recommendations in order to modify the natural user behavior, such as to increase the number of sales or the time spent on a website. This results in a gap between the final recommendation objective and the…

Information Retrieval · Computer Science 2018-08-06 Stephen Bonner , Flavian Vasile

We introduce Probabilistic Rank and Reward (PRR), a scalable probabilistic model for personalized slate recommendation. Our approach allows off-policy estimation of the reward in the scenario where the user interacts with at most one item…

Information Retrieval · Computer Science 2024-07-08 Imad Aouali , Achraf Ait Sidi Hammou , Otmane Sakhi , David Rohde , Flavian Vasile

In real-world recommender systems and search engines, optimizing ranking decisions to present a ranked list of relevant items is critical. Off-policy evaluation (OPE) for ranking policies is thus gaining a growing interest because it…

Machine Learning · Statistics 2022-02-04 Haruka Kiyohara , Yuta Saito , Tatsuya Matsuhiro , Yusuke Narita , Nobuyuki Shimizu , Yasuo Yamamoto

We present a recommender system based on the Random Utility Model. Online shoppers are modeled as rational decision makers with limited information, and the recommendation task is formulated as the problem of optimally enriching the…

Computer Science and Game Theory · Computer Science 2024-09-24 Benjamin Heymann , Flavian Vasile , David Rohde

We study the problem of decision-making in the setting of a scarcity of shared resources when the preferences of agents are unknown a priori and must be learned from data. Taking the two-sided matching market as a running example, we focus…

Computer Science and Game Theory · Computer Science 2021-11-24 Xiaowu Dai , Michael I. Jordan

Ranking functions that are used in decision systems often produce disparate results for different populations because of bias in the underlying data. Addressing, and compensating for, these disparate outcomes is a critical problem for fair…

Machine Learning · Computer Science 2024-04-23 Abraham Gale , Amélie Marian

For ambiguous queries, conventional retrieval systems are bound by two conflicting goals. On the one hand, they should diversify and strive to present results for as many query intents as possible. On the other hand, they should provide…

Information Retrieval · Computer Science 2015-03-19 Karthik Raman , Thorsten Joachims , Pannaga Shivaswamy

In the online (time-series) search problem, a player is presented with a sequence of prices which are revealed in an online manner. In the standard definition of the problem, for each revealed price, the player must decide irrevocably…

Data Structures and Algorithms · Computer Science 2021-12-06 Spyros Angelopoulos , Shahin Kamali , Dehou Zhang

Preference-based reward learning is a popular technique for teaching robots and autonomous systems how a human user wants them to perform a task. Previous works have shown that actively synthesizing preference queries to maximize…

Robotics · Computer Science 2024-03-12 Evan Ellis , Gaurav R. Ghosal , Stuart J. Russell , Anca Dragan , Erdem Bıyık

Understanding citizens' values in participatory systems is crucial for citizen-centric policy-making. We envision a hybrid participatory system where participants make choices and provide motivations for those choices, and AI agents…

Artificial Intelligence · Computer Science 2025-02-12 Enrico Liscio , Luciano C. Siebert , Catholijn M. Jonker , Pradeep K. Murukannaiah

Dialog policy decides what and how a task-oriented dialog system will respond, and plays a vital role in delivering effective conversations. Many studies apply Reinforcement Learning to learn a dialog policy with the reward function which…

Computation and Language · Computer Science 2019-08-29 Ryuichi Takanobu , Hanlin Zhu , Minlie Huang