English
Related papers

Related papers: Deploying a Robust Active Preference Elicitation A…

200 papers

Given a learning problem with real-world tradeoffs, which cost function should the model be trained to optimize? This is the metric selection problem in machine learning. Despite its practical interest, there is limited formal guidance on…

Machine Learning · Statistics 2022-08-22 Gaurush Hiranandani

Traditionally, the identification of parameters in the formulation and solution of inverse problems considers that models, variables and mathematical parameters are free of uncertainties. This aspect simplifies the estimation process, but…

Populations and Evolution · Quantitative Biology 2020-06-02 Gustavo Barbosa Libotte , Fran Sérgio Lobato , Gustavo Mendes Platt

Multi-objective reinforcement learning (MORL) aims to find a set of high-performing and diverse policies that address trade-offs between multiple conflicting objectives. However, in practice, decision makers (DMs) often deploy only one or a…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Ke Li , Han Guo

Modern kidney placement incorporates several intelligent recommendation systems which exhibit social discrimination due to biases inherited from training data. Although initial attempts were made in the literature to study algorithmic…

Machine Learning · Computer Science 2024-04-08 Mukund Telukunta , Sukruth Rao , Gabriella Stickney , Venkata Sriram Siddardh Nadendla , Casey Canfield

We address the problem of active online assortment optimization problem with preference feedback, which is a framework for modeling user choices and subsetwise utility maximization. The framework is useful in various real-world applications…

Machine Learning · Computer Science 2024-03-01 Aadirupa Saha , Pierre Gaillard

We present Covidex, a search engine that exploits the latest neural ranking models to provide information access to the COVID-19 Open Research Dataset curated by the Allen Institute for AI. Our system has been online and serving users since…

Information Retrieval · Computer Science 2020-07-16 Edwin Zhang , Nikhil Gupta , Raphael Tang , Xiao Han , Ronak Pradeep , Kuang Lu , Yue Zhang , Rodrigo Nogueira , Kyunghyun Cho , Hui Fang , Jimmy Lin

Since the first wave of the COVID-19 pandemic, governments have applied restrictions in order to slow down its spreading. However, creating such policies is hard, especially because the government needs to trade-off the spreading of the…

Machine Learning · Computer Science 2022-05-03 Leonardo Lucio Custode , Giovanni Iacca

Digital platforms such as social media and e-commerce websites adopt Recommender Systems to provide value to the user. However, the social consequences deriving from their adoption are still unclear. Many scholars argue that recommenders…

Information Retrieval · Computer Science 2024-09-26 Erica Coppolillo , Simone Mungari , Ettore Ritacco , Francesco Fabbri , Marco Minici , Francesco Bonchi , Giuseppe Manco

A critical factor in the success of decision support systems is the accurate modeling of user preferences. Psychology research has demonstrated that users often develop their preferences during the elicitation process, highlighting the…

Human-Computer Interaction · Computer Science 2024-10-03 Connor Lawless , Jakob Schoeffer , Lindy Le , Kael Rowan , Shilad Sen , Cristina St. Hill , Jina Suh , Bahareh Sarrafzadeh

We study the potential of large language models (LLMs) as proxies for humans to simplify preference elicitation (PE) in combinatorial assignment. While traditional PE methods rely on iterative queries to capture preferences, LLMs offer a…

Artificial Intelligence · Computer Science 2025-02-17 Ermis Soumalias , Yanchen Jiang , Kehang Zhu , Michael Curry , Sven Seuken , David C. Parkes

While recommendation systems generally observe user behavior passively, there has been an increased interest in directly querying users to learn their specific preferences. In such settings, considering queries at different levels of…

Machine Learning · Computer Science 2018-12-03 Yuheng Bu , Kevin Small

A preference-based subjective evaluation is a key method for evaluating generative media reliably. However, its huge combinations of pairs prohibit it from being applied to large-scale evaluation using crowdsourcing. To address this issue,…

Human-Computer Interaction · Computer Science 2024-03-12 Yusuke Yasuda , Tomoki Toda

In Reinforcement Learning (RL), designing precise reward functions remains to be a challenge, particularly when aligning with human intent. Preference-based RL (PbRL) was introduced to address this problem by learning reward models from…

Machine Learning · Computer Science 2024-08-09 Heewoong Choi , Sangwon Jung , Hongjoon Ahn , Taesup Moon

Preference elicitation is a central problem in AI, and has received significant attention in single-agent settings. It is also a key problem in multiagent systems, but has received little attention here so far. In this setting, the agents…

Computer Science and Game Theory · Computer Science 2007-05-23 Vincent Conitzer , Tuomas Sandholm

Eliciting the preferences of a set of agents over a set of alternatives is a problem of fundamental importance in social choice theory. Prior work on this problem has studied the query complexity of preference elicitation for the…

Computer Science and Game Theory · Computer Science 2016-04-19 Palash Dey , Neeldhara Misra

Reinforcement learning (RL) is increasingly being used in the healthcare domain, particularly for the development of personalized health adaptive interventions. Inspired by the success of Large Language Models (LLMs), we are interested in…

Machine Learning · Computer Science 2025-01-14 Karine Karine , Benjamin M. Marlin

We study a fundamental model of resource allocation in which a finite number of resources must be assigned in an online manner to a heterogeneous stream of customers. The customers arrive randomly over time according to known stochastic…

Optimization and Control · Mathematics 2018-05-16 Clifford Stein , Van-Anh Truong , Xinshang Wang

We investigate a learning decision support system for vehicle routing, where the routing engine learns implicit preferences that human planners have when manually creating route plans (or routings). The goal is to use these learned…

Artificial Intelligence · Computer Science 2021-01-12 Rocsildes Canoy , Víctor Bucarey , Jayanta Mandi , Tias Guns

Data generation and labeling are often expensive in robot learning. Preference-based learning is a concept that enables reliable labeling by querying users with preference questions. Active querying methods are commonly employed in…

Machine Learning · Computer Science 2024-02-27 Erdem Bıyık , Nima Anari , Dorsa Sadigh

The COVID-19 pandemic continues to have a devastating global impact, and has placed a tremendous burden on struggling healthcare systems around the world. Given the limited resources, accurate patient triaging and care planning is critical…

Machine Learning · Computer Science 2021-11-30 Audrey Chung , Mahmoud Famouri , Andrew Hryniowski , Alexander Wong