English
Related papers

Related papers: Accurate Quality Elicitation in a Multi-Attribute …

200 papers

We analyze the structure of the disagreement among a population of voters over a set of alternatives. Surveys typically ask either for pairwise comparisons, simple and intuitive for participants, or full rankings over alternatives,…

Artificial Intelligence · Computer Science 2026-05-20 Mohamed Ouaguenouni , Felipe Garrido-Lucero , Umberto Grandi , César Hidalgo , Magdalena Tydrichova

Several performance measures can be used for evaluating classification results: accuracy, F-measure, and many others. Can we say that some of them are better than others, or, ideally, choose one measure that is best in all situations? To…

Machine Learning · Computer Science 2022-01-25 Martijn Gösgens , Anton Zhiyanov , Alexey Tikhonov , Liudmila Prokhorenkova

It is important to collect credible training samples $(x,y)$ for building data-intensive learning systems (e.g., a deep learning system). Asking people to report complex distribution $p(x)$, though theoretically viable, is challenging in…

Machine Learning · Computer Science 2021-02-26 Jiaheng Wei , Zuyue Fu , Yang Liu , Xingyu Li , Zhuoran Yang , Zhaoran Wang

Whether the goal is to analyze voting behavior, locate facilities, or recommend products, the problem of translating between (ordinal) rankings and (numerical) utilities arises naturally in many contexts. This task is commonly approached by…

Theoretical Economics · Economics 2026-02-03 Joshua Zeitlin , Corinna Coupette

Human experts often struggle to select the best option from a large set of items with multiple competing objectives, a process bottlenecked by the difficulty of formalizing complex, implicit preferences. To address this, we introduce LISTEN…

Computation and Language · Computer Science 2026-05-19 Adam S. Jovine , Tinghan Ye , Francis Bahk , Jingjing Wang , Matthew Ford , David B. Shmoys , Peter I. Frazier

Some quality indicators have been proposed for benchmarking preference-based evolutionary multi-objective optimization algorithms using a reference point. Although a systematic review and analysis of the quality indicators are helpful for…

Neural and Evolutionary Computing · Computer Science 2023-09-27 Ryoji Tanabe , Ke Li

Recommender systems play a critical role in enhancing user experience by providing personalized suggestions based on user preferences. Traditional approaches often rely on explicit numerical ratings or assume access to fully ranked lists of…

Information Retrieval · Computer Science 2025-08-22 Bahar Boroomand , James R. Wright

Multi-label learning often requires identifying all relevant labels for training instances, but collecting full label annotations is costly and labor-intensive. In many datasets, only a single positive label is annotated per training…

Machine Learning · Computer Science 2025-09-16 Misgina Tsighe Hagos , Claes Lundström

The high number of products available makes it difficult for a user to find the most suitable products according to their needs. This problem is especially exacerbated when the user is trying to optimize multiple attributes during product…

Human-Computer Interaction · Computer Science 2020-04-28 Roquia Mushtaq , Naveed Ahmad , Aimal Rextin , Muhammad Muddassir Malik

It is challenging to quantify numerical preferences for different objectives in a multi-objective decision-making problem. However, the demonstrations of a user are often accessible. We propose an algorithm to infer linear preference…

Artificial Intelligence · Computer Science 2023-04-28 Junlin Lu

We consider the multi-item inventory lot-sizing problem with supplier selection. The problem consists of determining an optimal purchasing plan in order to satisfy dynamic deterministic demands for multiple items over a finite planning…

Optimization and Control · Mathematics 2021-02-22 Leopoldo E. Cárdenas-Barrón , Rafael A. Melo , Marcio C. Santos

Large Language Models (LLMs) have recently emerged as a powerful backbone for recommender systems. Existing LLM-based recommender systems take two different approaches for representing items in natural language, i.e., Attribute-based…

Information Retrieval · Computer Science 2026-03-03 Kibum Kim , Sein Kim , Hongseok Kang , Jiwan Kim , Heewoong Noh , Yeonjun In , Kanghoon Yoon , Jinoh Oh , Julian McAuley , Chanyoung Park

This paper introduces the abstraction of max-plus linear (MPL) systems via predicates. Predicates are automatically selected from system matrix, as well as from the specifications under consideration. We focus on verifying time-difference…

Logic in Computer Science · Computer Science 2019-07-09 Muhammad Syifa'ul Mufid , Dieky Adzkiya , Alessandro Abate

We explore how large language models (LLMs) can enhance the proposal selection process at large user facilities, offering a scalable, consistent, and cost-effective alternative to traditional human review. Proposal selection depends on…

Artificial Intelligence · Computer Science 2025-12-12 Lijie Ding , Janell Thomson , Jon Taylor , Changwoo Do

A key distinguishing feature of conversational recommender systems over traditional recommender systems is their ability to elicit user preferences using natural language. Currently, the predominant approach to preference elicitation is to…

Information Retrieval · Computer Science 2025-04-09 Ivica Kostric , Krisztian Balog , Filip Radlinski

Modeling user preferences across domains remains a key challenge in slate recommendation (i.e. recommending an ordered sequence of items) research. We investigate how Large Language Models (LLM) can effectively act as world models of user…

Information Retrieval · Computer Science 2025-11-07 Baptiste Bonin , Maxime Heuillet , Audrey Durand

We present a novel approach to help decision-makers efficiently identify preferred solutions from the Pareto set of a multi-objective optimization problem. Our method uses a Bayesian model to estimate the decision-maker's utility function…

Machine Learning · Statistics 2025-11-13 Felix Huber , Sebastian Rojas Gonzalez , Raul Astudillo

The development of largely human-annotated benchmarks has driven the success of deep neural networks in various NLP tasks. To enhance the effectiveness of existing benchmarks, collecting new additional input-output pairs is often too costly…

Computation and Language · Computer Science 2023-06-09 Jaehyung Kim , Jinwoo Shin , Dongyeop Kang

Statistical estimation often involves tradeoffs between expensive, high-quality measurements and a variety of lower-quality proxies. We introduce Multiple-Prediction-Powered Inference (MultiPPI): a general framework for constructing…

Traditional evaluation of information retrieval (IR) systems relies on human-annotated relevance labels, which can be both biased and costly at scale. In this context, large language models (LLMs) offer an alternative by allowing us to…

Information Retrieval · Computer Science 2024-10-21 Naghmeh Farzi , Laura Dietz