English
Related papers

Related papers: Modeling User Selection in Quality Diversity

200 papers

The increasing complexity of robots and autonomous agents that interact with people highlights the critical need for approaches that systematically test them before deployment. This review paper presents a general framework for solving this…

Artificial Intelligence · Computer Science 2024-09-10 Stefanos Nikolaidis

In this paper, we study collaborative filtering in an interactive setting, in which the recommender agents iterate between making recommendations and updating the user profile based on the interactive feedback. The most challenging problem…

Information Retrieval · Computer Science 2020-07-07 Lixin Zou , Long Xia , Yulong Gu , Xiangyu Zhao , Weidong Liu , Jimmy Xiangji Huang , Dawei Yin

Recently, in the area of big data, some popular applications such as web search engines and recommendation systems, face the problem to diversify results during query processing. In this sense, it is both significant and essential to…

Databases · Computer Science 2018-08-06 Meifan Zhang , Hongzhi Wang , Jianzhong Li , Hong Gao

In this work, we consider how preference models in interactive recommendation systems determine the availability of content and users' opportunities for discovery. We propose an evaluation procedure based on stochastic reachability to…

Information Retrieval · Computer Science 2021-07-05 Mihaela Curmei , Sarah Dean , Benjamin Recht

We present a novel approach to help decision-makers efficiently identify preferred solutions from the Pareto set of a multi-objective optimization problem. Our method uses a Bayesian model to estimate the decision-maker's utility function…

Machine Learning · Statistics 2025-11-13 Felix Huber , Sebastian Rojas Gonzalez , Raul Astudillo

We consider Bayesian optimization of expensive-to-evaluate experiments that generate vector-valued outcomes over which a decision-maker (DM) has preferences. These preferences are encoded by a utility function that is not known in closed…

Machine Learning · Computer Science 2022-03-23 Zhiyuan Jerry Lin , Raul Astudillo , Peter I. Frazier , Eytan Bakshy

In many real-world systems, such as adaptive robotics, achieving a single, optimised solution may be insufficient. Instead, a diverse set of high-performing solutions is often required to adapt to varying contexts and requirements. This is…

Machine Learning · Computer Science 2023-11-06 Garðar Ingvarsson , Mikayel Samvelyan , Bryan Lim , Manon Flageat , Antoine Cully , Tim Rocktäschel

Prompt engineering has made significant contributions to the era of large language models, yet its effectiveness depends on the skills of a prompt author. This paper introduces $\textit{iPrOp}$, a novel interactive prompt optimization…

Computation and Language · Computer Science 2025-06-30 Jiahui Li , Roman Klinger

Efficiently solving multi-objective optimization problems for simulation optimization of important scientific and engineering applications such as materials design is becoming an increasingly important research topic. This is due largely to…

Artificial Intelligence · Computer Science 2023-06-27 Eric Hans Lee , Bolong Cheng , Michael McCourt

Recommendation systems are pervasive in the digital economy. An important assumption in many deployed systems is that user consumption reflects user preferences in a static sense: users consume the content they like with no other…

Computers and Society · Computer Science 2023-02-14 Andreas Haupt , Dylan Hadfield-Menell , Chara Podimata

We consider an online model for recommendation systems, with each user being recommended an item at each time-step and providing 'like' or 'dislike' feedback. A latent variable model specifies the user preferences: both users and items are…

Machine Learning · Statistics 2025-04-29 Mina Karzand , Guy Bresler

Recent scholarly work has extensively examined the phenomenon of algorithmic collusion driven by AI-enabled pricing algorithms. However, online platforms commonly deploy recommender systems that influence how consumers discover and purchase…

Artificial Intelligence · Computer Science 2024-12-17 Xingchen Xu , Stephanie Lee , Yong Tan

Understanding citizens' values in participatory systems is crucial for citizen-centric policy-making. We envision a hybrid participatory system where participants make choices and provide motivations for those choices, and AI agents…

Artificial Intelligence · Computer Science 2025-02-12 Enrico Liscio , Luciano C. Siebert , Catholijn M. Jonker , Pradeep K. Murukannaiah

Effective collaboration between designers and users is important for fashion design, which can increase the user acceptance of fashion products and thereby create value. However, it remains an enduring challenge, as traditional…

Human-Computer Interaction · Computer Science 2026-01-22 Yuheng Shao , Yuansong Xu , Yifan Jin , Shuhao Zhang , Wenxin Gu , Quan Li

Effective optimization is essential for interactive systems to provide a satisfactory user experience. However, it is often challenging to find an objective to optimize for. Generally, such objectives are manually crafted and rarely capture…

Artificial Intelligence · Computer Science 2019-12-17 Ziming Li , Julia Kiseleva , Alekh Agarwal , Maarten de Rijke

Personalized alignment aims to adapt large language models to heterogeneous user preferences, yet the precise theoretical conditions for its statistical efficiency have not been formally established. This paper characterizes the conditions…

Machine Learning · Computer Science 2026-05-12 Enoch Hyunwook Kang

The availability of interaction devices has raised interest in techniques to support the user interface (UI). A UI specification describes the functions that a system provides to its users by capturing the interface details and includes…

Software Engineering · Computer Science 2019-02-01 Sabah Al-Fedaghi

Population diversity is crucial in evolutionary algorithms to enable global exploration and to avoid poor performance due to premature convergence. This book chapter reviews runtime analyses that have shown benefits of population diversity,…

Neural and Evolutionary Computing · Computer Science 2018-01-31 Dirk Sudholt

Many recommendation systems limit user inputs to text strings or behavior signals such as clicks and purchases, and system outputs to a list of products sorted by relevance. With the advent of generative AI, users have come to expect richer…

Accuracy and diversity have long been considered to be two conflicting goals for recommendations. We point out, however, that as the diversity is typically measured by certain pre-selected item attributes, e.g., category as the most…

Information Retrieval · Computer Science 2023-01-16 Xiaoying Zhang , Hongning Wang , Hang Li