English
Related papers

Related papers: Exploiting Preference Elicitation in Interactive a…

200 papers

Explaining algorithmic decisions and recommending actionable feedback is increasingly important for machine learning applications. Recently, significant efforts have been invested in finding a diverse set of recourses to cover the wide…

Machine Learning · Computer Science 2023-02-23 Duy Nguyen , Ngoc Bui , Viet Anh Nguyen

There exist situations of decision-making under information overload in the Internet, where people have an overwhelming number of available options to choose from, e.g. products to buy in an e-commerce site, or restaurants to visit in a…

Social and Information Networks · Computer Science 2021-01-14 Ivan Palomares , Carlos Porcel , Luiz Pizzato , Ido Guy , Enrique Herrera-Viedma

We propose a new problem setting to study the sequential interactions between a recommender system and a user. Instead of assuming the user is omniscient, static, and explicit, as the classical practice does, we sketch a more realistic user…

Machine Learning · Computer Science 2021-10-08 Fan Yao , Chuanhao Li , Denis Nekipelov , Hongning Wang , Haifeng Xu

Equipping artificial agents with useful exploration mechanisms remains a challenge to this day. Humans, on the other hand, seem to manage the trade-off between exploration and exploitation effortlessly. In the present article, we put…

Machine Learning · Computer Science 2022-11-15 Marcel Binz , Eric Schulz

Algorithmic recourse aims to recommend actionable changes to a factual's attributes that flip an unfavorable model decision while remaining realistic and feasible. We formulate recourse as a Constrained Maximum A-Posteriori (MAP) inference…

Machine Learning · Computer Science 2026-01-27 Anagha Sabu , Vidhya S , Narayanan C Krishnan

Recommender systems are increasingly successful in recommending personalized content to users. However, these systems often capitalize on popular content. There is also a continuous evolution of user interests that need to be captured, but…

Information Retrieval · Computer Science 2023-04-17 Khushhall Chandra Mahajan , Amey Porobo Dharwadker , Romil Shah , Simeng Qu , Gaurav Bang , Brad Schumitsch

We tackle the problem of constructive preference elicitation, that is the problem of learning user preferences over very large decision problems, involving a combinatorial space of possible outcomes. In this setting, the suggested…

Machine Learning · Statistics 2018-05-08 Paolo Dragone , Stefano Teso , Mohit Kumar , Andrea Passerini

Interactive reinforcement learning proposes the use of externally-sourced information in order to speed up the learning process. When interacting with a learner agent, humans may provide either evaluative or informative advice. Prior…

Artificial Intelligence · Computer Science 2022-07-08 Adam Bignold , Francisco Cruz , Richard Dazeley , Peter Vamplew , Cameron Foale

Generative AI models differ from traditional machine learning tools in that they allow users to provide as much or as little information as they choose in their inputs. This flexibility often leads users to omit certain details, relying on…

Computer Science and Game Theory · Computer Science 2026-05-13 Charlotte Park , Kate Donahue , Manish Raghavan

Recommender systems mainly tailor personalized recommendations according to user interests learned from user feedback. However, such recommender systems passively cater to user interests and even reinforce existing interests in the feedback…

Information Retrieval · Computer Science 2024-03-13 Shuxian Bi , Wenjie Wang , Hang Pan , Fuli Feng , Xiangnan He

Preference-based feedback is important for many applications in machine learning where evaluation of a reward function is not feasible. Notable recent examples arise in preference alignment for large language models, including in…

Conversational recommenders are emerging as a powerful tool to personalize a user's recommendation experience. Through a back-and-forth dialogue, users can quickly hone in on just the right items. Many approaches to conversational…

Information Retrieval · Computer Science 2023-02-15 Allen Lin , Ziwei Zhu , Jianling Wang , James Caverlee

Recommender systems are expected to be assistants that help human users find relevant information automatically without explicit queries. As recommender systems evolve, increasingly sophisticated learning techniques are applied and have…

Information Retrieval · Computer Science 2023-12-19 Zhengbang Zhu , Rongjun Qin , Junjie Huang , Xinyi Dai , Yang Yu , Yong Yu , Weinan Zhang

Recommender systems are often designed based on a collaborative filtering approach, where user preferences are predicted by modelling interactions between users and items. Many common approaches to solve the collaborative filtering task are…

Machine Learning · Computer Science 2021-10-11 Yinchong Yang , Florian Buettner

In a variety of application settings, the user preference for a planning task - the precise optimization objective - is difficult to elicit. One possible remedy is planning as an iterative process, allowing the user to iteratively refine…

Artificial Intelligence · Computer Science 2020-11-20 Rebecca Eifler , Jörg Hoffmann

In the one-class recommendation problem, it's required to make recommendations basing on users' implicit feedback, which is inferred from their action and inaction. Existing works obtain representations of users and items by encoding…

Information Retrieval · Computer Science 2024-01-22 Chu-Jen Shao , Hao-Ming Fu , Pu-Jen Cheng

Many real world problems can be defined as optimisation problems in which the aim is to maximise an objective function. The quality of obtained solution is directly linked to the pertinence of the used objective function. However, designing…

Machine Learning · Computer Science 2012-04-24 Patrick Taillandier , Julien Gaffuri

We propose opportunistic evaluation, a framework for accelerating interactions with dataframes. Interactive latency is critical for iterative, human-in-the-loop dataframe workloads for supporting exploratory data analysis. Opportunistic…

Decision-making is a cognitively intensive task that requires synthesizing relevant information from multiple unstructured sources, weighing competing factors, and incorporating subjective user preferences. Existing methods, including large…

Computation and Language · Computer Science 2026-04-21 Akriti Jain , Anish Mulay , Divyansh Verma , Aishani Pandey , Pritika Ramu , Aparna Garimella

How would you search for a unique, fashionable shoe that a friend wore and you want to buy, but you didn't take a picture? Existing approaches propose interactive image search as a promising venue. However, they either entrust the user with…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Nils Murrugarra-Llerena , Adriana Kovashka