English
Related papers

Related papers: Human-In-The-Loop Learning of Qualitative Preferen…

200 papers

In sequential recommendation, models recommend items based on user's interaction history. To this end, current models usually incorporate information such as item descriptions and user intent or preferences. User preferences are usually not…

The vast majority of recommender systems model preferences as static or slowly changing due to observable user experience. However, spontaneous changes in user preferences are ubiquitous in many domains like media consumption and key…

Human-Computer Interaction · Computer Science 2016-10-24 Arun Kumar , Paul Schrater

Recommender systems play a critical role in enhancing user experience by providing personalized suggestions based on user preferences. Traditional approaches often rely on explicit numerical ratings or assume access to fully ranked lists of…

Information Retrieval · Computer Science 2025-08-22 Bahar Boroomand , James R. Wright

Options represent a framework for reasoning across multiple time scales in reinforcement learning (RL). With the recent active interest in the unsupervised learning paradigm in the RL research community, the option framework was adapted to…

Artificial Intelligence · Computer Science 2022-06-14 Djordje Božić , Predrag Tadić , Mladen Nikolić

Smart assistants increasingly act proactively, yet mistimed or intrusive behavior often causes users to lose trust and disable these features. Learning user preferences for proactive assistance is difficult because real-world studies are…

Human-Computer Interaction · Computer Science 2026-02-05 Ziyi Xuan , Yiwen Wu , Zhaoyang Yan , Vinod Namboodiri , Yu Yang

Environments built for people are increasingly operated by a new class of economic actors: LLM-powered software agents making decisions on our behalf. These decisions range from our purchases to travel plans to medical treatment selection.…

Artificial Intelligence · Computer Science 2026-02-25 Manuel Cherep , Chengtian Ma , Abigail Xu , Maya Shaked , Pattie Maes , Nikhil Singh

Items in modern recommender systems are often organized in hierarchical structures. These hierarchical structures and the data within them provide valuable information for building personalized recommendation systems. In this paper, we…

Machine Learning · Computer Science 2019-08-21 Zitao Liu , Zhexuan Xu , Yan Yan

Preference elicitation is the task of suggesting a highly preferred configuration to a decision maker. The preferences are typically learned by querying the user for choice feedback over pairs or sets of objects. In its constructive…

Artificial Intelligence · Computer Science 2018-05-08 Paolo Dragone , Stefano Teso , Andrea Passerini

Recent successes combine reinforcement learning algorithms and deep neural networks, despite reinforcement learning not being widely applied to robotics and real world scenarios. This can be attributed to the fact that current…

Machine Learning · Computer Science 2020-09-01 Vinicius G. Goecks

With the development of autonomous driving, it is becoming increasingly common for autonomous vehicles (AVs) and human-driven vehicles (HVs) to travel on the same roads. Existing single-vehicle planning algorithms on board struggle to…

Robotics · Computer Science 2023-02-15 Licheng Wen , Pinlong Cai , Daocheng Fu , Song Mao , Yikang Li

Aligning LLM-based judges with human preferences is a significant challenge, as they are difficult to calibrate and often suffer from rubric sensitivity, bias, and instability. Overcoming this challenge advances key applications, such as…

Information about user preferences plays a key role in automated decision making. In many domains it is desirable to assess such preferences in a qualitative rather than quantitative way. In this paper, we propose a qualitative graphical…

Artificial Intelligence · Computer Science 2011-07-04 C. Boutilier , R. I. Brafman , C. Domshlak , H. H. Hoos , D. Poole

We introduce a new convolutional AutoEncoder architecture for user modelling and recommendation tasks with several improvements over the state of the art. Firstly, our model has the flexibility to learn a set of associations and…

Machine Learning · Computer Science 2025-09-10 Antoine Ledent , Petr Kasalický , Rodrigo Alves , Hady W. Lauw

This paper presents an exploration of preference learning in text-to-motion generation. We find that current improvements in text-to-motion generation still rely on datasets requiring expert labelers with motion capture systems. Instead,…

Machine Learning · Computer Science 2024-04-16 Jenny Sheng , Matthieu Lin , Andrew Zhao , Kevin Pruvost , Yu-Hui Wen , Yangguang Li , Gao Huang , Yong-Jin Liu

Collaborative filtering is a popular technique to infer users' preferences on new content based on the collective information of all users preferences. Recommender systems then use this information to make personalized suggestions to users.…

Social and Information Networks · Computer Science 2017-03-06 Ayan Sinha , David F. Gleich , Karthik Ramani

Data generation and labeling are usually an expensive part of learning for robotics. While active learning methods are commonly used to tackle the former problem, preference-based learning is a concept that attempts to solve the latter by…

Machine Learning · Computer Science 2018-10-11 Erdem Bıyık , Dorsa Sadigh

Large language models demonstrate impressive reasoning abilities but struggle to provide personalized content due to their lack of individual user preference information. Existing methods, such as in-context learning and parameter-efficient…

Computation and Language · Computer Science 2024-12-10 Sumuk Shashidhar , Abhinav Chinta , Vaibhav Sahai , Dilek Hakkani-Tür

Model Predictive Control (MPC) is a powerful control strategy widely utilized in domains like energy management, building control, and autonomous systems. However, its effectiveness in real-world settings is challenged by the need to…

Systems and Control · Electrical Eng. & Systems 2025-09-08 Ruixiang Wu , Jiahao Ai , Tongxin Li

Machine learning workflow development is anecdotally regarded to be an iterative process of trial-and-error with humans-in-the-loop. However, we are not aware of quantitative evidence corroborating this popular belief. A quantitative…

Machine Learning · Computer Science 2018-05-21 Doris Xin , Litian Ma , Shuchen Song , Aditya Parameswaran

Human-AI coevolution, defined as a process in which humans and AI algorithms continuously influence each other, increasingly characterises our society, but is understudied in artificial intelligence and complexity science literature.…