English
Related papers

Related papers: Human-In-The-Loop Learning of Qualitative Preferen…

200 papers

Human-in-the-loop reinforcement learning allows the training of agents through various interfaces, even for non-expert humans. Recently, preference-based methods (PbRL), where the human has to give his preference over two trajectories,…

Artificial Intelligence · Computer Science 2024-08-06 Jakob Karalus

System-provided explanations for recommendations are an important component towards transparent and trustworthy AI. In state-of-the-art research, this is a one-way signal, though, to improve user acceptance. In this paper, we turn the role…

Information Retrieval · Computer Science 2021-05-04 Azin Ghazimatin , Soumajit Pramanik , Rishiraj Saha Roy , Gerhard Weikum

Human-in-the-loop topic modelling incorporates users' knowledge into the modelling process, enabling them to refine the model iteratively. Recent research has demonstrated the value of user feedback, but there are still issues to consider,…

Computation and Language · Computer Science 2023-04-05 Zheng Fang , Lama Alqazlan , Du Liu , Yulan He , Rob Procter

Integrating human expertise into machine learning systems often reduces the role of experts to labeling oracles, a paradigm that limits the amount of information exchanged and fails to capture the nuances of human judgment. We address this…

Human-Computer Interaction · Computer Science 2026-02-18 Belén Martín-Urcelay , Yoonsang Lee , Matthieu R. Bloch , Christopher J. Rozell

We propose a new online learning model for learning with preference feedback. The model is especially suited for applications like web search and recommender systems, where preference data is readily available from implicit user feedback…

Machine Learning · Computer Science 2011-11-04 Pannagadatta K. Shivaswamy , Thorsten Joachims

Human-in-the-loop aims to train an accurate prediction model with minimum cost by integrating human knowledge and experience. Humans can provide training data for machine learning applications and directly accomplish tasks that are hard for…

Machine Learning · Computer Science 2022-05-20 Xingjiao Wu , Luwei Xiao , Yixuan Sun , Junhang Zhang , Tianlong Ma , Liang He

Segmentation models achieve high accuracy on benchmarks but often fail in real-world domains by relying on spurious correlations instead of true object boundaries. We propose a human-in-the-loop interactive framework that enables…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Pouya Shaeri , Ryan T. Woo , Yasaman Mohammadpour , Ariane Middel

Providing users with alternatives to choose from is an essential component in many online platforms, making the accurate prediction of choice vital to their success. A renewed interest in learning choice models has led to significant…

Machine Learning · Computer Science 2020-01-22 Nir Rosenfeld , Kojin Oshiba , Yaron Singer

Interactive AI systems increasingly employ a human-in-the-loop strategy. This creates new challenges for the HCI community when designing such systems. We reveal and investigate some of these challenges in a case study with an industry…

Human-Computer Interaction · Computer Science 2022-07-27 Changkun Ou , Daniel Buschek , Sven Mayer , Andreas Butz

Preference modelling lies at the intersection of economics, decision theory, machine learning and statistics. By understanding individuals' preferences and how they make choices, we can build products that closely match their expectations,…

Machine Learning · Computer Science 2026-05-19 Alessio Benavoli , Dario Azzimonti

We define a novel neuro-symbolic framework, argumentative reward learning, which combines preference-based argumentation with existing approaches to reinforcement learning from human feedback. Our method improves prior work by generalising…

Artificial Intelligence · Computer Science 2022-10-05 Francis Rhys Ward , Francesco Belardinelli , Francesca Toni

In this letter, we propose a control framework for human-in-the-loop systems, in which many human decision makers are involved in the feedback loop composed of a plant and a controller. The novelty of the framework is that the decision…

Systems and Control · Computer Science 2020-03-11 Masaki Inoue , Vijay Gupta

Demands on more transparency of the backbox nature of machine learning models have led to the recent rise of human-in-the-loop in machine learning, i.e. processes that integrate humans in the training and application of machine learning…

Human-Computer Interaction · Computer Science 2020-03-12 Chaehan So

This study focuses on the problem of path modeling in heterogeneous information networks and proposes a multi-hop path-aware recommendation framework. The method centers on multi-hop paths composed of various types of entities and…

Information Retrieval · Computer Science 2025-05-12 Hongye Zheng , Yue Xing , Lipeng Zhu , Xu Han , Junliang Du , Wanyu Cui

We consider the problem of learning good trajectories for manipulation tasks. This is challenging because the criterion defining a good trajectory varies with users, tasks and environments. In this paper, we propose a co-active online…

Robotics · Computer Science 2015-01-30 Ashesh Jain , Brian Wojcik , Thorsten Joachims , Ashutosh Saxena

A critical factor in the success of decision support systems is the accurate modeling of user preferences. Psychology research has demonstrated that users often develop their preferences during the elicitation process, highlighting the…

Human-Computer Interaction · Computer Science 2024-10-03 Connor Lawless , Jakob Schoeffer , Lindy Le , Kael Rowan , Shilad Sen , Cristina St. Hill , Jina Suh , Bahareh Sarrafzadeh

We consider the problem of learning preferences over trajectories for mobile manipulators such as personal robots and assembly line robots. The preferences we learn are more intricate than simple geometric constraints on trajectories; they…

Robotics · Computer Science 2016-01-06 Ashesh Jain , Shikhar Sharma , Thorsten Joachims , Ashutosh Saxena

In the realm of autonomous vehicles, dynamic user preferences are critical yet challenging to accommodate. Existing methods often misrepresent these preferences, either by overlooking their dynamism or overburdening users as humans often…

Human-Computer Interaction · Computer Science 2024-03-06 Mingyue Zhang , Jialong Li , Nianyu Li , Eunsuk Kang , Kenji Tei

Optimization with preference feedback is an active research area with many applications in engineering systems where humans play a central role, such as building control and autonomous vehicles. While most existing studies focus on…

Optimization and Control · Mathematics 2026-03-31 Wenbin Wang , Wenjie Xu , Colin N. Jones

Conversational recommendation frameworks have gained prominence as a dynamic paradigm for delivering personalized suggestions via interactive dialogues. The incorporation of advanced language understanding techniques has substantially…

Computation and Language · Computer Science 2025-03-17 Guanrong Li , Kuo Tian , Jinnan Qi , Qinghan Fu , Zhen Wu , Xinyu Dai
‹ Prev 1 2 3 10 Next ›