English
Related papers

Related papers: Human-in-the-Loop Control of Objective Drift in LL…

200 papers

While the role of humans is increasingly recognized in machine learning community, representation of and interaction with models in current human-in-the-loop machine learning (HITL-ML) approaches are too low-level and far-removed from…

Computation and Language · Computer Science 2021-09-17 Yiwei Yang , Eser Kandogan , Yunyao Li , Walter S. Lasecki , Prithviraj Sen

Human-in-the-loop (HITL) frameworks are increasingly recognized for their potential to improve annotation accuracy in emotion estimation systems by combining machine predictions with human expertise. This study focuses on integrating a…

Human-Computer Interaction · Computer Science 2025-06-10 Sahana Yadnakudige Subramanya , Ko Watanabe , Andreas Dengel , Shoya Ishimaru

Due to the limited smartness and abilities of machine intelligence, currently autonomous vehicles are still unable to handle all kinds of situations and completely replace drivers. Because humans exhibit strong robustness and adaptability…

Robotics · Computer Science 2021-04-16 Jingda Wu , Zhiyu Huang , Chao Huang , Zhongxu Hu , Peng Hang , Yang Xing , Chen Lv

Long-term interaction with LLM-based systems may produce alignment drift: a gradual process in which system outputs become less constrained by the user's current message and more shaped by prior interaction history, while still appearing…

Human-Computer Interaction · Computer Science 2026-05-19 Xintong Yao

Feedback is a critical component of the learning process, particularly in computer science education. This study investigates the quality of feedback generated by Large Language Models (LLMs), Small Language Models (SLMs), compared with…

Human-Computer Interaction · Computer Science 2026-01-21 Suqing Liu , Bogdan Simion , Christopher Eaton , Michael Liut

To facilitate the wider adoption of robotics, accessible programming tools are required for non-experts. Observational learning enables intuitive human skills transfer through hands-on demonstrations, but relying solely on visual input can…

Robotics · Computer Science 2025-07-29 Elena Merlo , Marta Lagomarsino , Arash Ajoudani

The large language model (LLM) has garnered significant attention due to its in-context learning mechanisms and emergent capabilities. The research community has conducted several pilot studies to apply LLMs to machine translation tasks and…

Computation and Language · Computer Science 2023-10-16 Xinyi Yang , Runzhe Zhan , Derek F. Wong , Junchao Wu , Lidia S. Chao

"Human-centered machine learning" (HCML) is a term that describes machine learning that applies to human-focused problems. Although this idea is noteworthy and generates scholarly excitement, scholars and practitioners have struggled to…

Machine Learning · Computer Science 2022-03-02 Stevie Chancellor

Interactive Task Learning (ITL) is an emerging research agenda that studies the design of complex intelligent robots that can acquire new knowledge through natural human teacher-robot learner interactions. ITL methods are particularly…

Robotics · Computer Science 2021-07-06 Preeti Ramaraj , Charles L. Ortiz, , Shiwali Mohan

Scaling educational assessment with large language models requires not just accuracy, but the ability to recognize when predictions are trustworthy. Instruction-tuned models tend to be overconfident, and their reliability deteriorates as…

Computation and Language · Computer Science 2026-03-13 Pranav Raikote , Korbinian Randl , Ioanna Miliou , Athanasios Lakes , Panagiotis Papapetrou

This paper investigates the planning and control problems for multi-robot systems under linear temporal logic (LTL) specifications. In contrast to most of existing literature, which presumes a static and known environment, our study focuses…

Robotics · Computer Science 2023-07-13 Pian Yu , Gianmarco Fedeli , Dimos V. Dimarogonas

How can we design Natural Language Processing (NLP) systems that learn from human feedback? There is a growing research body of Human-in-the-loop (HITL) NLP frameworks that continuously integrate human feedback to improve the model itself.…

Computation and Language · Computer Science 2021-03-09 Zijie J. Wang , Dongjin Choi , Shenyu Xu , Diyi Yang

Imitation learning from human demonstrations can teach robots complex manipulation skills, but is time-consuming and labor intensive. In contrast, Task and Motion Planning (TAMP) systems are automated and excel at solving long-horizon…

Robotics · Computer Science 2023-10-25 Ajay Mandlekar , Caelan Garrett , Danfei Xu , Dieter Fox

The development and deployment of systems using supervised machine learning (ML) remain challenging: mainly due to the limited reliability of prediction models and the lack of knowledge on how to effectively integrate human intelligence…

Software Engineering · Computer Science 2023-12-04 Jakob Smedegaard Andersen , Walid Maalej

Learning motor skills for sports or performance driving is often done with professional instruction from expert human teachers, whose availability is limited. Our goal is to enable automated teaching via a learned model that interacts with…

Development of machine learning (ML) workflows is a tedious process of iterative experimentation: developers repeatedly make changes to workflows until the desired accuracy is attained. We describe our vision for a "human-in-the-loop" ML…

Databases · Computer Science 2018-04-18 Doris Xin , Litian Ma , Jialin Liu , Stephen Macke , Shuchen Song , Aditya Parameswaran

Latent space representations are critical for understanding and improving the behavior of machine learning models, yet they often remain obscure and intricate. Understanding and exploring the latent space has the potential to contribute…

Machine Learning · Computer Science 2025-05-13 Daniel Geissler , Lars Krupp , Vishal Banwari , David Habusch , Bo Zhou , Paul Lukowicz , Jakob Karolus

As AI systems increasingly permeate high-stakes decision-making, the terminology regarding human involvement - Human-in-the-Loop (HITL), Human-on-the-Loop (HOTL), and Human Oversight - has become vexingly ambiguous. This ambiguity…

Computers and Society · Computer Science 2026-03-20 Kevin Baum , Johann Laux

Despite significant progress in autonomous vehicles (AVs), the development of driving policies that ensure both the safety of AVs and traffic flow efficiency has not yet been fully explored. In this paper, we propose an enhanced…

Machine Learning · Computer Science 2024-06-18 Zilin Huang , Zihao Sheng , Chengyuan Ma , Sikai Chen

While research on human-AI collaboration exists, it mainly examined language learning and used traditional counting methods with little attention to evolution and dynamics of collaboration on cognitively demanding tasks. This study examines…

Human-Computer Interaction · Computer Science 2025-08-18 Mohammed Saqr , Kamila Misiejuk , Sonsoles López-Pernas