English
Related papers

Related papers: Evaluating Deep Human-in-the-Loop Optimization for…

200 papers

Some imitation learning methods combine behavioural cloning with self-supervision to infer actions from state pairs. However, most rely on a large number of expert trajectories to increase generalisation and human intervention to capture…

Machine Learning · Computer Science 2024-07-23 Nathan Gavenski , Juarez Monteiro , Felipe Meneguzzi , Michael Luck , Odinaldo Rodrigues

Vision-Language-Action (VLA) models are prone to compounding errors in dexterous manipulation, where high-dimensional action spaces and contact-rich dynamics amplify small policy deviations over long horizons. While Interactive Imitation…

Robotics · Computer Science 2026-05-21 Zhuohang Li , Liqun Huang , Wei Xu , Zhengming Zhu , Nie Lin , Xiao Ma , Xinjun Sheng , Ruoshi Wen

Manipulation of deformable Linear objects (DLOs), including iron wire, rubber, silk, and nylon rope, is ubiquitous in daily life. These objects exhibit diverse physical properties, such as Young$'$s modulus and bending stiffness.Such…

Robotics · Computer Science 2024-11-01 Mingen Li , Changhyun Choi

We present NPO, an alignment-aware learning framework that operationalizes feedback-driven adaptation in human-in-the-loop decision systems. Unlike prior approaches that treat alignment as a static or post-hoc property, NPO introduces a…

Artificial Intelligence · Computer Science 2025-07-30 Madhava Gaikwad , Ashwini Ramchandra Doke

Human object interaction (HOI) detection plays a crucial role in human-centric scene understanding and serves as a fundamental building-block for many vision tasks. One generalizable and scalable strategy for HOI detection is to use weak…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Bo Wan , Yongfei Liu , Desen Zhou , Tinne Tuytelaars , Xuming He

Inertial Confinement Fusion (ICF) holds transformative promise for sustainable, near-limitless clean energy, yet remains constrained by prohibitively high costs and limited experimental opportunities. This paper presents Human-in-the-Loop…

Large language models (LLMs) have significantly advanced in reasoning tasks through reinforcement learning (RL) optimization, achieving impressive capabilities across various challenging benchmarks. However, our empirical analysis reveals a…

Computation and Language · Computer Science 2025-11-07 Junyi Li , Hwee Tou Ng

This paper introduces Multi-Output LOcal Narrative Explanation (MOLONE), a novel comparative explanation method designed to enhance preference selection in human-in-the-loop Preference Bayesian optimization (PBO). The preference elicitation…

Machine Learning · Computer Science 2025-08-25 Tanmay Chakraborty , Christian Wirth , Christin Seifert

Writing high-performance image processing code is challenging and labor-intensive. The Halide programming language simplifies this task by decoupling high-level algorithms from "schedules" which optimize their implementation. However, even…

Human-Computer Interaction · Computer Science 2024-11-08 Yuka Ikarashi , Jonathan Ragan-Kelley , Tsukasa Fukusato , Jun Kato , Takeo Igarashi

Demands on more transparency of the backbox nature of machine learning models have led to the recent rise of human-in-the-loop in machine learning, i.e. processes that integrate humans in the training and application of machine learning…

Human-Computer Interaction · Computer Science 2020-03-12 Chaehan So

With the increasing application of automated robotic digestive endoscopy (RDE), ensuring safe and efficient navigation in the unstructured and narrow digestive tract has become a critical challenge. Existing automated reinforcement learning…

Robotics · Computer Science 2025-04-01 Min Tan , Yushun Tao , Boyun Zheng , GaoSheng Xie , Lijuan Feng , Zeyang Xia , Jing Xiong

Modern industrial systems require updated approaches to safety management, as the tight interplay between cyber-physical, human, and organizational factors has driven their processes toward increasing complexity. In addition to dealing with…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Francesco Simone , Marco Bortolini , Giovanni Mazzuto , Giulio di Gravio , Riccardo Patriarca

Proximal Policy Optimization (PPO)-based reinforcement learning from human feedback (RLHF) is a widely adopted paradigm for aligning large language models (LLMs) with human preferences. However, its training pipeline suffers from…

Machine Learning · Computer Science 2026-03-06 Kaizhuo Yan , Yingjie Yu , Yifan Yu , Haizhong Zheng , Fan Lai

Human-Object Interaction (HOI) detection, which localizes and infers relationships between human and objects, plays an important role in scene understanding. Although two-stage HOI detectors have advantages of high efficiency in training…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jeeseung Park , Jin-Woo Park , Jong-Seok Lee

Robotic-assisted procedures offer numerous advantages over traditional approaches, including improved dexterity, reduced fatigue, minimized trauma, and superior outcomes. However, the main challenge of these systems remains the poor…

Direct Preference Optimization (DPO) is an effective framework for aligning large language models with human preferences, but it struggles with complex reasoning tasks. DPO optimizes for the likelihood of generating preferred over…

Artificial Intelligence · Computer Science 2026-04-23 Darsh Kachroo , Adriana Caraeni , Arjun Prasaath Anbazhagan , Brennan Lagasse , Kevin Zhu

Multi-turn human-AI collaboration is fundamental to deploying interactive services such as adaptive tutoring, conversational recommendation, and professional consultation. However, optimizing these interactions via reinforcement learning is…

Machine Learning · Computer Science 2026-03-26 Haoyu Wang , Yuxin Chen , Liang Luo , Buyun Zhang , Ellie Dingqiao Wen , Pan Li

To avoid myopic behavior, multi-step lookahead Bayesian optimization (BO) algorithms consider the sequential nature of BO and have demonstrated promising results in recent years. However, owing to the curse of dimensionality, most of these…

Machine Learning · Computer Science 2026-04-24 Mujin Cheon , Jay H. Lee , Dong-Yeun Koh , Calvin Tsay

We study human-in-the-loop reinforcement learning (RL) with trajectory preferences, where instead of receiving a numeric reward at each step, the agent only receives preferences over trajectory pairs from a human overseer. The goal of the…

Machine Learning · Computer Science 2022-05-25 Xiaoyu Chen , Han Zhong , Zhuoran Yang , Zhaoran Wang , Liwei Wang