English
Related papers

Related papers: Efficient Human-in-the-Loop Optimization via Prior…

200 papers

Multi-objective reinforcement learning (MORL) aims to find a set of high-performing and diverse policies that address trade-offs between multiple conflicting objectives. However, in practice, decision makers (DMs) often deploy only one or a…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Ke Li , Han Guo

Integrating human expertise into machine learning systems often reduces the role of experts to labeling oracles, a paradigm that limits the amount of information exchanged and fails to capture the nuances of human judgment. We address this…

Human-Computer Interaction · Computer Science 2026-02-18 Belén Martín-Urcelay , Yoonsang Lee , Matthieu R. Bloch , Christopher J. Rozell

In the realm of autonomous vehicles, dynamic user preferences are critical yet challenging to accommodate. Existing methods often misrepresent these preferences, either by overlooking their dynamism or overburdening users as humans often…

Human-Computer Interaction · Computer Science 2024-03-06 Mingyue Zhang , Jialong Li , Nianyu Li , Eunsuk Kang , Kenji Tei

Robots can use auditory, visual, or haptic interfaces to convey information to human users. The way these interfaces select signals is typically pre-defined by the designer: for instance, a haptic wristband might vibrate when the robot is…

Robotics · Computer Science 2025-03-20 Benjamin A. Christie , Dylan P. Losey

This article presents a method for learning well-coordinated Human-Robot Interaction (HRI) from Human-Human Interactions (HHI). We devise a hybrid approach using Hidden Markov Models (HMMs) as the latent space priors for a Variational…

Despite the recent successes of multi-agent reinforcement learning (MARL) algorithms, efficiently adapting to co-players in mixed-motive environments remains a significant challenge. One feasible approach is to hierarchically model…

Artificial Intelligence · Computer Science 2024-07-15 Yizhe Huang , Anji Liu , Fanqi Kong , Yaodong Yang , Song-Chun Zhu , Xue Feng

Grasping the intricacies of human motion, which involve perceiving spatio-temporal dependence and multi-scale effects, is essential for predicting human motion. While humans inherently possess the requisite skills to navigate this issue, it…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Kedi Lyu , Haipeng Chen , Zhenguang Liu , Yifang Yin , Yukang Lin , Yingying Jiao

Latent space representations are critical for understanding and improving the behavior of machine learning models, yet they often remain obscure and intricate. Understanding and exploring the latent space has the potential to contribute…

Machine Learning · Computer Science 2025-05-13 Daniel Geissler , Lars Krupp , Vishal Banwari , David Habusch , Bo Zhou , Paul Lukowicz , Jakob Karolus

Prompt optimization aims to find the best prompt to a large language model (LLM) for a given task. LLMs have been successfully used to help find and improve prompt candidates for single-step tasks. However, realistic tasks for agents are…

Computation and Language · Computer Science 2024-10-04 Yongchao Chen , Jacob Arkin , Yilun Hao , Yang Zhang , Nicholas Roy , Chuchu Fan

The performance of policy gradient methods is sensitive to hyperparameter settings that must be tuned for any new application. Widely used grid search methods for tuning hyperparameters are sample inefficient and computationally expensive.…

Machine Learning · Computer Science 2019-09-19 Supratik Paul , Vitaly Kurin , Shimon Whiteson

The increasing use of robots in unstructured environments necessitates the development of effective perception and navigation strategies to enable field robots to successfully perform their tasks. In particular, it is key for such robots to…

Robotics · Computer Science 2025-04-29 Andre Schreiber , Katherine Driggs-Campbell

Optimization with preference feedback is an active research area with many applications in engineering systems where humans play a central role, such as building control and autonomous vehicles. While most existing studies focus on…

Optimization and Control · Mathematics 2026-03-31 Wenbin Wang , Wenjie Xu , Colin N. Jones

Stochastic human motion prediction is critical for safe and effective human-robot collaboration (HRC) in industrial remanufacturing, as it captures human motion uncertainties and multi-modal behaviors that deterministic methods cannot…

Robotics · Computer Science 2025-12-17 Sibo Tian , Minghui Zheng , Xiao Liang

Adaptive interfaces can help users perform sequential decision-making tasks like robotic teleoperation given noisy, high-dimensional command signals (e.g., from a brain-computer interface). Recent advances in human-in-the-loop machine…

Robotics · Computer Science 2023-09-08 Jensen Gao , Siddharth Reddy , Glen Berseth , Anca D. Dragan , Sergey Levine

Providing reinforcement learning agents with informationally rich human knowledge can dramatically improve various aspects of learning. Prior work has developed different kinds of shaping methods that enable agents to learn efficiently in…

Human-Computer Interaction · Computer Science 2018-11-13 Chao Yu , Tianpei Yang , Wenxuan Zhu , Dongxu wang , Guangliang Li

Robots are becoming increasingly integrated into our lives, assisting us in various tasks. To ensure effective collaboration between humans and robots, it is essential that they understand our intentions and anticipate our actions. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Esteve Valls Mascaro , Daniel Sliwowski , Dongheui Lee

We introduce Hindsight-Guided Momentum (HGM), a first-order optimization algorithm that adaptively scales learning rates based on the directional consistency of recent updates. Traditional adaptive methods, such as Adam or RMSprop , adapt…

Optimization and Control · Mathematics 2025-07-01 Krisanu Sarkar

The complexities of information processing across Dynamic Data Driven Applications Systems drive the development and adoption of Artificial Intelligence-based optimization solutions. Traditional solvers often suffer from slow response times…

Systems and Control · Electrical Eng. & Systems 2024-07-09 Meiyi Li , Javad Mohammadi

In this work, we present a novel human-in-the-loop framework to help the human user understand the decision making process that involves choosing preferred options. We focus on qualitative preference models over alternatives from…

Artificial Intelligence · Computer Science 2019-09-20 Joseph Allen , Ahmed Moussa , Xudong Liu

Augmented reading systems aim to adapt text presentation to improve comprehension and task performance, yet existing approaches rely heavily on heuristics, opaque data-driven models, or repeated human involvement in the design loop. We…

Human-Computer Interaction · Computer Science 2026-02-27 Yunpeng Bai , Shengdong Zhao , Antti Oulasvirta