English
Related papers

Related papers: Evaluating Deep Human-in-the-Loop Optimization for…

200 papers

Adjusting visual parameters such as brightness and contrast is common in our everyday experiences. Finding the optimal parameter setting is challenging due to the large search space and the lack of an explicit objective function, leaving…

Human-Computer Interaction · Computer Science 2025-08-14 Zhipeng Li , Yi-Chi Liao , Christian Holz

As the global population ages, effective rehabilitation and mobility aids will become increasingly critical. Gait assistive robots are promising solutions, but designing adaptable controllers for various impairments poses a significant…

Robotics · Computer Science 2025-10-28 Yifan Wang , Sherwin Stephen Chan , Mingyuan Lei , Lek Syn Lim , Henry Johan , Bingran Zuo , Wei Tech Ang

Human-in-the-loop guidance has emerged as an effective approach for enabling faster convergence in online reinforcement learning (RL) of complex real-world manipulation tasks. However, existing human-in-the-loop RL (HiL-RL) frameworks often…

Robotics · Computer Science 2026-01-29 Haoyuan Deng , Yuanjiang Xue , Haoyang Du , Boyang Zhou , Zhenyu Wu , Ziwei Wang

The capacity for artificial intelligence (AI) to formulate, evolve, and test altered thought patterns under dynamic conditions indicates advanced cognition that is crucial for scientific discovery. The existing AI development landscape…

Artificial Intelligence · Computer Science 2025-08-06 Newman Cheng , Gordon Broadbent , William Chappell

Optimal input settings vary across users due to differences in motor abilities and personal preferences, which are typically addressed by manual tuning or calibration. Although human-in-the-loop optimization has the potential to identify…

Human-Computer Interaction · Computer Science 2025-03-10 Yi-Chi Liao , Paul Streli , Zhipeng Li , Christoph Gebhardt , Christian Holz

Interfaces for human oversight must effectively support users' situation awareness under time-critical conditions. We explore reinforcement learning (RL)-based UI adaptation to personalize alerting strategies that balance the benefits of…

Human-Computer Interaction · Computer Science 2026-02-10 Thorsten Klößner , João Belo , Zekun Wu , Jörg Hoffmann , Anna Maria Feit

Human intervention is an effective way to inject human knowledge into the training loop of reinforcement learning, which can bring fast learning and ensured training safety. Given the very limited budget of human intervention, it remains…

Machine Learning · Computer Science 2022-02-22 Quanyi Li , Zhenghao Peng , Bolei Zhou

Current visual implants still provide very low resolution and limited field of view, thus limiting visual acuity in implanted patients. Developments of new strategies of artificial vision simulation systems by harnessing new advancements in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Melani Sanchez-Garcia , Roberto Morollon-Ruiz , Ruben Martinez-Cantin , Jose J. Guerrero , Eduardo Fernandez-Jover

Reconstructing 3D clothed human involves creating a detailed geometry of individuals in clothing, with applications ranging from virtual try-on, movies, to games. To enable practical and widespread applications, recent advances propose to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yifan Yang , Dong Liu , Shuhai Zhang , Zeshuai Deng , Zixiong Huang , Mingkui Tan

In previous work, the authors proposed a data-driven optimisation algorithm for the personalisation of human-prosthetic interfaces, demonstrating the possibility of adapting prosthesis behaviour to its user while the user performs tasks…

Robotics · Computer Science 2020-03-04 Ricardo Garcia-Rosas , Tianshi Yu , Denny Oetomo , Chris Manzie , Ying Tan , Peter Choong

Despite all the benefits of automated hyperparameter optimization (HPO), most modern HPO algorithms are black-boxes themselves. This makes it difficult to understand the decision process which leads to the selected configuration, reduces…

Machine Learning · Computer Science 2023-02-14 Julia Moosbauer , Giuseppe Casalicchio , Marius Lindauer , Bernd Bischl

Data Quality Monitoring (DQM) is a crucial task in large particle physics experiments, since detector malfunctioning can compromise the data. DQM is currently performed by human shifters, which is costly and results in limited accuracy. In…

Large Vision-Language Models (LVLMs) have shown promising capabilities in understanding and generating information by integrating both visual and textual data. However, current models are still prone to hallucinations, which degrade the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Robert Wijaya , Ngoc-Bao Nguyen , Ngai-Man Cheung

Direct Preference Optimization (DPO) has been successfully used to align large language models (LLMs) according to human preferences, and more recently it has also been applied to improving the quality of text-to-image diffusion models.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Shivanshu Shekhar , Shreyas Singh , Tong Zhang

Reinforcement learning (RL) is widely used to produce robust robotic manipulation policies, but fine-tuning vision-language-action (VLA) models with RL can be unstable due to inaccurate value estimates and sparse supervision at intermediate…

Robotics · Computer Science 2025-10-31 Guanxing Lu , Rui Zhao , Haitao Lin , He Zhang , Yansong Tang

Achieving fairness in sequential-decision making systems within Human-in-the-Loop (HITL) environments is a critical concern, especially when multiple humans with different behavior and expectations are affected by the same adaptation…

Machine Learning · Computer Science 2023-11-08 Tianyu Zhao , Mojtaba Taherisadr , Salma Elmalaki

Non-prehensile manipulation is challenging due to complex contact interactions between objects, the environment, and robots. Model-based approaches can efficiently generate complex trajectories of robots and objects under contact…

Robotics · Computer Science 2025-08-07 Yuki Shirai , Kei Ota , Devesh K. Jha , Diego Romeres

Existing 3D human pose estimation models suffer performance drop when applying to new scenarios with unseen poses due to their limited generalizability. In this work, we propose a novel framework, Inference Stage Optimization (ISO), for…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Jianfeng Zhang , Xuecheng Nie , Jiashi Feng

While Vision-Language-Action (VLA) models have demonstrated promising generalization capabilities in robotic manipulation, deploying them on specific and complex downstream tasks still demands effective post-training. In parallel,…

Robotics · Computer Science 2026-03-11 Yifan Han , Zhongxi Chen , Yuxuan Zhao , Congsheng Xu , Yanming Shao , Yichuan Peng , Yao Mu , Wenzhao Lian

Protein sequence optimization under tight oracle budgets requires methods that explore vast combinatorial spaces while making each evaluation informative. Existing reinforcement learning and off-policy generative approaches often degrade…

Machine Learning · Computer Science 2026-05-27 Ashima Khanna , Dominik Grimm