English
Related papers

Related papers: Human Preference-Based Learning for High-dimension…

200 papers

Current exoskeleton control methods often face challenges in delivering personalized treatment. Standardized walking gaits can lead to patient discomfort or even injury. Therefore, personalized gait is essential for the effectiveness of…

Robotics · Computer Science 2025-05-26 Lijiang Liu , Junyu Shi , Yong Sun , Zhiyuan Zhang , Jinni Zhou , Shugen Ma , Qiang Nie

Designing generalizable control policies for lower-limb exoskeletons remains fundamentally constrained by exhaustive data collection or iterative optimization procedures, which limit accessibility to clinical populations. To address this…

Robotics · Computer Science 2026-04-13 Itak Choi , Ilseung Park , Eni Halilaj , Inseung Kang

User preference modeling is a vital yet challenging problem in personalized product search. In recent years, latent space based methods have achieved state-of-the-art performance by jointly learning semantic representations of products,…

Information Retrieval · Computer Science 2022-02-15 Fan Lu , Qimai Li , Bo Liu , Xiao-Ming Wu , Xiaotong Zhang , Fuyu Lv , Guli Lin , Sen Li , Taiwei Jin , Keping Yang

Lower limbs exoskeletons provide assistance during standing, squatting, and walking. Gait dynamics, in particular, implies a change in the configuration of the device in terms of contact points, actuation, and system dynamics in general. In…

Robotics · Computer Science 2021-07-09 Vittorio Lippi , Cristian Camardella , Alessandro Filippeschi , Francesco Porcini

This paper presents a framework that leverages both control theory and machine learning to obtain stable and robust bipedal locomotion without the need for manual parameter tuning. Traditionally, gaits are generated through trajectory…

Robotics · Computer Science 2021-03-31 Maegan Tucker , Noel Csomay-Shanklin , Wen-Loong Ma , Aaron D. Ames

It is well-known that a deep understanding of co-workers' behavior and preference is important for collaboration effectiveness. In this work, we present a method to accomplish smooth human-robot collaboration in close proximity by taking…

Robotics · Computer Science 2019-05-20 Xuan Zhao , Jia Pan

Many gait recognition methods first partition the human gait into N-parts and then combine them to establish part-based feature representations. Their gait recognition performance is often affected by partitioning strategies, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Ming Wang , Beibei Lin , Xianda Guo , Lincheng Li , Zheng Zhu , Jiande Sun , Shunli Zhang , Xin Yu

We present an approach to robot learning from egocentric human videos by modeling human preferences in a reward function and optimizing robot behavior to maximize this reward. Prior work on reward learning from human videos attempts to…

Robotics · Computer Science 2026-02-13 Mrinal Verghese , Christopher G. Atkeson

This paper addresses the problem of preference learning, which aims to align robot behaviors through learning user specific preferences (e.g. "good pull-over location") from visual demonstrations. Despite its similarity to learning factual…

Robotics · Computer Science 2025-01-16 Sadanand Modak , Noah Patton , Isil Dillig , Joydeep Biswas

Robotic exoskeletons are exciting technologies for augmenting human mobility. However, designing such a device for seamless integration with the human user and to assist human movement still is a major challenge. This paper aims at…

Robotics · Computer Science 2020-11-13 Xikai Tu , Minhan Li , Ming Liu , Jennie Si , He , Huang

The current reward learning from human preferences could be used to resolve complex reinforcement learning (RL) tasks without access to a reward function by defining a single fixed preference between pairs of trajectory segments. However,…

Artificial Intelligence · Computer Science 2020-12-29 Zehong Cao , KaiChiu Wong , Chin-Teng Lin

Accurate detection of locomotion transitions, such as walk to sit, walk to stair ascent, and descent, is crucial to effectively control robotic assistive devices, such as lower-limb exoskeletons, as each locomotion mode requires specific…

Gait asymmetry is a significant clinical characteristic of hemiplegic gait that most stroke survivors suffer, leading to limited mobility and long-term negative impacts on their quality of life. Although a variety of exoskeleton controls…

Robotics · Computer Science 2025-03-25 Yuepeng Qian , Jingfeng Xiong , Haoyong Yu , Chenglong Fu

Preference learning has long been studied in Human-Robot Interaction (HRI) in order to adapt robot behavior to specific user needs and desires. Typically, human preferences are modeled as a scalar function; however, such a formulation…

Robotics · Computer Science 2024-04-01 Austin Narcomey , Nathan Tsoi , Ruta Desai , Marynel Vázquez

Experimental demonstration of complex robotic behaviors relies heavily on finding the correct controller gains. This painstaking process is often completed by a domain expert, requiring deep knowledge of the relationship between parameter…

Robotics · Computer Science 2022-03-03 Noel Csomay-Shanklin , Maegan Tucker , Min Dai , Jenna Reher , Aaron D. Ames

Human-in-the-loop reinforcement learning allows the training of agents through various interfaces, even for non-expert humans. Recently, preference-based methods (PbRL), where the human has to give his preference over two trajectories,…

Artificial Intelligence · Computer Science 2024-08-06 Jakob Karalus

Many real-world engineering problems rely on human preferences to guide their design and optimization. We present PrefOpt, an open source package to simplify sequential optimization tasks that incorporate human preference feedback. Our…

Machine Learning · Computer Science 2018-01-10 Ian Dewancker , Jakob Bauer , Michael McCourt

Current metrics for text-to-image models typically rely on statistical metrics which inadequately represent the real preference of humans. Although recent work attempts to learn these preferences via human annotated images, they reduce the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Sixian Zhang , Bohan Wang , Junqiang Wu , Yan Li , Tingting Gao , Di Zhang , Zhongyuan Wang

Over the years, the separate fields of motion planning, mapping, and human trajectory prediction have advanced considerably. However, the literature is still sparse in providing practical frameworks that enable mobile manipulators to…

Robotics · Computer Science 2022-07-27 Mark Nicholas Finean , Luka Petrović , Wolfgang Merkt , Ivan Marković , Ioannis Havoutis

We analyze the problem of learning a single user's preferences in an active learning setting, sequentially and adaptively querying the user over a finite time horizon. Learning is conducted via choice-based queries, where the user selects…

Machine Learning · Statistics 2017-02-27 Stephen N. Pallone , Peter I. Frazier , Shane G. Henderson