English
Related papers

Related papers: Bayesian Optimization Meets Hybrid Zero Dynamics: …

200 papers

We study the problem of realizing the full spectrum of bipedal locomotion on a real robot with sim-to-real reinforcement learning (RL). A key challenge of learning legged locomotion is describing different gaits, via reward functions, in a…

Robotics · Computer Science 2021-03-12 Jonah Siekmann , Yesh Godse , Alan Fern , Jonathan Hurst

This work aims to combine machine learning and control approaches for legged robots, and developed a hybrid framework to achieve new capabilities of balancing against external perturbations. The framework embeds a kernel which is a fully…

Robotics · Computer Science 2022-03-31 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis , Zhibin Li

Effective bipedal locomotion in dynamic environments, such as cluttered indoor spaces or uneven terrain, requires agile and adaptive movement in all directions. This necessitates omnidirectional terrain sensing and a controller capable of…

Robotics · Computer Science 2026-03-18 Mohitvishnu S. Gadde , Pranay Dugar , Ashish Malik , Alan Fern

This paper combines episodic learning and control barrier functions in the setting of bipedal locomotion. The safety guarantees that control barrier functions provide are only valid with perfect model knowledge; however, this assumption…

Robotics · Computer Science 2021-05-06 Noel Csomay-Shanklin , Ryan K. Cosner , Min Dai , Andrew J. Taylor , Aaron D. Ames

Robotic algorithms typically depend on various parameters, the choice of which significantly affects the robot's performance. While an initial guess for the parameters may be obtained from dynamic models of the robot, parameters are usually…

Robotics · Computer Science 2020-04-08 Felix Berkenkamp , Andreas Krause , Angela P. Schoellig

This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are…

Robotics · Computer Science 2021-12-23 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

This paper presents a Q-learning framework for learning optimal locomotion gaits in robotic systems modeled as coupled rigid bodies. Inspired by prevalence of periodic gaits in bio-locomotion, an open loop periodic input is assumed to (say)…

Systems and Control · Electrical Eng. & Systems 2019-10-02 Tixian Wang , Amirhossein Taghvaei , Prashant G. Mehta

Bridging model-based safety and model-free reinforcement learning (RL) for dynamic robots is appealing since model-based methods are able to provide formal safety guarantees, while RL-based methods are able to exploit the robot agility by…

Robotics · Computer Science 2022-05-13 Zhongyu Li , Jun Zeng , Akshay Thirugnanam , Koushil Sreenath

Uncertainty in state or model parameters is common in robotics and typically handled by acquiring system measurements that yield information about the uncertain quantities of interest. Inputs to a nonlinear dynamical system yield outcomes…

Robotics · Computer Science 2023-08-04 Parker Ewen , Gitesh Gunjal , Joey Wilson , Jinsun Liu , Challen Enninful Adu , Ram Vasudevan

Bipedal robots have received much attention because of the variety of motion maneuvers that they can produce, and the many applications they have in various areas including rehabilitation. One of these motion maneuvers is walking. In this…

Robotics · Computer Science 2023-01-03 Aref Amiri , Hassan Salarieh

Many control problems require repeated tuning and adaptation of controllers across distinct closed-loop tasks, where data efficiency and adaptability are critical. We propose a hierarchical Bayesian optimization (BO) framework that is…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Sebastian Hirt , Lukas Theiner , Maik Pfefferkorn , Rolf Findeisen

Wheeled-legged robots have the potential for highly agile and versatile locomotion. The combination of legs and wheels might be a solution for any real-world application requiring rapid, and long-distance mobility skills on challenging…

Robotics · Computer Science 2020-02-07 Marko Bjelonic , Prajish K. Sankar , C. Dario Bellicoso , Heike Vallery , Marco Hutter

Bayesian optimization (BO) has contributed greatly to improving model performance by suggesting promising hyperparameter configurations iteratively based on observations from multiple training trials. However, only partial knowledge (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 HyunJae Lee , Heon Song , Hyeonsoo Lee , Gi-hyeon Lee , Suyeong Park , Donggeun Yoo

Bayesian optimization (BO) has gained attention as an efficient algorithm for black-box optimization of expensive-to-evaluate systems, where the BO algorithm iteratively queries the system and suggests new trials based on a probabilistic…

Machine Learning · Computer Science 2026-03-13 Eike Cramer , Luis Kutschat , Oliver Stollenwerk , Joel A. Paulson , Alexander Mitsos

In the automation of many kinds of processes, the observable outcome can often be described as the combined effect of an entire sequence of actions, or controls, applied throughout its execution. In these cases, strategies to optimise…

Robotics · Computer Science 2019-04-05 Rafael Oliveira , Fernando H. M. Rocha , Lionel Ott , Vitor Guizilini , Fabio Ramos , Valdir Grassi

Recent work has demonstrated the success of reinforcement learning (RL) for training bipedal locomotion policies for real robots. This prior work, however, has focused on learning joint-coordination controllers based on an objective of…

Robotics · Computer Science 2021-05-07 Helei Duan , Jeremy Dao , Kevin Green , Taylor Apgar , Alan Fern , Jonathan Hurst

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

Machine Learning · Statistics 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

Legged robots have unparalleled mobility on unstructured terrains. However, it remains an open challenge to design locomotion controllers that can operate in a large variety of environments. In this paper, we address this challenge of…

Robotics · Computer Science 2020-11-12 Alejandro Escontrela , George Yu , Peng Xu , Atil Iscen , Jie Tan

We present ZSL-RPPO, an improved zero-shot learning architecture that overcomes the limitations of teacher-student neural networks and enables generating robust, reliable, and versatile locomotion for quadrupedal robots in challenging…

Robotics · Computer Science 2024-03-05 Yao Zhao , Tao Wu , Yijie Zhu , Xiang Lu , Jun Wang , Haitham Bou-Ammar , Xinyu Zhang , Peng Du

Practical bipedal robot locomotion needs to be both energy efficient and robust to variability and uncertainty. In this paper, we build upon recent works in trajectory optimization for robot locomotion with two primary goals. First, we wish…

Robotics · Computer Science 2018-07-27 Nihar Talele , Katie Byl