English
Related papers

Related papers: Sample Efficient Optimization for Learning Control…

200 papers

Bayesian optimization has proven to be a highly effective methodology for the global optimization of unknown, expensive and multimodal functions. The ability to accurately model distributions over functions is critical to the effectiveness…

Machine Learning · Statistics 2014-06-13 Jasper Snoek , Kevin Swersky , Richard S. Zemel , Ryan P. Adams

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

Machine Learning · Computer Science 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

Deep reinforcement learning is a promising approach to learning policies in uncontrolled environments that do not require domain knowledge. Unfortunately, due to sample inefficiency, deep RL applications have primarily focused on simulated…

Robotics · Computer Science 2022-08-17 Laura Smith , Ilya Kostrikov , Sergey Levine

This paper presents a multi-phase whole-body model predictive control approach for bipedal walking, combining a detailed whole-body model in the near horizon with a simplified single-rigid-body model in the later prediction steps. This…

Robotics · Computer Science 2026-05-07 Franek Stark , Felix Wiebe , Shubham Vyas , Dennis Mronga , Frank Kirchner

Parallel-elastic joints can improve the efficiency and strength of robots by assisting the actuators with additional torques. For these benefits to be realized, a spring needs to be carefully designed. However, designing robots is an…

Robotics · Computer Science 2023-01-10 Filip Bjelonic , Joonho Lee , Philip Arm , Dhionis Sako , Davide Tateo , Jan Peters , Marco Hutter

Bilevel optimization, a hierarchical mathematical framework where one optimization problem is nested within another, has emerged as a powerful tool for modeling complex decision-making processes in various fields such as economics,…

Machine Learning · Computer Science 2024-12-25 Omer Ekmekcioglu , Nursen Aydin , Juergen Branke

Using Bayesian experimental design techniques, we have shown that for a single two-level quantum mechanical system under strong (projective) measurement, the dynamical parameters of a model Hamiltonian can be estimated with exponentially…

Quantum Physics · Physics 2012-06-05 Christopher Ferrie , Christopher E. Granade , D. G. Cory

Constrained learning is prevalent in many statistical tasks. Recent work proposes distance-to-set penalties to derive estimators under general constraints that can be specified as sets, but focuses on obtaining point estimates that do not…

Methodology · Statistics 2022-10-25 Rick Presman , Jason Xu

Bayesian optimization (BO) is a powerful approach for seeking the global optimum of expensive black-box functions and has proven successful for fine tuning hyper-parameters of machine learning models. However, BO is practically limited to…

Machine Learning · Statistics 2020-09-28 Riccardo Moriconi , Marc P. Deisenroth , K. S. Sesh Kumar

We present a framework for the efficient computation of optimal Bayesian decisions under intractable likelihoods, by learning a surrogate model for the expected utility (or its distribution) as a function of the action and data spaces. We…

Machine Learning · Statistics 2023-11-13 Justin Alsing , Thomas D. P. Edwards , Benjamin Wandelt

Control system optimization has long been a fundamental challenge in robotics. While recent advancements have led to the development of control algorithms that leverage learning-based approaches, such as SafeOpt, to optimize single feedback…

Robotics · Computer Science 2024-11-13 Lihao Zheng , Hongxuan Wang , Xiaocong Li , Jun Ma , Prahlad Vadakkepat

Federated learning performed by a decentralized networks of agents is becoming increasingly important with the prevalence of embedded software on autonomous devices. Bayesian approaches to learning benefit from offering more information as…

Machine Learning · Computer Science 2021-07-16 Vyacheslav Kungurtsev , Adam Cobb , Tara Javidi , Brian Jalaian

Bayesian Optimization (BO) is a method for globally optimizing black-box functions. While BO has been successfully applied to many scenarios, developing effective BO algorithms that scale to functions with high-dimensional domains is still…

Machine Learning · Computer Science 2024-02-13 Yihang Shen , Carl Kingsford

Over the last few years, sampling-based stochastic optimal control (SOC) frameworks have shown impressive performances in reinforcement learning (RL) with applications in robotics. However, such approaches require a large amount of samples…

Systems and Control · Computer Science 2014-12-10 Yunpeng Pan , Evangelos A. Theodorou , Michail Kontitsis

We address the robot grasp optimization problem of unknown objects considering uncertainty in the input space. Grasping unknown objects can be achieved by using a trial and error exploration strategy. Bayesian optimization is a sample…

Robotics · Computer Science 2016-03-08 José Nogueira , Ruben Martinez-Cantin , Alexandre Bernardino , Lorenzo Jamone

Estimation of physical quantities is at the core of most scientific research and the use of quantum devices promises to enhance its performances. In real scenarios, it is fundamental to consider that the resources are limited and Bayesian…

We study the sample complexity of stochastic convex optimization when problem parameters, e.g., the distance to optimality, are unknown. We pursue two strategies. First, we develop a reliable model selection method that avoids overfitting…

Machine Learning · Computer Science 2025-06-16 Jared Lawrence , Ari Kalinsky , Hannah Bradfield , Yair Carmon , Oliver Hinder

This paper combines episodic learning and control barrier functions in the setting of bipedal locomotion. The safety guarantees that control barrier functions provide are only valid with perfect model knowledge; however, this assumption…

Robotics · Computer Science 2021-05-06 Noel Csomay-Shanklin , Ryan K. Cosner , Min Dai , Andrew J. Taylor , Aaron D. Ames

We study the problem of bipedal robot navigation in complex environments with uncertain and rough terrain. In particular, we consider a scenario in which the robot is expected to reach a desired goal location by traversing an environment…

Robotics · Computer Science 2024-04-16 Kasidit Muenprasitivej , Jesse Jiang , Abdulaziz Shamsah , Samuel Coogan , Ye Zhao

Adaptive control approaches yield high-performance controllers when a precise system model or suitable parametrizations of the controller are available. Existing data-driven approaches for adaptive control mostly augment standard…

Systems and Control · Electrical Eng. & Systems 2021-03-03 Christopher König , Matteo Turchetta , John Lygeros , Alisa Rupenyan , Andreas Krause