English
Related papers

Related papers: Integrating Sample Inheritance into Bayesian Optim…

200 papers

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

Control system optimization has long been a fundamental challenge in robotics. While recent advancements have led to the development of control algorithms that leverage learning-based approaches, such as SafeOpt, to optimize single feedback…

Robotics · Computer Science 2024-11-13 Lihao Zheng , Hongxuan Wang , Xiaocong Li , Jun Ma , Prahlad Vadakkepat

We present a modular approach to reinforcement learning that uses a Bayesian representation of the uncertainty over models. The approach, BOSS (Best of Sampled Set), drives exploration by sampling multiple models from the posterior and…

Machine Learning · Computer Science 2012-05-14 John Asmuth , Lihong Li , Michael L. Littman , Ali Nouri , David Wingate

Data-efficiency is crucial for autonomous robots to adapt to new tasks and environments. In this work we focus on robotics problems with a budget of only 10-20 trials. This is a very challenging setting even for data-efficient approaches…

Robotics · Computer Science 2019-07-11 Rika Antonova , Akshara Rai , Tianyu Li , Danica Kragic

Evolutionary optimization algorithms are often derived from loose biological analogies and struggle to leverage information obtained during the sequential course of optimization. An alternative promising approach is to leverage data and…

Artificial Intelligence · Computer Science 2024-03-06 Robert Tjarko Lange , Yingtao Tian , Yujin Tang

Bayesian optimal experimental design is a sub-field of statistics focused on developing methods to make efficient use of experimental resources. Any potential design is evaluated in terms of a utility function, such as the (theoretically…

Machine Learning · Computer Science 2022-10-21 Noble Kennamer , Steven Walton , Alexander Ihler

The inheritance of characteristics induced by the environment has often been opposed to the theory of evolution by natural selection. Yet, while evolution by natural selection requires new heritable traits to be produced and transmitted, it…

Populations and Evolution · Quantitative Biology 2015-06-18 Olivier Rivoire , Stanislas Leibler

Robotic performance emerges from the coupling of body and controller, yet it remains unclear when morphology-control co-design is necessary. We present a unified framework that embeds morphology and control parameters within a single neural…

Neural and Evolutionary Computing · Computer Science 2025-10-10 Yi Zhang , Yue Xie , Tao Sun , Fumiya Iida

Down-sampling training data has long been shown to improve the generalization performance of a wide range of machine learning systems. Recently, down-sampling has proved effective in genetic programming (GP) runs that utilize the lexicase…

Neural and Evolutionary Computing · Computer Science 2022-06-01 Ryan Boldi , Thomas Helmuth , Lee Spector

The design (shape) of a robot is usually decided before the control is implemented. This might limit how well the design is adapted to a task, as the suitability of the design is given by how well the robot performs in the task, which…

Robotics · Computer Science 2025-09-30 Etor Arza , Frank Veenstra , Tønnes F. Nygaard , Kyrre Glette

Genetic programming systems often use large training sets to evaluate the quality of candidate solutions for selection, which is often computationally expensive. Down-sampling training sets has long been used to decrease the computational…

Neural and Evolutionary Computing · Computer Science 2024-08-02 Ryan Boldi , Ashley Bao , Martin Briesch , Thomas Helmuth , Dominik Sobania , Lee Spector , Alexander Lalejini

Learning policies for bipedal locomotion can be difficult, as experiments are expensive and simulation does not usually transfer well to hardware. To counter this, we need al- gorithms that are sample efficient and inherently safe. Bayesian…

Robotics · Computer Science 2018-10-11 Rika Antonova , Akshara Rai , Christopher G. Atkeson

Learning controller parameters from closed-loop data has been shown to improve closed-loop performance. Bayesian optimization, a widely used black-box and sample-efficient learning method, constructs a probabilistic surrogate of the…

Machine Learning · Computer Science 2025-12-15 Sebastian Hirt , Valentinus Suwanto , Hendrik Alsmeier , Maik Pfefferkorn , Rolf Findeisen

We study the effects of injecting human-generated designs into the initial population of an evolutionary robotics experiment, where subsequent population of robots are optimised via a Genetic Algorithm and MAP-Elites. First, human…

Robotics · Computer Science 2022-05-18 Huang Zonghao , Quinn Wu , David Howard , Cynthia Sung

A robotic swarm that is required to operate for long periods in a potentially unknown environment can use both evolution and individual learning methods in order to adapt. However, the role played by the environment in influencing the…

Neural and Evolutionary Computing · Computer Science 2018-04-23 Andreas Steyven , Emma Hart , Ben Paechter

Bayesian optimization devolves the global optimization of a costly objective function to the global optimization of a sequence of acquisition functions. This inner-loop optimization can be catastrophically difficult if it involves posterior…

Machine Learning · Computer Science 2025-04-02 Taiwo A. Adebiyi , Bach Do , Ruda Zhang

Tuning control policies manually to meet high-level objectives is often time-consuming. Bayesian optimization provides a data-efficient framework for automating this process using numerical evaluations of an objective function. However,…

Machine Learning · Computer Science 2026-03-26 Lukas Theiner , Maik Pfefferkorn , Yongpeng Zhao , Sebastian Hirt , Rolf Findeisen

Industrial robots are designed as general-purpose hardware with limited ability to adapt to changing task requirements or environments. Modular robots, on the other hand, offer flexibility and can be easily customized to suit diverse needs.…

Robotics · Computer Science 2024-03-05 Jonathan Külz , Matthias Althoff

Approximate Bayesian inference based on Laplace approximation and quadrature methods have become increasingly popular for their efficiency at fitting latent Gaussian models (LGM), which encompass popular models such as Bayesian generalized…

Methodology · Statistics 2024-03-20 Dayi Li , Ziang Zhang

Hyperparameters and learning algorithms for neuromorphic hardware are usually chosen by hand. In contrast, the hyperparameters and learning algorithms of networks of neurons in the brain, which they aim to emulate, have been optimized…

Neural and Evolutionary Computing · Computer Science 2019-06-11 Thomas Bohnstingl , Franz Scherr , Christian Pehle , Karlheinz Meier , Wolfgang Maass