English
Related papers

Related papers: Integrating Sample Inheritance into Bayesian Optim…

200 papers

This paper presents an advancement to an approach for model-independent surrogate-based optimization with adaptive batch sampling, known as Adaptive Model Refinement (AMR). While the original AMR method provides unique decisions with…

Optimization and Control · Mathematics 2019-06-04 Payam Ghassemi , Sumeet Sanjay Lulekar , Souma Chowdhury

Purpose: Machine learning is broadly used for clinical data analysis. Before training a model, a machine learning algorithm must be selected. Also, the values of one or more model parameters termed hyper-parameters must be set. Selecting…

Machine Learning · Computer Science 2018-12-10 Xueqiang Zeng , Gang Luo

We introduce Genetic AI, a novel method for multi-objective optimization without external parameters or predefined weights. The method can be applied to all problems that can be formulated in matrix form and allows for a data-less training…

Neural and Evolutionary Computing · Computer Science 2025-05-09 Philipp Wissgott

Robot learning is often difficult due to the expense of gathering data. The need for large amounts of data can, and should, be tackled with effective algorithms and leveraging expert information on robot dynamics. Bayesian reinforcement…

Robotics · Computer Science 2023-07-25 Hai Nguyen , Sammie Katt , Yuchen Xiao , Christopher Amato

We present a Bayesian approach to identify optimal transformations that map model input points to low dimensional latent variables. The "projection" mapping consists of an orthonormal matrix that is considered a priori unknown and needs to…

Machine Learning · Statistics 2021-09-22 Panagiotis Tsilifis , Piyush Pandita , Sayan Ghosh , Valeria Andreoli , Thomas Vandeputte , Liping Wang

Given a supervised machine learning problem where the training set has been subject to a known sampling bias, how can a model be trained to fit the original dataset? We achieve this through the Bayesian inference framework by altering the…

Machine Learning · Statistics 2022-03-16 Max Sklar

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

Machine Learning · Computer Science 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe

Adaptive control approaches yield high-performance controllers when a precise system model or suitable parametrizations of the controller are available. Existing data-driven approaches for adaptive control mostly augment standard…

Systems and Control · Electrical Eng. & Systems 2021-03-03 Christopher König , Matteo Turchetta , John Lygeros , Alisa Rupenyan , Andreas Krause

Correctly setting the parameters of a production machine is essential to improve product quality, increase efficiency, and reduce production costs while also supporting sustainability goals. Identifying optimal parameters involves an…

Machine Learning · Computer Science 2025-03-24 Philipp Wagner , Tobias Nagel , Philipp Leube , Marco F. Huber

Posterior sampling by Monte Carlo methods provides a more comprehensive solution approach to inverse problems than computing point estimates such as the maximum posterior using optimization methods, at the expense of usually requiring many…

Numerical Analysis · Mathematics 2024-11-28 Paolo Villani , Daniel Andrés-Arcones , Jörg F. Unger , Martin Weiser

Scenarios requiring humans to choose from multiple seemingly optimal actions are commonplace, however standard imitation learning often fails to capture this behavior. Instead, an over-reliance on replicating expert actions induces…

Robotics · Computer Science 2022-11-08 Hanbit Oh , Hikaru Sasaki , Brendan Michael , Takamitsu Matsubara

While the animals' Fin-to-Limb evolution has been well-researched in biology, such morphological transformation remains under-adopted in the modern design of advanced robotic limbs. This paper investigates a novel class of overconstrained…

Optimization for deep networks is currently a very active area of research. As neural networks become deeper, the ability in manually optimizing the network becomes harder. Mini-batch normalization, identification of effective respective…

Neural and Evolutionary Computing · Computer Science 2018-08-07 M. U. B. Dias , D. D. N. De Silva , S. Fernando

There are two common approaches for optimizing the performance of a machine: genetic algorithms and machine learning. A genetic algorithm is applied over many generations whereas machine learning works by applying feedback until the system…

Artificial Intelligence · Computer Science 2017-09-01 Leigh Sheneman , Arend Hintze

Surrogate assisted evolutionary algorithms (EA) are rapidly gaining popularity where applications of EA in complex real world problem domains are concerned. Although EAs are powerful global optimizers, finding optimal solution to complex…

Neural and Evolutionary Computing · Computer Science 2013-03-13 Maumita Bhattacharya

Bayesian model-based reinforcement learning is a formally elegant approach to learning optimal behaviour under model uncertainty, trading off exploration and exploitation in an ideal way. Unfortunately, finding the resulting Bayes-optimal…

Machine Learning · Computer Science 2015-03-20 Arthur Guez , David Silver , Peter Dayan

Evolution and learning have historically been interrelated topics, and their interplay is attracting increased interest lately. The emerging new factor in this trend is morphological evolution, the evolution of physical forms within…

Robotics · Computer Science 2026-04-15 Jed Muff , Keiichi Ito , Elijah H. W. Ang , Karine Miras , A. E. Eiben

What if there is a teacher who knows the learning goal and wants to design good training data for a machine learner? We propose an optimal teaching framework aimed at learners who employ Bayesian models. Our framework is expressed as an…

Machine Learning · Computer Science 2013-10-04 Xiaojin Zhu

With this paper, we contribute to the growing research area of feature-based analysis of bio-inspired computing. In this research area, problem instances are classified according to different features of the underlying problem in terms of…

Neural and Evolutionary Computing · Computer Science 2016-02-10 Shayan Poursoltan , Frank Neumann