English
Related papers

Related papers: Caliper-in-the-Loop: Black-Box Optimization for Hy…

200 papers

Bayesian optimization (BO) is a powerful approach for optimizing complex and expensive-to-evaluate black-box functions. Its importance is underscored in many applications, notably including hyperparameter tuning, but its efficacy depends on…

Machine Learning · Computer Science 2024-03-11 Tennison Liu , Nicolás Astorga , Nabeel Seedat , Mihaela van der Schaar

Despite all the benefits of automated hyperparameter optimization (HPO), most modern HPO algorithms are black-boxes themselves. This makes it difficult to understand the decision process which leads to the selected configuration, reduces…

Machine Learning · Computer Science 2023-02-14 Julia Moosbauer , Giuseppe Casalicchio , Marius Lindauer , Bernd Bischl

The objective of this Philosophiae Doctor (Ph.D) thesis is to propose an efficient approach for optimizing a multidisciplinary black-box model when the optimization problem is constrained and involves a large number of mixed integer design…

Optimization and Control · Mathematics 2025-07-24 Paul Saves

Bayesian Optimization (BO) is a surrogate-based global optimization strategy that relies on a Gaussian Process regression (GPR) model to approximate the objective function and an acquisition function to suggest candidate points. It is…

Machine Learning · Computer Science 2022-06-28 Kirill Antonov , Elena Raponi , Hao Wang , Carola Doerr

Reinforcement learning algorithms can show strong variation in performance between training runs with different random seeds. In this paper we explore how this affects hyperparameter optimization when the goal is to find hyperparameter…

Machine Learning · Computer Science 2020-07-31 Lars Hertel , Pierre Baldi , Daniel L. Gillen

Object detectors have improved considerably in the last years by using advanced CNN architectures. However, many detector hyper-parameters are generally manually tuned, or they are used with values set by the detector authors. Automatic…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Mohandass Muthuraja , Octavio Arriaga , Paul Plöger , Frank Kirchner , Matias Valdenegro-Toro

A major challenge in robotics is to design robust policies which enable complex and agile behaviors in the real world. On one end of the spectrum, we have model-free reinforcement learning (MFRL), which is incredibly flexible and general…

Robotics · Computer Science 2024-10-01 Jacob Sacks , Rwik Rana , Kevin Huang , Alex Spitzer , Guanya Shi , Byron Boots

Model predictive control (MPC) is a promising approach for the lateral and longitudinal control of autonomous vehicles. However, the parameterization of the MPC with respect to high-level requirements such as passenger comfort as well as…

Systems and Control · Electrical Eng. & Systems 2022-12-14 David Stenger , Robert Ritschel , Felix Krabbes , Rick Voßwinkel , Hendrik Richter

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

Machine Learning · Computer Science 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

Accurate positioning and fast traversal times determine the productivity in machining applications. This paper demonstrates a hierarchical contour control implementation for the increase of productivity in positioning systems. The…

Systems and Control · Electrical Eng. & Systems 2024-04-30 Alisa Rupenyan , Mohammad Khosravi , John Lygeros

Bayesian optimization has been successfully applied to optimize black-box functions where the number of evaluations is severely limited. However, in many real-world applications, it is hard or impossible to know in advance which designs are…

Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely applied in robotics with movement primitives or…

Machine Learning · Computer Science 2022-03-22 Marius Memmel , Puze Liu , Davide Tateo , Jan Peters

The most data-efficient algorithms for reinforcement learning (RL) in robotics are based on uncertain dynamical models: after each episode, they first learn a dynamical model of the robot, then they use an optimization algorithm to find a…

Systematic design and verification of advanced control strategies for complex systems under uncertainty largely remains an open problem. Despite the promise of blackbox optimization methods for automated controller tuning, they generally…

Systems and Control · Electrical Eng. & Systems 2020-11-17 Joel A. Paulson , Ali Mesbah

Parameter settings profoundly impact the performance of machine learning algorithms and laboratory experiments. The classical grid search or trial-error methods are exponentially expensive in large parameter spaces, and Bayesian…

Machine Learning · Computer Science 2017-04-18 Vu Nguyen , Santu Rana , Sunil Gupta , Cheng Li , Svetha Venkatesh

Ensuring high accuracy and efficiency of predictive models is paramount in the aerospace industry, particularly in the context of multidisciplinary design and optimization processes. These processes often require numerous evaluations of…

Machine Learning · Computer Science 2025-03-26 James M. Shihua , Paul Saves , Rhea P. Liem , Joseph Morlier

Data-enabled predictive control (DeePC) leverages system measurements in characterizing system dynamics for optimal control. The performance of DeePC relies on optimizing its hyperparameters, especially in noisy systems where the optimal…

Optimization and Control · Mathematics 2025-06-02 Jinbao Wang , Shiliang Zhang , Jun Liu , Xuehui Ma , Haolin Liu

Bayesian Optimization (BO) is widely used for optimizing expensive black-box functions, particularly in hyperparameter tuning. However, standard BO assumes access to precise objective values, which may be unavailable, noisy, or unreliable…

Machine Learning · Statistics 2025-10-07 Tunde Fahd Egunjobi

The development of novel instrumentation requires an iterative cycle with three stages: design, prototyping, and testing. Recent advancements in simulation and nanofabrication techniques have significantly accelerated the design and…

Instrumentation and Detectors · Physics 2026-01-21 J. Cuevas-Zepeda , C. Chavez , J. Estrada , J. Noonan , B. D. Nord , N. Saffold , M. Sofo-Haro , R. Spinola e Castro , S. Trivedi

Smart manufacturing requires on-device intelligence that meets strict latency and energy budgets. HyperDimensional Computing (HDC) offers a lightweight alternative by encoding data as high-dimensional hypervectors and computing with simple…

Machine Learning · Computer Science 2025-10-01 Fardin Jalil Piran , Anandkumar Patel , Rajiv Malhotra , Farhad Imani