English
Related papers

Related papers: Time-Aware Latent Space Bayesian Optimization

200 papers

Robots have been used in all sorts of automation, and yet the design of robots remains mainly a manual task. We seek to provide design tools to automate the design of robots themselves. An important challenge in robot design automation is…

Robotics · Computer Science 2022-09-26 Jiaheng Hu , Julian Whiman , Howie Choset

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian…

Machine Learning · Statistics 2019-06-24 Yao Zhang , James Jordon , Ahmed M. Alaa , Mihaela van der Schaar

Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of…

Machine Learning · Computer Science 2022-06-17 Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy

Changing conditions or environments can cause system dynamics to vary over time. To ensure optimal control performance, controllers should adapt to these changes. When the underlying cause and time of change is unknown, we need to rely on…

Machine Learning · Computer Science 2023-06-28 Paul Brunzema , Alexander von Rohr , Sebastian Trimpe

Preferential Bayesian Optimization (PBO) is a sample-efficient method to learn latent user utilities from preferential feedback over a pair of designs. It relies on a statistical surrogate model for the latent function, usually a Gaussian…

Machine Learning · Statistics 2025-03-04 Xinyu Zhang , Daolang Huang , Samuel Kaski , Julien Martinelli

Scientific discovery is increasingly constrained by costly experiments and limited resources, underscoring the need for efficient optimization in AI for science. Bayesian Optimization (BO), though widely adopted for balancing exploration…

Artificial Intelligence · Computer Science 2026-05-19 Xinzhe Yuan , Zhuo Chen , Jianshu Zhang , Huan Xiong , Nanyang Ye , Yuqiang Li , Qinying Gu

Bayesian optimization (BO) is well known to be sample-efficient for solving black-box problems. However, the BO algorithms can sometimes get stuck in suboptimal solutions even with plenty of samples. Intrinsically, such suboptimal problem…

Machine Learning · Computer Science 2025-01-24 Zhendong Guo , Yew-Soon Ong , Tiantian He , Haitao Liu

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these…

Machine Learning · Statistics 2020-06-05 Peter D. Tonner , Daniel V. Samarov , A. Gilad Kusne

We propose to use Bayesian optimization (BO) to improve the efficiency of the design selection process in clinical trials. BO is a method to optimize expensive black-box functions, by using a regression as a surrogate to guide the search.…

Methodology · Statistics 2021-05-20 Jakob Richter , Tim Friede , Jörg Rahnenführer

Generative modeling of crystal structures is significantly challenged by the complexity of input data, which constrains the ability of these models to explore and discover novel crystals. This complexity often confines de novo design…

Machine Learning · Computer Science 2024-10-01 Onur Boyar , Yanheng Gu , Yuji Tanaka , Shunsuke Tonogai , Tomoya Itakura , Ichiro Takeuchi

Bayesian Optimization (BO) is a powerful method for optimizing black-box functions by combining prior knowledge with ongoing function evaluations. BO constructs a probabilistic surrogate model of the objective function given the covariates,…

Machine Learning · Statistics 2025-08-26 Roi Naveiro , Becky Tang

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agents often face…

Machine Learning · Statistics 2025-10-21 Zihan Wang , Yi-Ping Chen , Tuba Dolar , Wei Chen

We consider the problem of optimizing combinatorial spaces (e.g., sequences, trees, and graphs) using expensive black-box function evaluations. For example, optimizing molecules for drug design using physical lab experiments. Bayesian…

Machine Learning · Computer Science 2022-02-07 Aryan Deshwal , Janardhan Rao Doppa

Bayesian optimisation in the latent space of a Variational AutoEncoder (VAE) is a powerful framework for optimisation tasks over complex structured domains, such as the space of scientifically interesting molecules. However, existing…

Machine Learning · Computer Science 2025-07-08 Henry B. Moss , Sebastian W. Ober , Tom Diethe

Bayesian Optimisation (BO) is a powerful tool for optimising expensive blackbox functions but its effectiveness diminishes in highdimensional spaces due to sparse data and poor surrogate model scalability While Variational Autoencoder (VAE)…

Machine Learning · Computer Science 2025-10-13 Junyu Xuan , Wenlong Chen , Yingzhen Li

Bayesian optimization (BayesOpt) is a gold standard for query-efficient continuous optimization. However, its adoption for drug design has been hindered by the discrete, high-dimensional nature of the decision variables. We develop a new…

Molecular design based on generative models, such as variational autoencoders (VAEs), has become increasingly popular in recent years due to its efficiency for exploring high-dimensional molecular space to identify molecules with desired…

Machine Learning · Computer Science 2024-08-13 A N M Nafiz Abeer , Nathan Urban , M Ryan Weil , Francis J. Alexander , Byung-Jun Yoon

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

The optimal assignment of Large Language Models (LLMs) to specialized roles in multi-agent systems is a significant challenge, defined by a vast combinatorial search space, expensive black-box evaluations, and an inherent trade-off between…

Multiagent Systems · Computer Science 2025-11-18 Antonio Sabbatella

Bayesian optimization (BO) for high-dimensional constrained problems remains a significant challenge due to the curse of dimensionality. We propose Local Constrained Bayesian Optimization (LCBO), a novel framework tailored for such…

Machine Learning · Statistics 2026-03-10 Jing Jingzhe , Fan Zheyi , Szu Hui Ng , Qingpei Hu