English
Related papers

Related papers: Attentive Neural Processes and Batch Bayesian Opti…

200 papers

This paper deals with the identification of linear stochastic dynamical systems, where the unknowns include system coefficients and noise variances. Conventional approaches that rely on the maximum likelihood estimation (MLE) require…

Machine Learning · Statistics 2025-08-18 Jinwen Xu , Qin Lu , Yaakov Bar-Shalom

Establishing adaptive particles that sense their state, anticipate their evolution, and compute control inputs onboard has been a major challenge in non-equilibrium physics. We address this challenge by realizing an autonomous brainbot,…

It has become commonplace to use complex computer models to predict outcomes in regions where data does not exist. Typically these models need to be calibrated and validated using some experimental data, which often consists of multiple…

Controller tuning and parameter optimization are crucial in system design to improve closed-loop system performance. Bayesian optimization has been established as an efficient model-free controller tuning and adaptation method. However,…

Systems and Control · Electrical Eng. & Systems 2024-04-24 Christopher König , Raamadaas Krishnadas , Efe C. Balta , Alisa Rupenyan

Bayesian optimization (BO) is a model-based approach for gradient-free black-box function optimization. Typically, BO is powered by a Gaussian process (GP), whose algorithmic complexity is cubic in the number of evaluations. Hence, GP-based…

Machine Learning · Statistics 2017-12-11 Valerio Perrone , Rodolphe Jenatton , Matthias Seeger , Cedric Archambeau

This paper presents novel mixed-type Bayesian optimization (BO) algorithms to accelerate the optimization of a target objective function by exploiting correlated auxiliary information of binary type that can be more cheaply obtained, such…

Machine Learning · Statistics 2019-06-19 Yehong Zhang , Zhongxiang Dai , Kian Hsiang Low

Most existing digital twins rely on data-driven black-box models, predominantly using deep neural recurrent, and convolutional neural networks (DNNs, RNNs, and CNNs) to capture the dynamics of chemical systems. However, these models have…

Chemical Physics · Physics 2023-08-14 Niranjan Sitapure , Joseph S Kwon

Advances in artificial intelligence (AI) and deep learning have raised concerns about its increasing energy consumption, while demand for deploying AI in mobile devices and machines at the edge is growing. Binary neural networks (BNNs) have…

Optimization and Control · Mathematics 2026-01-05 Jonas Christoffer Villumsen , Yusuke Sugita

In recent years, leveraging parallel and distributed computational resources has become essential to solve problems of high computational cost. Bayesian optimization (BO) has shown attractive results in those expensive-to-evaluate problems…

Machine Learning · Statistics 2020-06-25 Masahiro Nomura

Expensive-to-train deep learning models can benefit from an optimization of the hyperparameters that determine the model architecture. We optimize 23 hyperparameters of a materials informatics model, Compositionally-Restricted…

Materials Science · Physics 2023-03-20 Sterling G. Baird , Marianne Liu , Taylor D. Sparks

Bayesian optimization (BO) is a powerful technology for optimizing noisy expensive-to-evaluate black-box functions, with a broad range of real-world applications in science, engineering, economics, manufacturing, and beyond. In this paper,…

Machine Learning · Computer Science 2024-01-30 Joel A. Paulson , Calvin Tsay

In modern astronomy, the quantity of data collected has vastly exceeded the capacity for manual analysis, necessitating the use of advanced artificial intelligence (AI) techniques to assist scientists with the most labor-intensive tasks. AI…

Solar and Stellar Astrophysics · Physics 2025-02-18 Marcin Wrona , Andrej Prša

Most research in Bayesian optimization (BO) has focused on \emph{direct feedback} scenarios, where one has access to exact values of some expensive-to-evaluate objective. This direction has been mainly driven by the use of BO in machine…

Machine Learning · Computer Science 2021-09-02 Eero Siivola , Akash Kumar Dhaka , Michael Riis Andersen , Javier Gonzalez , Pablo Garcia Moreno , Aki Vehtari

High-fidelity complex engineering simulations are highly predictive, but also computationally expensive and often require substantial computational efforts. The mitigation of computational burden is usually enabled through parallelism in…

Machine Learning · Statistics 2021-02-08 Anh Tran , Mike Eldred , Tim Wildey , Scott McCann , Jing Sun , Robert J. Visintainer

We live in a world of exploding complexity driven by technical evolution as well as highly volatile socio-economic environments. Managing complexity is a key issue in everyday decision making such as providing safe, sustainable, and…

Computers and Society · Computer Science 2023-11-28 Dirk Hartmann

Bayesian optimization (BO) is a sample efficient approach to automatically tune the hyperparameters of machine learning models. In practice, one frequently has to solve similar hyperparameter tuning problems sequentially. For example, one…

Machine Learning · Computer Science 2021-02-26 Samuel Horváth , Aaron Klein , Peter Richtárik , Cédric Archambeau

The development of Digital Twins (DTs) represents a transformative advance for simulating and optimizing complex systems in a controlled digital space. Despite their potential, the challenge of constructing DTs that accurately replicate and…

Systems and Control · Electrical Eng. & Systems 2024-06-21 Longfei Ma , Nan Cheng , Xiucheng Wang , Jiong Chen , Yinjun Gao , Dongxiao Zhang , Jun-Jie Zhang

Bayesian optimization (BO) is an attractive machine learning framework for performing sample-efficient global optimization of black-box functions. The optimization process is guided by an acquisition function that selects points to acquire…

Machine Learning · Computer Science 2024-10-14 Felix Teufel , Carsten Stahlhut , Jesper Ferkinghoff-Borg

Industrial process optimization and control is crucial to increase economic and ecologic efficiency. However, data sovereignty, differing goals, or the required expert knowledge for implementation impede holistic implementation. Further,…

Machine Learning · Computer Science 2024-08-28 Johannes Emmert , Ronald Mendez , Houman Mirzaalian Dastjerdi , Christopher Syben , Andreas Maier

Leveraging the high density and energy efficiency of Compute-In-Memory (CIM) crossbar-based Deep Neural Network (DNN) accelerators requires optimal Design Space Exploration (DSE), which becomes increasingly challenging as complex models for…

Emerging Technologies · Computer Science 2026-05-12 Arnob Saha , Bibhas Manna , Nikhil Kotikalapudi , Md Zesun Ahmed Mia , Rahul Kumar , Madhavan Swaminathan , Abhronil Sengupta