English
Related papers

Related papers: Accelerating Bayesian Optimization for Nonlinear S…

200 papers

From a systems biology perspective the majority of cancer models, although interesting and providing a qualitative explanation of some problems, have a major disadvantage in that they usually miss a genuine connection with experimental…

Statistics Theory · Mathematics 2023-05-25 Zuzanna Szymańska , Jakub Skrzeczkowski , Błażej Miasojedow , Piotr Gwiazda

We propose an algorithm for designing optimal inputs for on-line Bayesian identification of stochastic non-linear state-space models. The proposed method relies on minimization of the posterior Cram\'er Rao lower bound derived for the model…

Applications · Statistics 2013-07-25 Aditya Tulsyan , Swanand R. Khare , Biao Huang , R. Bhushan Gopaluni , J. Fraser Forbes

Many real-world experimental design problems (a) evaluate multiple experimental conditions in parallel and (b) replicate each condition multiple times due to large and heteroscedastic observation noise. Given a fixed total budget, this…

Unconstrained optimization problems are typically solved using iterative methods, which often depend on line search techniques to determine optimal step lengths in each iteration. This paper introduces a novel line search approach.…

Optimization and Control · Mathematics 2024-05-20 Sören Laue , Tomislav Prusina

Bayesian Networks (BNs) are of interest from an explainable AI viewpoint, offering transparent probabilistic models for decision support. Baymex is a recently introduced multi-objective evolutionary algorithm for learning discretized BNs,…

Machine Learning · Computer Science 2026-05-29 Damy M. F. Ha , Tanja Alderliesten , Peter A. N. Bosman

Modern epidemiological analytics increasingly use machine learning models that offer strong prediction but often lack calibrated uncertainty. Bayesian methods provide principled uncertainty quantification, yet are viewed as difficult to…

Machine Learning · Statistics 2025-11-18 Debashis Chatterjee

Mixed Integer Linear Programs (MILPs) are often used in the path planning of both ground and aerial vehicles. Such a formulation of the path planning problem requires a linear objective function and constraints, limiting the fidelity of the…

Optimization and Control · Mathematics 2022-11-21 Drew Scott , Satyanarayana G. Manyam , David W. Casbeer , Manish Kumar , Isaac E. Weintraub , Michael J. Rothenberger

Modern cosmological data demand modern data analysis techniques. We introduce BayOp, a new likelihood sampling and maximisation method which is based on the Bayesian Optimisation algorithm and learns a function instead of randomly sampling…

Cosmology and Nongalactic Astrophysics · Physics 2022-04-15 Jan Hamann , Julius Wons

In this paper, a new filter model called set-membership Kalman filter for nonlinear state estimation problems was designed, where both random and unknown but bounded uncertainties were considered simultaneously in the discrete-time system.…

Optimization and Control · Mathematics 2018-02-09 Ligang Sun , Hamza Alkhatib , Boris Kargoll , Vladik Kreinovich , Ingo Neumann

High Power Targetry (HPT) R&D is critical in the context of increasing beam intensity and energy for next generation accelerators. Many target concepts and novel materials are being developed and tested for their ability to withstand…

Accelerator Physics · Physics 2024-06-04 W. Asztalos , Y. Torun , S. Bidhar , F. Pellemoine , P. Rath

In this paper we present an algorithm for rapid Bayesian analysis that combines the benefits of nested sampling and artificial neural networks. The blind accelerated multimodal Bayesian inference (BAMBI) algorithm implements the MultiNest…

Instrumentation and Methods for Astrophysics · Physics 2012-03-12 Philip Graff , Farhan Feroz , Michael P. Hobson , Anthony Lasenby

We propose a convex optimization procedure for black-box identification of nonlinear state-space models for systems that exhibit stable limit cycles (unforced periodic solutions). It extends the "robust identification error" framework in…

Optimization and Control · Mathematics 2013-03-21 Ian R. Manchester , Mark M. Tobenkin , Jennifer Wang

We propose a fast inference method for Bayesian nonlinear support vector machines that leverages stochastic variational inference and inducing points. Our experiments show that the proposed method is faster than competing Bayesian…

Machine Learning · Statistics 2018-03-22 Florian Wenzel , Theo Galy-Fajou , Matthaeus Deutsch , Marius Kloft

Bayesian optimization is a popular method for solving the problem of global optimization of an expensive-to-evaluate black-box function. It relies on a probabilistic surrogate model of the objective function, upon which an acquisition…

Machine Learning · Statistics 2022-06-22 Jungtaek Kim , Seungjin Choi , Minsu Cho

Parameter settings profoundly impact the performance of machine learning algorithms and laboratory experiments. The classical grid search or trial-error methods are exponentially expensive in large parameter spaces, and Bayesian…

Machine Learning · Computer Science 2017-04-18 Vu Nguyen , Santu Rana , Sunil Gupta , Cheng Li , Svetha Venkatesh

State estimation and sensor selection problems for nonlinear networks and systems are ubiquitous problems that are important for the control, monitoring, analysis, and prediction of a large number of engineered and physical systems. Sensor…

Systems and Control · Electrical Eng. & Systems 2021-03-23 Aleksandar Haber

We present an integrated prediction-optimization (PredOpt) framework to efficiently solve sequential decision-making problems by predicting the values of binary decision variables in an optimal solution. We address the key issues of…

Machine Learning · Computer Science 2023-11-14 Dogacan Yilmaz , İ. Esra Büyüktahtakın

Many cosmological models have only a finite number of parameters of interest, but a very expensive data-generating process and an intractable likelihood function. We address the problem of performing likelihood-free Bayesian inference from…

Cosmology and Nongalactic Astrophysics · Physics 2018-09-14 Florent Leclercq

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

Optimization and Control · Mathematics 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang

Bayesian optimal experimental design has immense potential to inform the collection of data so as to subsequently enhance our understanding of a variety of processes. However, a major impediment is the difficulty in evaluating optimal…

Computation · Statistics 2018-03-14 David J. Price , Nigel G. Bean , Joshua V. Ross , Jonathan Tuke