English
Related papers

Related papers: Optimal design for linear models via gradient flow

200 papers

Bayesian optimal experimental design (BOED) is a principled framework for making efficient use of limited experimental resources. Unfortunately, its applicability is hampered by the difficulty of obtaining accurate estimates of the expected…

Machine Learning · Statistics 2020-01-15 Adam Foster , Martin Jankowiak , Eli Bingham , Paul Horsfall , Yee Whye Teh , Tom Rainforth , Noah Goodman

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general…

Machine Learning · Statistics 2012-12-04 Xun Huan , Youssef M. Marzouk

Algorithms for bilevel optimization often encounter Hessian computations, which are prohibitive in high dimensions. While recent works offer first-order methods for unconstrained bilevel problems, the constrained setting remains relatively…

Optimization and Control · Mathematics 2025-04-22 Guy Kornowski , Swati Padmanabhan , Kai Wang , Zhe Zhang , Suvrit Sra

We consider optimal experimental design (OED) problems in selecting the most informative observation sensors to estimate model parameters in a Bayesian framework. Such problems are computationally prohibitive when the…

Computational Engineering, Finance, and Science · Computer Science 2024-09-10 Jinwoo Go , Peng Chen

Bayesian experimental design (BED) aims at designing an experiment to maximize the information gathering from the collected data. The optimal design is usually achieved by maximizing the mutual information (MI) between the data and the…

Machine Learning · Computer Science 2021-03-17 Jiaxin Zhang , Sirui Bi , Guannan Zhang

Bayesian optimal experimental design (BOED) is a methodology to identify experiments that are expected to yield informative data. Recent work in cognitive science considered BOED for computational models of human behavior with tractable and…

Machine Learning · Computer Science 2021-11-01 Simon Valentin , Steven Kleinegesse , Neil R. Bramley , Michael U. Gutmann , Christopher G. Lucas

We develop a computational framework for D-optimal experimental design for PDE-based Bayesian linear inverse problems with infinite-dimensional parameters. We follow a formulation of the experimental design problem that remains valid in the…

Numerical Analysis · Mathematics 2017-11-17 Alen Alexanderian , Arvind K. Saibaba

Given an experimental set-up and a fixed number of measurements, how should one take data in order to optimally reconstruct the state of a quantum system? The problem of optimal experiment design (OED) for quantum state tomography was first…

Quantum Physics · Physics 2011-11-22 J. Nunn , B. J. Smith , G. Puentes , J. S. Lundeen , I. A. Walmsley

We introduce a fully stochastic gradient based approach to Bayesian optimal experimental design (BOED). Our approach utilizes variational lower bounds on the expected information gain (EIG) of an experiment that can be simultaneously…

Machine Learning · Statistics 2020-02-28 Adam Foster , Martin Jankowiak , Matthew O'Meara , Yee Whye Teh , Tom Rainforth

In this paper, we propose a novel numerical scheme to optimize the gradient flows for learning energy-based models (EBMs). From a perspective of physical simulation, we redefine the problem of approximating the gradient flow utilizing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yang Wu , Pengxu Wei , Liang Lin

Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventional BED methods…

Machine Learning · Computer Science 2021-03-16 Jiaxin Zhang , Sirui Bi , Guannan Zhang

We present an efficient method for computing A-optimal experimental designs for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we address the problem of optimizing the…

Computation · Statistics 2014-05-29 Alen Alexanderian , Noemi Petra , Georg Stadler , Omar Ghattas

Sequential filtering and spatial inverse problems assimilate data points distributed either temporally (in the case of filtering) or spatially (in the case of spatial inverse problems). Sometimes it is possible to choose the position of…

Statistics Theory · Mathematics 2025-08-19 Sahani Pathiraja , Claudia Schillings , Philipp Wacker

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

Machine Learning · Statistics 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

Data-driven decision-making is performed by solving a parameterized optimization problem, and the optimal decision is given by an optimal solution for unknown true parameters. We often need a solution that satisfies true constraints even…

Optimization and Control · Mathematics 2020-03-03 Akihiro Yabe , Takanori Maehara

The challenge of optimal design of experiments (DOE) pervades materials science, physics, chemistry, and biology. Bayesian optimization has been used to address this challenge in vast sample spaces, although it requires framing experimental…

A lot of real-world engineering problems represent dynamicity with nests of nonlinearities due to highly complex network of exponential functions or large number of differential equations interacting together. Such search spaces are…

Neural and Evolutionary Computing · Computer Science 2020-05-07 Mojtaba Moattari , Emad Roshandel , Shima Kamyab , Zohreh Azimifar

We review typical design problems encountered in the planning of observational studies and propose a unifying framework that allows us to use the same concepts and notation for different problems. In the framework, the design is defined as…

Statistics Theory · Mathematics 2017-11-02 Juha Karvanen , Jarno Vanhatalo , Kari Auranen , Sangita Kulathinal , Samu Mäntyniemi

Policy optimization is a core component of reinforcement learning (RL), and most existing RL methods directly optimize parameters of a policy based on maximizing the expected total reward, or its surrogate. Though often achieving…

Machine Learning · Computer Science 2018-08-10 Ruiyi Zhang , Changyou Chen , Chunyuan Li , Lawrence Carin

We provide attainable analytical tools to estimate the error of flow-based generative models under the Wasserstein metric and to establish the optimal sampling iteration complexity bound with respect to dimension as $O(\sqrt{d})$. We show…

Machine Learning · Computer Science 2025-12-09 Xiangjun Meng , Zhongjian Wang