English
Related papers

Related papers: Structured Column Subset Selection for Bayesian Op…

200 papers

We introduce a computationally efficient method for the automation of inverse design in science and engineering. Based on simple least-square regression, the underlying dynamic mode decomposition algorithm can be used to construct a…

Machine Learning · Computer Science 2025-02-14 Yunpeng Zhu , Liangliang Cheng , Anping Jing , Hanyu Huo , Ziqiang Lang , Bo Zhang , J. Nathan Kutz

Motivated by modern applications such as computerized adaptive testing, sequential rank aggregation, and heterogeneous data source selection, we study the problem of active sequential estimation, which involves adaptively selecting…

Statistics Theory · Mathematics 2024-02-14 Xiaoou Li , Hongru Zhao

Bayesian experimental design (BED) aims at designing an experiment to maximize the information gathering from the collected data. The optimal design is usually achieved by maximizing the mutual information (MI) between the data and the…

Machine Learning · Computer Science 2021-03-17 Jiaxin Zhang , Sirui Bi , Guannan Zhang

We propose a Bayesian variable selection method in the framework of modal regression for heavy-tailed responses. An efficient expectation-maximization algorithm is employed to expedite parameter estimation. A test statistic is constructed…

Methodology · Statistics 2025-10-29 Jiasong Duan , Hongmei Zhang , Xianzheng Huang

We revisit the classical problem of optimal experimental design (OED) under a new mathematical model grounded in a geometric motivation. Specifically, we introduce models based on elementary symmetric polynomials; these polynomials capture…

Statistics Theory · Mathematics 2017-05-30 Zelda Mariet , Suvrit Sra

We consider the problem of obtaining D-optimal designs for factorial experiments with a binary response and $k$ qualitative factors each at two levels. We obtain a characterization for a design to be locally D-optimal. Based on this…

Statistics Theory · Mathematics 2015-03-19 Jie Yang , Abhyuday Mandal , Dibyen Majumdar

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

Machine Learning · Statistics 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

The generation of decision-theoretic Bayesian optimal designs is complicated by the significant computational challenge of minimising an analytically intractable expected loss function over a, potentially, high-dimensional design space. A…

Methodology · Statistics 2017-02-07 Antony M. Overstall , James M. McGree , Christopher C. Drovandi

Accelerated discovery in materials science demands autonomous systems capable of dynamically formulating and solving design problems. In this work, we introduce a novel framework that leverages Bayesian optimization over a problem…

Systems and Control · Electrical Eng. & Systems 2025-02-11 Danial Khatamsaz , Joseph Wagner , Brent Vela , Raymundo Arroyave , Douglas L. Allaire

We examine the problem of optimal design in the context of filtering multiple random walks. Specifically, we define the steady state E-optimal design criterion and show that the underlying optimization problem leads to a second order cone…

Applications · Statistics 2010-10-07 Harsh Singhal , George Michailidis

Bayesian experimental design (BED) provides a powerful and general framework for optimizing the design of experiments. However, its deployment often poses substantial computational challenges that can undermine its practical use. In this…

Machine Learning · Statistics 2023-11-30 Tom Rainforth , Adam Foster , Desi R Ivanova , Freddie Bickford Smith

Automatic Chemical Design is a framework for generating novel molecules with optimized properties. The original scheme, featuring Bayesian optimization over the latent space of a variational autoencoder, suffers from the pathology that it…

Machine Learning · Statistics 2019-08-13 Ryan-Rhys Griffiths , José Miguel Hernández-Lobato

Bayesian optimality criteria provide a robust design strategy to parameter misspecification. We develop an approximate design theory for Bayesian $D$-optimality for non-linear regression models with covariates subject to measurement errors.…

Methodology · Statistics 2016-05-16 Maria Konstantinou , Holger Dette

This work considers sequential edge-promoting Bayesian experimental design for (discretized) linear inverse problems, exemplified by X-ray tomography. The process of computing a total variation type reconstruction of the absorption inside…

Methodology · Statistics 2021-04-02 Tapio Helin , Nuutti Hyvönen , Juha-Pekka Puska

Sequential algorithms are popular for experimental design, enabling emulation, optimisation and inference to be efficiently performed. For most of these applications bespoke software has been developed, but the approach is general and many…

Computation · Statistics 2021-10-18 Matthew A. Fisher , Onur Teymur , Chris. J. Oates

We design optimal $2 \times N$ ($2 <N$) matrices, with unit columns, so that the maximum condition number of all the submatrices comprising 3 columns is minimized. The problem has two applications. When estimating a 2-dimensional signal by…

Information Theory · Computer Science 2012-12-17 Hema Kumari Achanta , Weiyu Xu , Soura Dasgupta

We introduce Deep Adaptive Design (DAD), a method for amortizing the cost of adaptive Bayesian experimental design that allows experiments to be run in real-time. Traditional sequential Bayesian optimal experimental design approaches…

Machine Learning · Statistics 2021-06-14 Adam Foster , Desi R. Ivanova , Ilyas Malik , Tom Rainforth

Complex system design problems, such as those involved in aerospace engineering, require the use of numerically costly simulation codes in order to predict the performance of the system to be designed. In this context, these codes are often…

Optimization and Control · Mathematics 2024-02-14 Loic Brevault , Mathieu Balesdent

Bayesian optimal experimental design (BOED) seeks to maximize the expected information gain (EIG) of experiments. This requires a likelihood estimate, which in many settings is intractable. Simulation-based inference (SBI) provides powerful…

Machine Learning · Computer Science 2026-02-09 Samuel Klein , Willie Neiswanger , Daniel Ratner , Michael Kagan , Sean Gasiorowski

Sequential experimental design to discover interventions that achieve a desired outcome is a key problem in various domains including science, engineering and public policy. When the space of possible interventions is large, making an…

Machine Learning · Computer Science 2023-08-17 Jiaqi Zhang , Louis Cammarata , Chandler Squires , Themistoklis P. Sapsis , Caroline Uhler