English
Related papers

Related papers: Wasserstein-enabled characterization of designs an…

200 papers

The Wasserstein barycenter is a geometric construct which captures the notion of centrality among probability distributions, and which has found many applications in machine learning. However, most algorithms for finding even an approximate…

Data Structures and Algorithms · Computer Science 2021-10-20 Zachary Izzo , Sandeep Silwal , Samson Zhou

The Bayesian decision-theoretic approach to design of experiments involves specifying a design (values of all controllable variables) to maximise the expected utility function (expectation with respect to the distribution of responses and…

Statistics Theory · Mathematics 2021-09-24 Antony M. Overstall

With the ongoing investment in data collection and communication technology in power systems, data-driven optimization has been established as a powerful tool for system operators to handle stochastic system states caused by weather- and…

Optimization and Control · Mathematics 2023-12-18 Robert Mieth , Juan M. Morales , H. Vincent Poor

Experimental design is central to science and engineering. A ubiquitous challenge is how to maximize the value of information obtained from expensive or constrained experimental settings. Bayesian optimal experimental design (OED) provides…

Methodology · Statistics 2026-02-13 Sofia Mäkinen , Andrew B. Duncan , Tapio Helin

We consider a general online stochastic optimization problem with multiple budget constraints over a horizon of finite time periods. In each time period, a reward function and multiple cost functions are revealed, and the decision maker…

Machine Learning · Computer Science 2022-07-26 Jiashuo Jiang , Xiaocheng Li , Jiawei Zhang

The generation of decision-theoretic Bayesian optimal designs is complicated by the significant computational challenge of minimising an analytically intractable expected loss function over a, potentially, high-dimensional design space. A…

Methodology · Statistics 2017-02-07 Antony M. Overstall , James M. McGree , Christopher C. Drovandi

Bayesian optimization (BO) is a class of sample-efficient global optimization methods, where a probabilistic model conditioned on previous observations is used to determine future evaluations via the optimization of an acquisition function.…

Machine Learning · Computer Science 2020-06-22 Eric Hans Lee , David Eriksson , Bolong Cheng , Michael McCourt , David Bindel

Wasserstein distances provide a powerful framework for comparing data distributions. They can be used to analyze processes over time or to detect inhomogeneities within data. However, simply calculating the Wasserstein distance or analyzing…

Machine Learning · Computer Science 2026-03-03 Philip Naumann , Jacob Kauffmann , Grégoire Montavon

We address the challenge of sequential data-driven decision-making under context distributional uncertainty. This problem arises in numerous real-world scenarios where the learner optimizes black-box objective functions in the presence of…

Machine Learning · Computer Science 2025-03-27 Francesco Micheli , Efe C. Balta , Anastasios Tsiamis , John Lygeros

It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension…

Machine Learning · Statistics 2022-06-01 Adam Block , Zeyu Jia , Yury Polyanskiy , Alexander Rakhlin

Measuring dependence between random variables is a fundamental problem in Statistics, with applications across diverse fields. While classical measures such as Pearson's correlation have been widely used for over a century, they have…

Statistics Theory · Mathematics 2025-10-08 Marta Catalano , Hugo Lavenant

Model-based geostatistical design involves the selection of locations to collect data to minimise an expected loss function over a set of all possible locations. The loss function is specified to reflect the aim of data collection, which,…

Computation · Statistics 2021-12-03 S. G. Jagath Senarathne , Werner G. Müller , James M. McGree

Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data…

Machine Learning · Statistics 2016-03-11 Panagiotis Tsilifis , Roger G. Ghanem , Paris Hajali

Performing optimal Bayesian design for discriminating between competing models is computationally intensive as it involves estimating posterior model probabilities for thousands of simulated datasets. This issue is compounded further when…

Methodology · Statistics 2022-04-07 Markus Hainy , David J. Price , Olivier Restif , Christopher Drovandi

In this work we study systems consisting of a group of moving particles. In such systems, often some important parameters are unknown and have to be estimated from observed data. Such parameter estimation problems can often be solved via a…

Applications · Statistics 2023-07-11 Chen Cheng , Linjie Wen , Jinglai Li

Bayesian optimal design is considered for experiments where the response distribution depends on the solution to a system of non-linear ordinary differential equations. The motivation is an experiment to estimate parameters in the equations…

Methodology · Statistics 2019-05-02 Antony Overstall , David Woods , Ben Parker

A novel framework for density estimation under expectation constraints is proposed. The framework minimizes the Wasserstein distance between the estimated density and a prior, subject to the constraints that the expected value of a set of…

Machine Learning · Statistics 2026-02-24 Yinan Hu , Esteban G. Tabak

Bayesian optimal experimental design is a sub-field of statistics focused on developing methods to make efficient use of experimental resources. Any potential design is evaluated in terms of a utility function, such as the (theoretically…

Machine Learning · Computer Science 2022-10-21 Noble Kennamer , Steven Walton , Alexander Ihler

We are often interested in identifying the feasible subset of a decision space under multiple constraints to permit effective design exploration. If determining feasibility required computationally expensive simulations, the cost of…

Machine Learning · Computer Science 2020-06-25 Alma Rahat , Michael Wood

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

Statistics Theory · Mathematics 2020-01-29 Jing Lei