English
Related papers

Related papers: Optimal Design Emulators: A Point Process Approach

200 papers

Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data…

Machine Learning · Statistics 2016-03-11 Panagiotis Tsilifis , Roger G. Ghanem , Paris Hajali

Scientists often run experiments to distinguish competing theories. This requires patience, rigor, and ingenuity - there is often a large space of possible experiments one could run. But we need not comb this space by hand - if we represent…

Artificial Intelligence · Computer Science 2016-08-18 Long Ouyang , Michael Henry Tessler , Daniel Ly , Noah Goodman

We propose an efficient optimization algorithm for selecting a subset of training data to induce sparsity for Gaussian process regression. The algorithm estimates an inducing set and the hyperparameters using a single objective, either the…

Machine Learning · Computer Science 2013-11-12 Yanshuai Cao , Marcus A. Brubaker , David J. Fleet , Aaron Hertzmann

We propose a new approach to solve optimal stopping problems via simulation. Working within the backward dynamic programming/Snell envelope framework, we augment the methodology of Longstaff-Schwartz that focuses on approximating the…

Computational Finance · Quantitative Finance 2015-09-04 Robert B. Gramacy , Mike Ludkovski

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for…

Machine Learning · Statistics 2022-04-29 Alexander Terenin

The process of dynamic state estimation (filtering) based on point process observations is in general intractable. Numerical sampling techniques are often practically useful, but lead to limited conceptual insight about optimal…

Machine Learning · Statistics 2016-09-13 Yuval Harel , Ron Meir , Manfred Opper

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

We propose a computational approach to constructing exact designs on finite design spaces that are optimal for multiresponse regression experiments under a combination of the standard linear and specific 'sparsity' constraints. The linear…

Methodology · Statistics 2026-02-13 Lenka Filová , Pál Somogyi , Radoslav Harman

Stochastic gradient descent is an optimisation method that combines classical gradient descent with random subsampling within the target functional. In this work, we introduce the stochastic gradient process as a continuous-time…

Probability · Mathematics 2021-05-11 Jonas Latz

Optimal design of experiments for correlated processes is an increasingly relevant and active research topic. Present methods have restricted possibilities to judge their quality. To fill this gap, we complement the virtual noise approach…

Statistics Theory · Mathematics 2021-10-25 Andrej Pázman , Markus Hainy , Werner G. Müller

Microplastics contamination is one of the most rapidly growing research topics. However, monitoring microplastics contamination in the environment presents both logistical and statistical challenges, particularly when constrained resources…

We develop and analyze a method for stochastic simulation optimization based on Gaussian process models within a trust-region framework. We focus on settings where the variance of the objective function is large, making accurate estimation…

Optimization and Control · Mathematics 2026-03-10 Mickael Binois , Jeffrey Larson

Computer experiments with both quantitative and qualitative (QQ) inputs are commonly used in science and engineering applications. Constructing desirable emulators for such computer experiments remains a challenging problem. In this…

Methodology · Statistics 2022-03-22 Qian Xiao , Abhyuday Mandal , C. Devon Lin , Xinwei Deng

Gaussian graphical model is a graphical representation of the dependence structure for a Gaussian random vector. It is recognized as a powerful tool in different applied fields such as bioinformatics, error-control codes, speech language,…

Machine Learning · Statistics 2017-01-10 Valery A. Kalyagin , Alexander P. Koldanov , Petr A. Koldanov , Panos M. Pardalos

In Bayesian nonparametric models, Gaussian processes provide a popular prior choice for regression function estimation. Existing literature on the theoretical investigation of the resulting posterior distribution almost exclusively assume a…

Statistics Theory · Mathematics 2015-03-06 Debdeep Pati , Anirban Bhattacharya , Guang Cheng

We discuss the problem of input design for uncertainty reduction in a parameter estimation procedure. Assuming a linear continuous-time control system with noisy measurements, we formulate an objective of variance reduction in a Bayesian…

Optimization and Control · Mathematics 2025-11-21 Ludovic Sacchelli , Alessandro Scagliotti

Gaussian processes are the leading class of distributions on random functions, but they suffer from well known issues including difficulty scaling and inflexibility with respect to certain shape constraints (such as nonnegativity). Here we…

With the rising complexity of numerous novel applications that serve our modern society comes the strong need to design efficient computing platforms. Designing efficient hardware is, however, a complex multi-objective problem that deals…

Hardware Architecture · Computer Science 2023-04-11 Alireza Ghaffari , Masoud Asgharian , Yvon Savaria

Gaussian Process (GP) regression is a popular and sample-efficient approach for many engineering applications, where observations are expensive to acquire, and is also a central ingredient of Bayesian optimization (BO), a highly prevailing…

Machine Learning · Statistics 2025-06-06 Sébastien Da Veiga

Computer experiments are becoming increasingly important in scientific investigations. In the presence of uncertainty, analysts employ probabilistic sensitivity methods to identify the key-drivers of change in the quantities of interest.…

Methodology · Statistics 2024-07-02 Isadora Antoniano-Villalobos , Emanuele Borgonovo , Xuefei Lu