English
Related papers

Related papers: Variational Sequential Optimal Experimental Design…

200 papers

We develop a new computational framework to solve sequential Bayesian optimal experimental design (SBOED) problems constrained by large-scale partial differential equations with infinite-dimensional random parameters. We propose an adaptive…

Computational Engineering, Finance, and Science · Computer Science 2024-10-04 Jinwoo Go , Peng Chen

The surrogate loss of variational autoencoders (VAEs) poses various challenges to their training, inducing the imbalance between task fitting and representation inference. To avert this, the existing strategies for VAEs focus on adjusting…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Zhangkai Wu , Longbing Cao , Lei Qi

We consider the problem of fitting variational posterior approximations using stochastic optimization methods. The performance of these approximations depends on (1) how well the variational family matches the true posterior…

Sequential filtering and spatial inverse problems assimilate data points distributed either temporally (in the case of filtering) or spatially (in the case of spatial inverse problems). Sometimes it is possible to choose the position of…

Statistics Theory · Mathematics 2025-08-19 Sahani Pathiraja , Claudia Schillings , Philipp Wacker

Scalable and effective exploration remains a key challenge in reinforcement learning (RL). While there are methods with optimality guarantees in the setting of discrete state and action spaces, these methods cannot be applied in…

Machine Learning · Computer Science 2017-01-30 Rein Houthooft , Xi Chen , Yan Duan , John Schulman , Filip De Turck , Pieter Abbeel

We propose a sequential design method aiming at the estimation of an extreme quantile based on a sample of dichotomic data corresponding to peaks over a given threshold. This study is motivated by an industrial challenge in material…

Methodology · Statistics 2020-04-06 Michel Broniatowski , Emilie Miranda

While many advanced statistical methods for the design of experiments exist, it is still typical for physical experiments to be performed adaptively based on human intuition. As a consequence, experimental resources are wasted on…

Methodology · Statistics 2025-03-04 Anton van Beek

Repetitive Scenario Design (RSD) is a randomized approach to robust design based on iterating two phases: a standard scenario design phase that uses $N$ scenarios (design samples), followed by randomized feasibility phase that uses $N_o$…

Systems and Control · Computer Science 2016-02-12 Giuseppe C. Calafiore

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these…

Machine Learning · Statistics 2020-06-05 Peter D. Tonner , Daniel V. Samarov , A. Gilad Kusne

Recently, variational auto-encoder (VAE) based approaches have made impressive progress on improving the diversity of generated responses. However, these methods usually suffer the cost of decreased relevance accompanied by diversity…

Computation and Language · Computer Science 2020-04-28 Zeyang Lei , Zekang Li , Jinchao Zhang , Fandong Meng , Yang Feng , Yujiu Yang , Cheng Niu , Jie Zhou

Determining the causal structure of a set of variables is critical for both scientific inquiry and decision-making. However, this is often challenging in practice due to limited interventional data. Given that randomized experiments are…

Methodology · Statistics 2019-02-28 Raj Agrawal , Chandler Squires , Karren Yang , Karthik Shanmugam , Caroline Uhler

Optimal experimental design (OED) is a framework that leverages a mathematical model of the experiment to identify optimal conditions for conducting the experiment. Under a Bayesian approach, the design objective function is typically…

Computation · Statistics 2026-01-27 Thomas E. Coons , Xun Huan

Optimal experimental design (OED) aims to choose the observations in an experiment to be as informative as possible, according to certain statistical criteria. In the linear case (when the observations depend linearly on the unknown…

Numerical Analysis · Mathematics 2026-02-25 Ruhui Jin , Martin Guerra , Qin Li , Stephen Wright

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

Machine Learning · Computer Science 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

Variational inference is an alternative estimation technique for Bayesian models. Recent work shows that variational methods provide consistent estimation via efficient, deterministic algorithms. Other tools, such as model selection using…

Methodology · Statistics 2023-08-01 Mark J. Meyer , Selina Carter , Elizabeth J. Malloy

Scientific experiments are usually expensive due to complex experimental preparation and processing. Experimental design is therefore involved with the task of finding the optimal experimental input that results in the desirable output by…

Machine Learning · Statistics 2020-02-27 Cheng Li , Sunil Gupta , Santu Rana , Vu Nguyen , Antonio Robles-Kelly , Svetha Venkatesh

We consider a task of surveillance-evading path-planning in a continuous setting. An Evader strives to escape from a 2D domain while minimizing the risk of detection (and immediate capture). The probability of detection is path-dependent…

Machine Learning · Computer Science 2023-02-24 Dongping Qi , David Bindel , Alexander Vladimirsky

Ensuring safety is a key aspect in sequential decision making problems, such as robotics or process control. The complexity of the underlying systems often makes finding the optimal decision challenging, especially when the safety-critical…

Machine Learning · Computer Science 2024-09-27 Jialin Li , Marta Zagorowska , Giulia De Pasquale , Alisa Rupenyan , John Lygeros

Achieving the full promise of the Thermodynamic Variational Objective (TVO), a recently proposed variational lower bound on the log evidence involving a one-dimensional Riemann integral approximation, requires choosing a "schedule" of…

Machine Learning · Computer Science 2020-11-24 Vu Nguyen , Vaden Masrani , Rob Brekelmans , Michael A. Osborne , Frank Wood

Variational autoencoders (VAEs) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their…

Machine Learning · Computer Science 2024-12-10 Hadi Vafaii , Dekel Galor , Jacob L. Yates