English
Related papers

Related papers: Using Large Ensembles of Control Variates for Vari…

200 papers

The importance of exploring a potential integration among surveys has been acknowledged in order to enhance effectiveness and minimize expenses. In this work, we employ the alignment method to combine information from two different surveys…

Methodology · Statistics 2024-04-09 Vasilis Chasiotis , Dimitris Karlis

This paper studies the optimization of observation channels (stochastic kernels) in partially observed stochastic control problems. In particular, existence and continuity properties are investigated mostly (but not exclusively)…

Optimization and Control · Mathematics 2012-02-09 Serdar Yüksel , Tamás Linder

In robust optimisation problems the objective function consists of an average over (an ensemble of) uncertain parameters. Ensemble optimisation (EnOpt) implements steepest descent by estimating the gradient using linear regression on…

Optimization and Control · Mathematics 2023-04-25 Patrick N. Raanes , Andreas S. Stordal , Rolf J. Lorentzen

Multifidelity modeling has been steadily gaining attention as a tool to address the problem of exorbitant model evaluation costs that makes the estimation of failure probabilities a significant computational challenge for complex real-world…

Methodology · Statistics 2024-11-26 Promit Chakroborty , Somayajulu L. N. Dhulipala , Michael D. Shields

The constrained gradient method (CGM) has recently been proposed to solve convex optimization and monotone variational inequality (VI) problems with general functional constraints. While existing literature has established convergence…

Optimization and Control · Mathematics 2025-11-24 Danqing Zhou , Hongmei Chen , Shiqian Ma , Junfeng Yang

Complex system design problems, such as those involved in aerospace engineering, require the use of numerically costly simulation codes in order to predict the performance of the system to be designed. In this context, these codes are often…

Optimization and Control · Mathematics 2024-02-14 Loic Brevault , Mathieu Balesdent

In this paper we examine a control variate estimator for a quantity that can be expressed as the expectation of a functional of a random process, that is itself the solution of a differential equation driven by fast mean-reverting ergodic…

Probability · Mathematics 2020-08-10 Josselin Garnier , Laurent Mertz

We consider a variance reduction approach for the stochastic homogenization of divergence form linear elliptic problems. Although the exact homogenized coefficients are deterministic, their practical approximations are random. We introduce…

Numerical Analysis · Mathematics 2014-07-31 Frederic Legoll , William Minvielle

Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of…

Computation · Statistics 2015-05-20 Tim Salimans , Diederik P. Kingma , Max Welling

Adjustable hyperparameters of machine learning models typically impact various key trade-offs such as accuracy, fairness, robustness, or inference cost. Our goal in this paper is to find a configuration that adheres to user-specified limits…

Machine Learning · Computer Science 2023-12-05 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

This note is concerned with an accurate and computationally efficient variational bayesian treatment of mixed-effects modelling. We focus on group studies, i.e. empirical studies that report multiple measurements acquired in multiple…

Machine Learning · Statistics 2019-03-22 Jean Daunizeau

A method based on Bayesian neural networks and genetic algorithm is proposed to control the fermentation process. The relationship between input and output variables is modelled using Bayesian neural network that is trained using hybrid…

Computational Engineering, Finance, and Science · Computer Science 2007-05-23 Tshilidzi Marwala

Model-based policy optimization is a well-established framework for designing reliable and high-performance controllers across a wide range of control applications. Recently, this approach has been extended to model predictive control…

Systems and Control · Electrical Eng. & Systems 2026-04-15 Riccardo Zuliani , Efe C. Balta , John Lygeros

Variable selection in cluster analysis is important yet challenging. It can be achieved by regularization methods, which realize a trade-off between the clustering accuracy and the number of selected variables by using a lasso-type penalty.…

Methodology · Statistics 2016-12-23 Marbac Matthieu , Sedki Mohammed

This paper provides a unifying theoretical framework for stochastic optimization algorithms by means of a latent stochastic variational problem. Using techniques from stochastic control, the solution to the variational problem is shown to…

Machine Learning · Computer Science 2019-10-29 Philippe Casgrain

Statistical inference methods are fundamentally important in machine learning. Most state-of-the-art inference algorithms are variants of Markov chain Monte Carlo (MCMC) or variational inference (VI). However, both methods struggle with…

Machine Learning · Computer Science 2019-10-17 Yichuan Zhang , José Miguel Hernández-Lobato

Covariate-adaptive randomization is widely employed to balance baseline covariates in interventional studies such as clinical trials and experiments in development economics. Recent years have witnessed substantial progress in inference…

Methodology · Statistics 2024-05-30 Jiahui Xin , Hanzhong Liu , Wei Ma

Monte Carlo (MC) integration is an important calculational technique in the physical sciences. Practical considerations require that the calculations are performed as accurately as possible for a given set of computational resources. To…

High Energy Physics - Phenomenology · Physics 2024-11-08 Prasanth Shyamsundar , Jacob L. Scott , Stephen Mrenna , Konstantin T. Matchev , Kyoungchul Kong

Black Box Variational Inference is a promising framework in a succession of recent efforts to make Variational Inference more ``black box". However, in basic version it either fails to converge due to instability or requires some…

Machine Learning · Computer Science 2024-05-10 Dominic B. Dayta

We discuss the problem of input design for uncertainty reduction in a parameter estimation procedure. Assuming a linear continuous-time control system with noisy measurements, we formulate an objective of variance reduction in a Bayesian…

Optimization and Control · Mathematics 2025-11-21 Ludovic Sacchelli , Alessandro Scagliotti