English
Related papers

Related papers: Meta-learning Control Variates: Variance Reduction…

200 papers

We consider the problem of estimating confidence intervals for the mean of a random variable, where the goal is to produce the smallest possible interval for a given number of samples. While minimax optimal algorithms are known for this…

Machine Learning · Statistics 2020-06-19 Shengjia Zhao , Christopher Yeh , Stefano Ermon

A general methodology is introduced for the construction and effective application of control variates to estimation problems involving data from reversible MCMC samplers. We propose the use of a specific class of functions as control…

Computation · Statistics 2010-08-10 Petros Dellaportas , Ioannis Kontoyiannis

Meta-analyses frequently include trials that report multiple effect sizes based on a common set of study participants. These effect sizes will generally be correlated. Cluster-robust variance-covariance estimators are a fruitful approach…

Methodology · Statistics 2022-03-07 Thilo Welz , Wolfgang Viechtbauer , Markus Pauly

Monte Carlo (MC) sampling is a popular method for estimating the statistics (e.g. expectation and variance) of a random variable. Its slow convergence has led to the emergence of advanced techniques to reduce the variance of the MC…

Statistics Theory · Mathematics 2024-06-21 Mohamed Reda El Amri , Paul Mycek , Sophie Ricci , Matthias De Lozzo

Biased regularization and fine-tuning are two recent meta-learning approaches. They have been shown to be effective to tackle distributions of tasks, in which the tasks' target vectors are all close to a common meta-parameter vector.…

Machine Learning · Computer Science 2020-08-26 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

A non-parametric extension of control variates is presented. These leverage gradient information on the sampling density to achieve substantial variance reduction. It is not required that the sampling density be normalised. The novel…

Methodology · Statistics 2016-04-05 Chris J. Oates , Mark Girolami , Nicolas Chopin

This work introduces meta estimators that combine multiple multifidelity techniques based on control variates, importance sampling, and information reuse to yield a quasi-multiplicative amount of variance reduction. The proposed meta…

Computational Physics · Physics 2023-01-19 Frederick Law , Antoine Cerfon , Benjamin Peherstorfer , Florian Wechsung

An identification is found between meta-learning and the problem of determining the ground state of a randomly generated Hamiltonian drawn from a known ensemble. A model-agnostic meta-learning approach is proposed to solve the associated…

Quantum Physics · Physics 2020-11-24 Tianchen Zhao , James Stokes , Oliver Knitter , Brian Chen , Shravan Veerapaneni

Monte Carlo methods are widely used for neutron transport simulations at least partly because of the accuracy they bring to the modeling of these problems. However, the computational burden associated with the slow convergence rate of Monte…

Computational Physics · Physics 2025-09-30 Jordan Northrop , Ilham Variansyah , Todd Palmer , Camille Palmer

Data availability has dramatically increased in recent years, driving model-based control methods to exploit learning techniques for improving the system description, and thus control performance. Two key factors that hinder the practical…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Elena Arcari , Andrea Carron , Melanie N. Zeilinger

Data-driven control offers a viable option for control scenarios where constructing a system model is expensive or time-consuming. Nonetheless, many of these algorithms are not entirely automated, often necessitating the adjustment of…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Riccardo Busetto , Valentina Breschi , Federica Baracchi , Simone Formentin

Popular measures of meta-analysis heterogeneity, such as $I^2$, cannot be considered measures of population heterogeneity since they are dependant on samples sizes within studies. The coefficient of variation (CV) recently introduced and…

Methodology · Statistics 2020-10-06 Maxwell Cairns , Luke Prendergast

Meta-learning is a branch of machine learning which aims to quickly adapt models, such as neural networks, to perform new tasks by learning an underlying structure across related tasks. In essence, models are being trained to learn new…

We introduce a class of Monte Carlo estimators that aim to overcome the rapid growth of variance with dimension often observed for standard estimators by exploiting the target's independence structure. We identify the most basic…

Statistics Theory · Mathematics 2021-11-02 Juan Kuntz , Francesca R. Crucinio , Adam M. Johansen

Learning strategies for imperfect information games from samples of interaction is a challenging problem. A common method for this setting, Monte Carlo Counterfactual Regret Minimization (MCCFR), can have slow long-term convergence rates…

Computer Science and Game Theory · Computer Science 2018-09-11 Martin Schmid , Neil Burch , Marc Lanctot , Matej Moravcik , Rudolf Kadlec , Michael Bowling

The recent growth in multi-fidelity uncertainty quantification has given rise to a large set of variance reduction techniques that leverage information from model ensembles to provide variance reduction for estimates of the statistics of a…

Methodology · Statistics 2021-01-11 Trung Pham , Alex A. Gorodetsky

Meta-learning is a popular framework for learning with limited data in which an algorithm is produced by training over multiple few-shot learning tasks. For classification problems, these tasks are typically constructed by sampling a small…

Machine Learning · Computer Science 2021-10-08 Amrith Setlur , Oscar Li , Virginia Smith

Kinetic equations play a major rule in modeling large systems of interacting particles. Uncertainties may be due to various reasons, like lack of knowledge on the microscopic interaction details or incomplete informations at the boundaries.…

Numerical Analysis · Mathematics 2019-05-01 Giacomo Dimarco , Lorenzo Pareschi

Estimation of causal effects using machine learning methods has become an active research field in econometrics. In this paper, we study the finite sample performance of meta-learners for estimation of heterogeneous treatment effects under…

Econometrics · Economics 2022-02-01 Gabriel Okasa

Control variates are a variance-reduction technique for Monte Carlo integration. The principle involves approximating the integrand by a function that can be analytically integrated, and integrating using the Monte Carlo method only the…

Graphics · Computer Science 2025-09-22 Daniel Meister , Takahiro Harada