English
Related papers

Related papers: Hierarchical Importance Weighted Autoencoders

200 papers

Hierarchical Variational Autoencoders (VAEs) are among the most popular likelihood-based generative models. There is a consensus that the top-down hierarchical VAEs allow effective learning of deep latent structures and avoid problems like…

Machine Learning · Computer Science 2023-09-29 Anna Kuzina , Jakub M. Tomczak

Importance sampling (IS) is an important technique to reduce the estimation variance in Monte Carlo simulations. In many practical problems, however, the use of IS method may result in unbounded variance, and thus fail to provide reliable…

Computation · Statistics 2019-02-26 Tengchao Yu , Linjun Lu , Jinglai Li

It is often of interest to combine available estimates of a similar quantity from multiple data sources. When the corresponding variances of each estimate are also available, a model should take into account the uncertainty of the estimates…

Methodology · Statistics 2021-09-17 Yujing Yao , R. Todd Ogden , Chubing Zeng , Qixuan Chen

Estimating the parameters of compact binaries which coalesce and produce gravitational waves is a challenging Bayesian inverse problem. Gravitational-wave parameter estimation lies within the class of multifidelity problems, where a variety…

General Relativity and Quantum Cosmology · Physics 2024-05-31 Bassel Saleh , Aaron Zimmerman , Peng Chen , Omar Ghattas

Diffusion models may be viewed as hierarchical variational autoencoders (VAEs) with two improvements: parameter sharing for the conditional distributions in the generative process and efficient computation of the loss as independent terms…

Machine Learning · Computer Science 2025-10-20 Beatrix M. G. Nielsen , Anders Christensen , Andrea Dittadi , Ole Winther

We provide an inferential framework to assess variable importance for heterogeneous treatment effects. This assessment is especially useful in high-risk domains such as medicine, where decision makers hesitate to rely on black-box treatment…

Methodology · Statistics 2026-05-11 Pawel Morzywolek , Peter B. Gilbert , Alex Luedtke

Hierarchical models with gamma hyperpriors provide a flexible, sparse-promoting framework to bridge $L^1$ and $L^2$ regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing…

Methodology · Statistics 2021-11-30 Shiv Agrawal , Hwanwoo Kim , Daniel Sanz-Alonso , Alexander Strang

An importance sampling approach for sampling copula models is introduced. We propose two algorithms that improve Monte Carlo estimators when the functional of interest depends mainly on the behaviour of the underlying random vector when at…

Computation · Statistics 2015-04-08 Philipp Arbenz , Mathieu Cambou , Marius Hofert

We present a weighted estimator of the covariance and correlation in bipartite complex systems with a double layer of heterogeneity. The advantage provided by the weighted estimators lies in the fact that the unweighted sample covariance…

Data Analysis, Statistics and Probability · Physics 2016-12-22 Elena Puccio , Jyrki Piilo , Michele Tumminello

Adaptive importance sampling for stochastic optimization is a promising approach that offers improved convergence through variance reduction. In this work, we propose a new framework for variance reduction that enables the use of mixtures…

Machine Learning · Computer Science 2019-04-01 Zalán Borsos , Sebastian Curi , Kfir Y. Levy , Andreas Krause

In machine learning models, the estimation of errors is often complex due to distribution bias, particularly in spatial data such as those found in environmental studies. We introduce an approach based on the ideas of importance sampling to…

Machine Learning · Computer Science 2023-09-15 Boris Prokhorov , Diana Koldasbayeva , Alexey Zaytsev

Existing metrics in competing risks survival analysis such as concordance and accuracy do not evaluate a model's ability to jointly predict the event type and the event time. To address these limitations, we propose a new metric, which we…

Methodology · Statistics 2019-08-20 Kartik Ahuja , Mihaela van der Schaar

Multivariate meta-analysis is gaining prominence in evidence synthesis research because it enables simultaneous synthesis of multiple correlated outcome data, and random-effects models have generally been used for addressing between-studies…

Methodology · Statistics 2021-07-14 Hisashi Noma , Kengo Nagashima , Toshi A. Furukawa

Adaptive importance sampling is a widely spread Monte Carlo technique that uses a re-weighting strategy to iteratively estimate the so-called target distribution. A major drawback of adaptive importance sampling is the large variance of the…

Statistics Theory · Mathematics 2021-11-01 Anna Korba , François Portier

Multiple importance sampling estimators are widely used for computing intractable constants due to its reliability and robustness. The celebrated balance heuristic estimator belongs to this class of methods and has proved very successful in…

Computation · Statistics 2019-09-05 Felipe J Medina-Aguayo , Richard G Everitt

Maximum Likelihood Estimation of continuous variable models can be very challenging in high dimensions, due to potentially complex probability distributions. The existence of multiple interdependencies among variables can make it very…

Machine Learning · Statistics 2024-09-06 Jean-Sébastien Brouillon , Florian Dörfler , Giancarlo Ferrari-Trecate

In various data settings, it is necessary to compare observations from disparate data sources. We assume the data is in the dissimilarity representation and investigate a joint embedding method that results in a commensurate representation…

Methodology · Statistics 2016-01-05 Sancar Adali , Carey E. Priebe

In the variational relevance vector machine, the gamma distribution is representative as a hyperprior over the noise precision of automatic relevance determination prior. Instead of the gamma hyperprior, we propose to use the inverse gamma…

Machine Learning · Statistics 2020-05-08 Kazuaki. Murayama , Shuichi. Kawano

We aim to create the highest possible quality of treatment-control matches for categorical data in the potential outcomes framework. Matching methods are heavily used in the social sciences due to their interpretability, but most matching…

Machine Learning · Statistics 2019-06-11 Yameng Liu , Aw Dieng , Sudeepa Roy , Cynthia Rudin , Alexander Volfovsky

Recently, researches related to unsupervised disentanglement learning with deep generative models have gained substantial popularity. However, without introducing supervision, there is no guarantee that the factors of interest can be…

Machine Learning · Computer Science 2020-03-13 Junxiang Chen , Kayhan Batmanghelich