English
Related papers

Related papers: Model Selection for Bayesian Autoencoders

200 papers

For a Bayesian, the task to define the likelihood can be as perplexing as the task to define the prior. We focus on situations when the parameter of interest has been emancipated from the likelihood and is linked to data directly through a…

Computation · Statistics 2022-06-01 Lizhen Nie , Veronika Rockova

Imbalanced distribution learning is a common and significant challenge in predictive modeling, often reducing the performance of standard algorithms. Although various approaches address this issue, most are tailored to classification…

Machine Learning · Computer Science 2025-08-20 Samuel Stocksieker , Denys pommeret , Arthur Charpentier

Purpose: Machine learning is broadly used for clinical data analysis. Before training a model, a machine learning algorithm must be selected. Also, the values of one or more model parameters termed hyper-parameters must be set. Selecting…

Machine Learning · Computer Science 2018-12-10 Xueqiang Zeng , Gang Luo

Recent successes in image generation, model-based reinforcement learning, and text-to-image generation have demonstrated the empirical advantages of discrete latent representations, although the reasons behind their benefits remain unclear.…

Machine Learning · Computer Science 2023-07-27 David Friede , Christian Reimers , Heiner Stuckenschmidt , Mathias Niepert

Approximate Bayesian Computation (ABC) is a popular method for approximate inference in generative models with intractable but easy-to-sample likelihood. It constructs an approximate posterior distribution by finding parameters for which…

Computation · Statistics 2020-03-09 Kimia Nadjahi , Valentin De Bortoli , Alain Durmus , Roland Badeau , Umut Şimşekli

Self-supervised disentangled representation learning is a critical task in sequence modeling. The learnt representations contribute to better model interpretability as well as the data generation, and improve the sample efficiency for…

Machine Learning · Computer Science 2021-10-26 Junwen Bai , Weiran Wang , Carla Gomes

Computing expected information gain (EIG) from prior to posterior (equivalently, mutual information between candidate observations and model parameters or other quantities of interest) is a fundamental challenge in Bayesian optimal…

Methodology · Statistics 2026-01-30 Fengyi Li , Ricardo Baptista , Youssef Marzouk

The estimation of patient-specific tissue properties in the form of model parameters is important for personalized physiological models. However, these tissue properties are spatially varying across the underlying anatomical model,…

Machine Learning · Statistics 2020-05-19 Jwala Dhamala , Sandesh Ghimire , John L. Sapp , B. Milan Horácek , Linwei Wang

A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small…

Methodology · Statistics 2013-09-24 Zuofeng Shang , Ping Li

Deep learning has revolutionized the last decade, being at the forefront of extraordinary advances in a wide range of tasks including computer vision, natural language processing, and reinforcement learning, to name but a few. However, it…

Machine Learning · Computer Science 2024-01-24 Sebastian W. Ober

Driven by the critical needs of biomanufacturing 4.0, we introduce a probabilistic knowledge graph hybrid model characterizing the risk- and science-based understanding of bioprocess mechanisms. It can faithfully capture the important…

Machine Learning · Statistics 2022-10-03 Wei Xie , Keqi Wang , Hua Zheng , Ben Feng

In this paper we develop a dynamic form of Bayesian optimization for machine learning models with the goal of rapidly finding good hyperparameter settings. Our method uses the partial information gained during the training of a machine…

Machine Learning · Statistics 2014-06-17 Kevin Swersky , Jasper Snoek , Ryan Prescott Adams

We propose an empirical Bayes estimator based on Dirichlet process mixture model for estimating the sparse normalized mean difference, which could be directly applied to the high dimensional linear classification. In theory, we build a…

Machine Learning · Statistics 2017-02-17 Yunbo Ouyang , Feng Liang

Data-driven optimization of sampling patterns in MRI has recently received a significant attention.Following recent observations on the combinatorial number of minimizers in off-the-grid optimization, we propose a framework to globally…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Alban Gossard , Frédéric de Gournay , Pierre Weiss

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

We explore the theoretical and numerical property of a fully Bayesian model selection method in sparse ultrahigh-dimensional settings, i.e., $p\gg n$, where $p$ is the number of covariates and $n$ is the sample size. Our method consists of…

Methodology · Statistics 2013-03-13 Zuofeng Shang , Ping Li

We study Bayesian estimation of finite mixture models in a general setup where the number of components is unknown and allowed to grow with the sample size. An assumption on growing number of components is a natural one as the degree of…

Statistics Theory · Mathematics 2022-03-18 Ilsang Ohn , Lizhen Lin

A variational autoencoder (VAE) derived from Tsallis statistics called q-VAE is proposed. In the proposed method, a standard VAE is employed to statistically extract latent space hidden in sampled data, and this latent space helps make…

Machine Learning · Computer Science 2021-08-27 Taisuke Kobayashi

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

Bayesian inference is known to provide a general framework for incorporating prior knowledge or specific properties into machine learning models via carefully choosing a prior distribution. In this work, we propose a new type of prior…

Machine Learning · Statistics 2019-02-20 Andrei Atanov , Arsenii Ashukha , Kirill Struminsky , Dmitry Vetrov , Max Welling