English
Related papers

Related papers: Deep Bayesian Nonparametric Factor Analysis

200 papers

The paper exposes a non-parametric approach to latent and co-latent modeling of bivariate data, based upon alternating minimization of the Kullback-Leibler divergence (EM algorithm) for complete log-linear models. For categorical data, the…

Methodology · Statistics 2016-03-10 François Bavaud

Latent factor GARCH models are difficult to estimate using Bayesian methods because standard Markov chain Monte Carlo samplers produce slowly mixing and inefficient draws from the posterior distributions of the model parameters. This paper…

Methodology · Statistics 2015-07-07 Michael K. Pitt , Jamie Hall , Robert Kohn

Among likelihood-based approaches for deep generative modelling, variational autoencoders (VAEs) offer scalable amortized posterior inference and fast sampling. However, VAEs are also more and more outperformed by competing models such as…

Machine Learning · Computer Science 2021-07-01 Antoine Wehenkel , Gilles Louppe

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

We study the class of state-space models and perform maximum likelihood estimation for the model parameters. We consider a stochastic approximation expectation-maximization (SAEM) algorithm to maximize the likelihood function with the…

Computation · Statistics 2017-10-25 Umberto Picchini , Adeline Samson

Efficient learning and model compression algorithm for deep neural network (DNN) is a key workhorse behind the rise of deep learning (DL). In this work, we propose a message passing based Bayesian deep learning algorithm called EM-TDAMP to…

Machine Learning · Computer Science 2024-06-11 Wei Xu , An Liu , Yiting Zhang , Vincent Lau

Deep directed generative models have attracted much attention recently due to their generative modeling nature and powerful data representation ability. In this paper, we review different structures of deep directed generative models and…

Machine Learning · Computer Science 2017-10-16 Siqi Nie , Meng Zheng , Qiang Ji

This paper presents an augmented deep factor model that generates latent factors for cross-sectional asset pricing. The conventional security sorting on firm characteristics for constructing long-short factor portfolio weights is nonlinear…

Methodology · Statistics 2024-12-11 Guanhao Feng , Jingyu He , Nicholas G. Polson , Jianeng Xu

Gaussian processes (GPs) are nonparametric priors over functions. Fitting a GP implies computing a posterior distribution of functions consistent with the observed data. Similarly, deep Gaussian processes (DGPs) should allow us to compute a…

We introduce a dynamic generative model, Bayesian allocation model (BAM), which establishes explicit connections between nonnegative tensor factorization (NTF), graphical models of discrete probability distributions and their Bayesian…

Machine Learning · Statistics 2019-03-12 Ali Taylan Cemgil , Mehmet Burak Kurutmaz , Sinan Yildirim , Melih Barsbey , Umut Simsekli

We consider a nonparametric Bayesian approach to estimate the diffusion coefficient of a stochastic differential equation given discrete time observations over a fixed time interval. As a prior on the diffusion coefficient, we employ a…

Statistics Theory · Mathematics 2020-07-22 Shota Gugushvili , Frank van der Meulen , Moritz Schauer , Peter Spreij

Driven by the critical needs of biomanufacturing 4.0, we introduce a probabilistic knowledge graph hybrid model characterizing the risk- and science-based understanding of bioprocess mechanisms. It can faithfully capture the important…

Machine Learning · Statistics 2022-10-03 Wei Xie , Keqi Wang , Hua Zheng , Ben Feng

We present an exact Bayesian inference method for discrete statistical models, which can find exact solutions to a large class of discrete inference problems, even with infinite support and continuous priors. To express such models, we…

Programming Languages · Computer Science 2023-11-08 Fabian Zaiser , Andrzej S. Murawski , Luke Ong

Mapping data from and/or onto a known family of distributions has become an important topic in machine learning and data analysis. Deep generative models (e.g., generative adversarial networks ) have been used effectively to match known and…

Machine Learning · Computer Science 2020-10-30 Surojit Saha , Shireen Elhabian , Ross T. Whitaker

In this paper, we propose a new and unified approach for nonparametric regression and conditional distribution learning. Our approach simultaneously estimates a regression function and a conditional generator using a generative learning…

Machine Learning · Statistics 2023-06-28 Shanshan Song , Tong Wang , Guohao Shen , Yuanyuan Lin , Jian Huang

Recent advances have shown that GP priors, or their finite realisations, can be encoded using deep generative models such as variational autoencoders (VAEs). These learned generators can serve as drop-in replacements for the original priors…

Machine Learning · Statistics 2023-11-13 Elizaveta Semenova , Prakhar Verma , Max Cairney-Leeming , Arno Solin , Samir Bhatt , Seth Flaxman

Deep Gaussian processes (DGPs) are popular surrogate models for complex nonstationary computer experiments. DGPs use one or more latent Gaussian processes (GPs) to warp the input space into a plausibly stationary regime, then use typical GP…

Methodology · Statistics 2025-12-23 Annie S. Booth

We develop a scalable multi-step Monte Carlo algorithm for inference under a large class of nonparametric Bayesian models for clustering and classification. Each step is "embarrassingly parallel" and can be implemented using the same Markov…

Computation · Statistics 2018-06-08 Yang Ni , Peter Müller , Maurice Diesendruck , Sinead Williamson , Yitan Zhu , Yuan Ji

Estimation and prediction in high dimensional multivariate factor stochastic volatility models is an important and active research area because such models allow a parsimonious representation of multivariate stochastic volatility. Bayesian…

Computation · Statistics 2021-04-27 David Gunawan , Robert Kohn , David Nott

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

Methodology · Statistics 2022-10-14 Erik Spånberg