English
Related papers

Related papers: A new wavelet-based variational family with copula…

200 papers

We develop flexible methods of deriving variational inference for models with complex latent variable structure. By splitting the variables in these models into "global" parameters and "local" latent variables, we define a class of…

Computation · Statistics 2019-04-23 Linda S. L. Tan , Aishwarya Bhaskaran , David J. Nott

Variational inference (VI) is a computationally efficient and scalable methodology for approximate Bayesian inference. It strikes a balance between accuracy of uncertainty quantification and practical tractability. It excels at generative…

Machine Learning · Statistics 2025-04-15 Alex Glyn-Davies , Arnaud Vadeboncoeur , O. Deniz Akyildiz , Ieva Kazlauskaite , Mark Girolami

Models with a large number of latent variables are often used to fully utilize the information in big or complex data. However, they can be difficult to estimate using standard approaches, and variational inference methods are a popular…

Methodology · Statistics 2021-04-20 Rubén Loaiza-Maya , Michael Stanley Smith , David J. Nott , Peter J. Danaher

In this work, we propose a scalable Bayesian procedure for learning the local dependence structure in a high-dimensional model where the variables possess a natural ordering. The ordering of variables can be indexed by time, the vicinities…

Methodology · Statistics 2021-09-27 Kyoungjae Lee , Lizhen Lin

Variational methods are employed in situations where exact Bayesian inference becomes intractable due to the difficulty in performing certain integrals. Typically, variational methods postulate a tractable posterior and formulate a lower…

Machine Learning · Statistics 2019-06-12 Nikolaos Gianniotis , Christoph Schnörr , Christian Molkenthin , Sanjay Singh Bora

Probability density estimation is a central task in statistics. Copula-based models provide a great deal of flexibility in modelling multivariate distributions, allowing for the specifications of models for the marginal distributions…

Methodology · Statistics 2024-05-08 Nicolás Kuschinski , Richard Warr , Alejandro Jara

This paper explores a class of empirical Bayes methods for level-dependent threshold selection in wavelet shrinkage. The prior considered for each wavelet coefficient is a mixture of an atom of probability at zero and a heavy-tailed…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman

This paper introduces two families of probability distributions for Bayesian analysis of hypertoroidal data. The first family consists of symmetric distributions derived from the projection of multivariate normal distributions under…

Methodology · Statistics 2025-12-02 Shogo Kato , Gianluca Mastrantonio , Masayuki Ishikawa

A framework to boost the efficiency of Bayesian inference in probabilistic programs is introduced by embedding a sampler inside a variational posterior approximation. We call it the refined variational approximation. Its strength lies both…

Machine Learning · Computer Science 2020-02-25 Victor Gallego , David Rios Insua

The purpose of this paper is twofold. First, we provide a novel characterization of independence of random vectors based on the checkerboard approximation to a multivariate copula. Using this result, we then propose a new family of tests of…

Statistics Theory · Mathematics 2019-06-07 José M. González-Barrios , Eduardo Gutiérrez-Peña , Juan D. Nieves , Raúl Rueda

Sampling from the posterior is a key technical problem in Bayesian statistics. Rigorous guarantees are difficult to obtain for Markov Chain Monte Carlo algorithms of common use. In this paper, we study an alternative class of algorithms…

Statistics Theory · Mathematics 2024-08-26 Andrea Montanari , Yuchen Wu

Hawkes processes are often applied to model dependence and interaction phenomena in multivariate event data sets, such as neuronal spike trains, social interactions, and financial transactions. In the nonparametric setting, learning the…

Statistics Theory · Mathematics 2023-09-04 Deborah Sulem , Vincent Rivoirard , Judith Rousseau

Variational inference uses optimization, rather than integration, to approximate the marginal likelihood, and thereby the posterior, in a Bayesian model. Thanks to advances in computational scalability made in the last decade, variational…

Machine Learning · Statistics 2023-01-04 Jens Sjölund

We propose a new method for estimating the extreme quantiles for a function of several dependent random variables. In contrast to the conventional approach based on extreme value theory, we do not impose the condition that the tail of the…

Methodology · Statistics 2013-11-25 Jinguo Gong , Yadong Li , Liang Peng , Qiwei Yao

Spatial concurrent linear models, in which the model coefficients are spatial processes varying at a local level, are flexible and useful tools for analyzing spatial data. One approach places stationary Gaussian process priors on the…

Applications · Statistics 2012-02-03 Zuofeng Shang , Murray K. Clayton

Random feature latent variable models (RFLVMs) represent the state-of-the-art in latent variable models, capable of handling non-Gaussian likelihoods and effectively uncovering patterns in high-dimensional data. However, their heavy…

Machine Learning · Computer Science 2024-10-24 Ying Li , Zhidi Lin , Yuhao Liu , Michael Minyi Zhang , Pablo M. Olmos , Petar M. Djurić

We introduce a flexible method to simultaneously infer both the drift and volatility functions of a discretely observed scalar diffusion. We introduce spline bases to represent these functions and develop a Markov chain Monte Carlo…

Methodology · Statistics 2023-10-02 Paul A. Jenkins , Murray Pollock , Gareth O. Roberts

Flexible regression methods where interest centres on the way that the whole distribution of a response vector changes with covariates are very useful in some applications. A recently developed technique in this regard uses the…

Computation · Statistics 2016-03-01 Meng Hwee Victor Ong , David J. Nott , Ajay Jasra

We develop adaptive estimation and inference methods for high-dimensional Gaussian copula regression that achieve the same performance without the knowledge of the marginal transformations as that for high-dimensional linear regression.…

Methodology · Statistics 2015-12-09 T. Tony Cai , Linjun Zhang

Variational inference methods often focus on the problem of efficient model optimization, with little emphasis on the choice of the approximating posterior. In this paper, we review and implement the various methods that enable us to…

Machine Learning · Statistics 2017-07-11 Siddhartha Saxena , Shibhansh Dohare , Jaivardhan Kapoor