English
Related papers

Related papers: Cluster-based Regression using Variational Inferen…

200 papers

Approximating complex probability densities is a core problem in modern statistics. In this paper, we introduce the concept of Variational Inference (VI), a popular method in machine learning that uses optimization techniques to estimate…

Machine Learning · Computer Science 2021-11-23 Ankush Ganguly , Samuel W. F. Earp

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation…

Computation · Statistics 2018-05-11 David M. Blei , Alp Kucukelbir , Jon D. McAuliffe

Variational inference is computationally challenging in models that contain both conjugate and non-conjugate terms. Methods specifically designed for conjugate models, even though computationally efficient, find it difficult to deal with…

Machine Learning · Computer Science 2017-04-14 Mohammad Emtiyaz Khan , Wu Lin

Bayesian hierarchical linear models provide a natural framework to analyze nested and clustered data. Classical estimation with Markov chain Monte Carlo produces well calibrated posterior distributions but becomes computationally expensive…

Methodology · Statistics 2025-12-16 Cristian Parra-Aldana , Juan Sosa

Functional data analysis deals with data recorded densely over time (or any other continuum) with one or more observed curves per subject. Conceptually, functional data are continuously defined, but in practice, they are usually observed at…

Methodology · Statistics 2023-01-20 Chengqian Xian , Camila de Souza , John Jewell , Ronaldo Dias

Variational inference (VI) is a popular method for approximating intractable posterior distributions in Bayesian inference and probabilistic machine learning. In this paper, we introduce a general framework for quantifying the statistical…

Statistics Theory · Mathematics 2025-07-18 Chenyang Zhong , Sumit Mukherjee , Bodhisattva Sen

Vanilla variational inference finds an optimal approximation to the Bayesian posterior distribution, but even the exact Bayesian posterior is often not meaningful under model misspecification. We propose predictive variational inference…

Machine Learning · Statistics 2026-03-31 Jinlin Lai , Antonio Linero , Yuling Yao

Variational inference has been widely used in machine learning literature to fit various Bayesian models. In network analysis, this method has been successfully applied to solve the community detection problems. Although these results are…

Machine Learning · Statistics 2024-05-22 Xuezhen Li , Can M. Le

We investigate the parameter estimation of regression models with fixed group effects, when the group variable is missing while group related variables are available. This problem involves clustering to infer the missing group variable…

Methodology · Statistics 2020-12-29 Matthieu Marbac , Mohammed Sedki , Christophe Biernacki , Vincent Vandewalle

Many modern unsupervised or semi-supervised machine learning algorithms rely on Bayesian probabilistic models. These models are usually intractable and thus require approximate inference. Variational inference (VI) lets us approximate a…

Machine Learning · Computer Science 2018-10-24 Cheng Zhang , Judith Butepage , Hedvig Kjellstrom , Stephan Mandt

Variational inference (VI) is a computationally efficient and scalable methodology for approximate Bayesian inference. It strikes a balance between accuracy of uncertainty quantification and practical tractability. It excels at generative…

Machine Learning · Statistics 2025-04-15 Alex Glyn-Davies , Arnaud Vadeboncoeur , O. Deniz Akyildiz , Ieva Kazlauskaite , Mark Girolami

This article concerns the dimension reduction in regression for large data set. We introduce a new method based on the sliced inverse regression approach, called cluster-based regularized sliced inverse regression. Our method not only keeps…

Applications · Statistics 2013-12-03 Yue Yu , Zhihong Chen , Jie Yang

A conventional Bayesian approach to prediction uses the posterior distribution to integrate out parameters in a density for unobserved data conditional on the observed data and parameters. When the true posterior is intractable, it is…

Methodology · Statistics 2026-02-27 Lucas Kock , Scott A. Sisson , G. S. Rodrigues , David J. Nott

The core principle of Variational Inference (VI) is to convert the statistical inference problem of computing complex posterior probability densities into a tractable optimization problem. This property enables VI to be faster than several…

Machine Learning · Computer Science 2023-10-25 Ankush Ganguly , Sanjana Jain , Ukrit Watchareeruetai

For better clustering performance, appropriate representations are critical. Although many neural network-based metric learning methods have been proposed, they do not directly train neural networks to improve clustering performance. We…

Machine Learning · Statistics 2021-03-02 Tomoharu Iwata

Traditional neural networks are simple to train but they typically produce overconfident predictions. In contrast, Bayesian neural networks provide good uncertainty quantification but optimizing them is time consuming due to the large…

Machine Learning · Computer Science 2024-11-07 Yadi Wei , Roni Khardon

Variational inference (VI) is a specific type of approximate Bayesian inference that approximates an intractable posterior distribution with a tractable one. VI casts the inference problem as an optimization problem, more specifically, the…

Machine Learning · Computer Science 2022-12-20 Felix Leibfried

Many financial and economic variables, including financial returns, exhibit nonlinear dependence, heterogeneity and heavy-tailedness. These properties may make problematic the analysis of (non-)efficiency and volatility clustering in…

Econometrics · Economics 2023-12-01 Rustam Ibragimov , Rasmus Pedersen , Anton Skrobotov

Motivated by modern applications in which one constructs graphical models based on a very large number of features, this paper introduces a new class of cluster-based graphical models, in which variable clustering is applied as an initial…

Machine Learning · Statistics 2020-06-09 Carson Eisenach , Florentina Bunea , Yang Ning , Claudiu Dinicu

In this paper we use Clustering Method to understand whether stock market volatility can be predicted at all, and if so, when it can be predicted. The exercise has been performed for the Indian stock market on daily data for two years. For…

Computational Engineering, Finance, and Science · Computer Science 2016-04-19 Tamal Datta Chaudhuri , Indranil Ghosh
‹ Prev 1 2 3 10 Next ›