English
Related papers

Related papers: Vertical Consensus Inference for High-Dimensional …

200 papers

Variational inference (VI) is a popular method for approximating intractable posterior distributions in Bayesian inference and probabilistic machine learning. In this paper, we introduce a general framework for quantifying the statistical…

Statistics Theory · Mathematics 2025-07-18 Chenyang Zhong , Sumit Mukherjee , Bodhisattva Sen

Clustering in high-dimensional settings with severe feature noise remains challenging, especially when only a small subset of dimensions is informative and the final number of clusters is not specified in advance. In such regimes, partition…

Machine Learning · Statistics 2026-04-09 Wan Ping Chen

A key design constraint when implementing Monte Carlo and variational inference algorithms is that it must be possible to cheaply and exactly evaluate the marginal densities of proposal distributions and variational families. This takes…

Machine Learning · Computer Science 2022-11-22 Alexander K. Lew , Marco Cusumano-Towner , Vikash K. Mansinghka

This paper presents Orthogonal Subspace Clustering (OSC), an innovative method for high-dimensional data clustering. We first establish a theoretical theorem proving that high-dimensional data can be decomposed into orthogonal subspaces in…

Machine Learning · Computer Science 2026-03-17 Qing-Yuan Wen , Da-Qing Zhang

We study in this paper a variant of Wasserstein barycenter problem, which we refer to as tree-Wasserstein barycenter, by leveraging a specific class of ground metrics, namely tree metrics, for Wasserstein distance. Drawing on the tree…

Machine Learning · Statistics 2020-02-28 Tam Le , Viet Huynh , Nhat Ho , Dinh Phung , Makoto Yamada

We develop a Coordinate Ascent Variational Inference (CAVI) algorithm for Bayesian Mixed Data Sampling (MIDAS) regression with linear weight parameterizations. The model separates impact coeffcients from weighting function parameters…

Machine Learning · Computer Science 2026-02-24 Luigi Simeone

Variational inference (VI) is widely used as an efficient alternative to Markov chain Monte Carlo. It posits a family of approximating distributions $q$ and finds the closest member to the exact posterior $p$. Closeness is usually measured…

Machine Learning · Statistics 2017-11-15 Adji B. Dieng , Dustin Tran , Rajesh Ranganath , John Paisley , David M. Blei

In this work, we address the unsupervised classification issue by exploiting the general idea of Random Projection Ensemble. Specifically, we propose to generate a set of low dimensional independent random projections and to perform…

Methodology · Statistics 2020-11-24 Laura Anderlucci , Francesca Fortunato , Angela Montanari

Multiple clustering aims at exploring alternative clusterings to organize the data into meaningful groups from different perspectives. Existing multiple clustering algorithms are designed for single-view data. We assume that the…

Machine Learning · Computer Science 2019-05-16 Shixing Yao , Guoxian Yu , Jun Wang , Carlotta Domeniconi , Xiangliang Zhang

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high…

Machine Learning · Statistics 2025-09-11 Ponkrshnan Thiagarajan , Tamer A. Zaki , Michael D. Shields

Reconstructing the evolutionary history relating a collection of molecular sequences is the main subject of modern Bayesian phylogenetic inference. However, the commonly used Markov chain Monte Carlo methods can be inefficient due to the…

Machine Learning · Statistics 2024-08-12 Tianyu Xie , Frederick A. Matsen , Marc A. Suchard , Cheng Zhang

Biclustering algorithms play a central role in the biotechnological and biomedical domains. The knowledge extracted supports the extraction of putative regulatory modules, essential to understanding diseases, aiding therapy research, and…

Databases · Computer Science 2022-12-13 Leonardo Alexandre , Rafael S. Costa , Rui Henriques

In this paper, we consider a Bayesian bi-level variable selection problem in high-dimensional regressions. In many practical situations, it is natural to assign group membership to each predictor. Examples include that genetic variants can…

Applications · Statistics 2018-03-29 Mingxuan Cai , Mingwei Dai , Jingsi Ming , Heng Peng , Jin Liu , Can Yang

We propose a novel method for multiple clustering that assumes a co-clustering structure (partitions in both rows and columns of the data matrix) in each view. The new method is applicable to high-dimensional data. It is based on a…

Bayesian phylogenetic inference is often conducted via local or sequential search over topologies and branch lengths using algorithms such as random-walk Markov chain Monte Carlo (MCMC) or Combinatorial Sequential Monte Carlo (CSMC).…

Machine Learning · Statistics 2021-06-21 Antonio Khalil Moretti , Liyi Zhang , Christian A. Naesseth , Hadiah Venner , David Blei , Itsik Pe'er

This paper discusses distributed approaches for the solution of random convex programs (RCP). RCPs are convex optimization problems with a (usually large) number N of randomly extracted constraints; they arise in several applicative areas,…

Optimization and Control · Mathematics 2012-07-27 Luca Carlone , Vaibhav Srivastava , Francesco Bullo , Giuseppe Calafiore

Variational inference (VI) is a method to approximate the computationally intractable posterior distributions that arise in Bayesian statistics. Typically, VI fits a simple parametric distribution to the target posterior by minimizing an…

Machine Learning · Statistics 2023-07-18 Chirag Modi , Charles Margossian , Yuling Yao , Robert Gower , David Blei , Lawrence Saul

Approximating complex probability densities is a core problem in modern statistics. In this paper, we introduce the concept of Variational Inference (VI), a popular method in machine learning that uses optimization techniques to estimate…

Machine Learning · Computer Science 2021-11-23 Ankush Ganguly , Samuel W. F. Earp

We propose a Deep Variational Clustering (DVC) framework for unsupervised representation learning and clustering of large-scale medical images. DVC simultaneously learns the multivariate Gaussian posterior through the probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Farzin Soleymani , Mohammad Eslami , Tobias Elze , Bernd Bischl , Mina Rezaei

Varying coefficient models (VCMs) are widely used for estimating nonlinear regression functions for functional data. Their Bayesian variants using Gaussian process priors on the functional coefficients, however, have received limited…

Methodology · Statistics 2022-03-01 Rajarshi Guhaniyogi , Cheng Li , Terrance D. Savitsky , Sanvesh Srivastava