English
Related papers

Related papers: Scalable Variational Inference in Log-supermodular…

200 papers

In this paper, we consider a simple coding scheme for spatial modulation (SM), where the same set of active transmit antennas is repeatedly used over consecutive multiple transmissions. Based on a Gaussian approximation, an approximate…

Information Theory · Computer Science 2019-01-01 Jinho Choi

Despite their theoretical appealingness, Bayesian neural networks (BNNs) are left behind in real-world adoption, mainly due to persistent concerns on their scalability, accessibility, and reliability. In this work, we develop the…

Machine Learning · Computer Science 2022-10-14 Zhijie Deng , Jun Zhu

The inferential models (IM) framework provides prior-free, frequency-calibrated, posterior probabilistic inference. The key is the use of random sets to predict unobservable auxiliary variables connected to the observable data and unknown…

Statistics Theory · Mathematics 2016-01-26 Ryan Martin , Chuanhai Liu

We pursue tractable Bayesian analysis of generalized linear models (GLMs) for categorical data. Thus far, GLMs are difficult to scale to more than a few dozen categories due to non-conjugacy or strong posterior dependencies when using…

Machine Learning · Statistics 2022-06-02 Michael T. Wojnowicz , Shuchin Aeron , Eric L. Miller , Michael C. Hughes

Subspace inference for neural networks assumes that a subspace of their parameter space suffices to produce a reliable uncertainty quantification. In this work, we underpin the validity of this assumption by using low rank techniques. We…

Machine Learning · Computer Science 2026-04-13 Josua Faller , Jörg Martin

Variational inference has experienced a recent surge in popularity owing to stochastic approaches, which have yielded practical tools for a wide range of model classes. A key benefit is that stochastic variational inference obviates the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Plötz , Anne S. Wannenwetsch , Stefan Roth

The likelihood-informed subspace (LIS) method offers a viable route to reducing the dimensionality of high-dimensional probability distributions arising in Bayesian inference. LIS identifies an intrinsic low-dimensional linear subspace…

Computation · Statistics 2021-10-22 Tiangang Cui , Xin T. Tong

Deep learning models have achieved great success on various vision challenges, but a well-trained model would face drastic performance degradation when applied to unseen data. Since the model is sensitive to domain shift, unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Ziyu Ye , Chen Ju , Chaofan Ma , Xiaoyun Zhang

The Bayesian paradigm has the potential to solve core issues of deep neural networks such as poor calibration and data inefficiency. Alas, scaling Bayesian inference to large weight spaces often requires restrictive approximations. In this…

This is a preliminary version of visual interpretation integrating multiple sensors in SUCCESSOR, an intelligent, model-based vision system. We pursue a thorough integration of hierarchical Bayesian inference with comprehensive physical…

Artificial Intelligence · Computer Science 2013-04-11 Thomas O. Binford , Tod S. Levitt , Wallace B. Mann

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

Bayesian statistical inference loses predictive optimality when generative models are misspecified. Working within an existing coherent loss-based generalisation of Bayesian inference, we show existing Modular/Cut-model inference is…

Methodology · Statistics 2026-05-18 Chris U. Carmona , Geoff K. Nicholls

Exact inference of marginals in probabilistic graphical models (PGM) is known to be intractable, necessitating the use of approximate methods. Most of the existing variational techniques perform iterative message passing in loopy graphs…

Artificial Intelligence · Computer Science 2023-10-31 Shivani Bathla , Vinita Vasudevan

Semi-structured regression models enable the joint modeling of interpretable structured and complex unstructured feature effects. The structured model part is inspired by statistical models and can be used to infer the input-output…

Machine Learning · Computer Science 2024-01-24 Daniel Dold , David Rügamer , Beate Sick , Oliver Dürr

Simulation-based inference techniques are indispensable for parameter estimation of mechanistic and simulable models with intractable likelihoods. While traditional statistical approaches like approximate Bayesian computation and Bayesian…

Methodology · Statistics 2024-03-08 Ryan P. Kelly , David J. Nott , David T. Frazier , David J. Warne , Chris Drovandi

Variational inference (VI) has emerged as a popular method for approximate inference for high-dimensional Bayesian models. In this paper, we propose a novel VI method that extends the naive mean field via entropic regularization, referred…

Machine Learning · Statistics 2026-02-02 Bohan Wu , David Blei

In the context of inference with expectation constraints, we propose an approach based on the "loopy belief propagation" algorithm LBP, as a surrogate to an exact Markov Random Field MRF modelling. A prior information composed of…

Machine Learning · Computer Science 2015-05-13 Cyril Furtlehner , Jean-Marc Lasgouttes , Anne Auger

Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventional BED methods…

Machine Learning · Computer Science 2021-03-16 Jiaxin Zhang , Sirui Bi , Guannan Zhang

We present an efficient, principled, and interpretable technique for inferring module assignments and for identifying the optimal number of modules in a given network. We show how several existing methods for finding modules can be…

Data Analysis, Statistics and Probability · Physics 2008-06-23 Jake M. Hofman , Chris H. Wiggins

There has been much recent interest in modifying Bayesian inference for misspecified models so that it is useful for specific purposes. One popular modified Bayesian inference method is "cutting feedback" which can be used when the model…