中文
相关论文

相关论文: Batch, match, and patch: low-rank approximations f…

200 篇论文

Large spatial datasets with non-Gaussian responses are increasingly common in environmental monitoring, ecology, and remote sensing, yet scalable Bayesian inference for such data remains challenging. Markov chain Monte Carlo (MCMC) methods…

统计方法学 · 统计学 2025-12-02 Jin Hyung Lee , Ben Seiyon Lee

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

机器学习 · 计算机科学 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

We discuss a method of parameter reduction in complex models known as the Manifold Boundary Approximation Method (MBAM). This approach, based on a geometric interpretation of statistics, maps the model reduction problem to a geometric…

数据分析、统计与概率 · 物理学 2016-05-30 Mark K. Transtrum

Structural equation models (SEMs) are commonly used to study the structural relationship between observed variables and latent constructs. Recently, Bayesian fitting procedures for SEMs have received more attention thanks to their potential…

统计方法学 · 统计学 2024-07-12 Khue-Dung Dang , Luca Maestrini , Francis K. C. Hui

Variational inference algorithms have proven successful for Bayesian analysis in large data settings, with recent advances using stochastic variational inference (SVI). However, such methods have largely been studied in independent or…

机器学习 · 统计学 2014-11-07 Nicholas J. Foti , Jason Xu , Dillon Laird , Emily B. Fox

Covariance matrix estimation, a classical statistical topic, poses significant challenges when the sample size is comparable to or smaller than the number of features. In this paper, we frame covariance matrix estimation as a compound…

统计方法学 · 统计学 2025-03-04 Huqin Xin , Sihai Dave Zhao

We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assigning a mean-field…

机器学习 · 统计学 2025-08-12 Ismaël Castillo , Alice L'Huillier , Kolyan Ray , Luke Travis

Structural equation models are commonly used to capture the relationship between sets of observed and unobservable variables. Traditionally these models are fitted using frequentist approaches but recently researchers and practitioners have…

统计方法学 · 统计学 2023-02-22 Khue-Dung Dang , Luca Maestrini

The main computational challenge in Bayesian inference is to compute integrals against a high-dimensional posterior distribution. In the past decades, variational inference (VI) has emerged as a tractable approximation to these integrals,…

统计理论 · 数学 2024-01-09 Anya Katsevich , Philippe Rigollet

Variational inference (VI) is a popular approach in Bayesian inference, that looks for the best approximation of the posterior distribution within a parametric family, minimizing a loss that is typically the (reverse) Kullback-Leibler (KL)…

机器学习 · 统计学 2025-11-18 Marguerite Petit-Talamon , Marc Lambert , Anna Korba

Vector approximate message passing (VAMP) is an efficient approximate inference algorithm used for generalized linear models. Although VAMP exhibits excellent performance, particularly when measurement matrices are sampled from rotationally…

信息论 · 计算机科学 2025-08-05 Takashi Takahashi , Yoshiyuki Kabashima

In this paper, we address the problem of convergence of sequential variational inference filter (VIF) through the application of a robust variational objective and Hinf-norm based correction for a linear Gaussian system. As the dimension of…

机器学习 · 统计学 2022-04-28 Niladri Das , Jed A. Duersch , Thomas A. Catanach

Understanding how different classes are distributed in an unlabeled data set is an important challenge for the calibration of probabilistic classifiers and uncertainty quantification. Approaches like adjusted classify and count, black-box…

机器学习 · 统计学 2024-06-19 Albert Ziegler , Paweł Czyż

In this paper we present an algorithm for rapid Bayesian analysis that combines the benefits of nested sampling and artificial neural networks. The blind accelerated multimodal Bayesian inference (BAMBI) algorithm implements the MultiNest…

天体物理仪器与方法 · 物理学 2012-03-12 Philip Graff , Farhan Feroz , Michael P. Hobson , Anthony Lasenby

Modern deep learning models are over-parameterized, where different optima can result in widely varying generalization performance. The Sharpness-Aware Minimization (SAM) technique modifies the fundamental loss function that steers gradient…

A conventional Bayesian approach to prediction uses the posterior distribution to integrate out parameters in a density for unobserved data conditional on the observed data and parameters. When the true posterior is intractable, it is…

统计方法学 · 统计学 2026-02-27 Lucas Kock , Scott A. Sisson , G. S. Rodrigues , David J. Nott

Variational regression methods are an increasingly popular tool for their efficient estimation of complex. Given the mixed model representation of penalized effects, additive regression models with smoothed effects and scalar-on-function…

统计方法学 · 统计学 2024-06-13 Mark J. Meyer , Junyi Wei

Accurate calibration of stochastic agent-based models (ABMs) in epidemiology is crucial to make them useful in public health policy decisions and interventions. Traditional calibration methods, e.g., Markov Chain Monte Carlo (MCMC), that…

机器学习 · 统计学 2025-02-28 Connor Robertson , Cosmin Safta , Nicholson Collier , Jonathan Ozik , Jaideep Ray

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm for hidden Markov models, in a…

机器学习 · 统计学 2015-12-08 Pengyu Wang , Phil Blunsom

Variational inference (VI) is a widely used framework in Bayesian estimation. For most of the non-Gaussian statistical models, it is infeasible to find an analytically tractable solution to estimate the posterior distributions of the…

机器学习 · 统计学 2020-01-31 Zhanyu Ma , Jalil Taghia , Jun Guo