English
Related papers

Related papers: Automatic Laplace Collapsed Sampling: Scalable Mar…

200 papers

Approximate Bayesian inference for the class of latent Gaussian models can be achieved efficiently with integrated nested Laplace approximations (INLA). Based on recent reformulations in the INLA methodology, we propose a further extension…

Methodology · Statistics 2025-02-27 Shourya Dutta , Janet van Niekerk , Haavard Rue

Annealed importance sampling (AIS) and related algorithms are highly effective tools for marginal likelihood estimation, but are not fully differentiable due to the use of Metropolis-Hastings correction steps. Differentiability is a…

Machine Learning · Statistics 2021-10-28 Guodong Zhang , Kyle Hsu , Jianing Li , Chelsea Finn , Roger Grosse

We introduce a novel nonlinear model, Sparse Adaptive Bottleneck Centroid-Encoder (SABCE), for determining the features that discriminate between two or more classes. The algorithm aims to extract discriminatory features in groups while…

Machine Learning · Computer Science 2023-06-12 Tomojit Ghosh , Michael Kirby

Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods…

Methodology · Statistics 2023-11-28 Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

Bayesian optimisation is an adaptive sampling strategy for constructing a Gaussian process surrogate to efficiently search for the global minimum of a black-box computational model. Gaussian processes have limited applicability in…

Applications · Statistics 2025-12-04 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

The Adaptive Multilevel Splitting (AMS) algorithm is a powerful and versatile method for the simulation of rare events. It is based on an interacting (via a mutation-selection procedure) system of replicas, and depends on two integer…

Probability · Mathematics 2015-02-25 Charles-Edouard Bréhier

Bayesian inference tasks continue to pose a computational challenge. This especially holds for spatial-temporal modeling where high-dimensional latent parameter spaces are ubiquitous. The methodology of integrated nested Laplace…

Computation · Statistics 2023-03-28 Lisa Gaedke-Merzhäuser , Elias Krainski , Radim Janalik , Håvard Rue , Olaf Schenk

A new approach to inference in state space models is proposed, based on approximate Bayesian computation (ABC). ABC avoids evaluation of the likelihood function by matching observed summary statistics with statistics computed from data…

Statistics Theory · Mathematics 2014-10-01 Gael M. Martin , Brendan P. M. McCabe , Worapree Maneesoonthorn , Christian P. Robert

A new statistical technique for constructing linear latent structure (LLS) models from available data, supported by well established theoretical results and an efficient algorithm, is presented. The method reduces the problem of estimating…

Statistics Theory · Mathematics 2007-06-13 I. Akushevich , M. Kovtun , A. I. Yashin , K. G. Manton

Approximate Bayesian Computation (ABC) is a popular method for approximate inference in generative models with intractable but easy-to-sample likelihood. It constructs an approximate posterior distribution by finding parameters for which…

Computation · Statistics 2020-03-09 Kimia Nadjahi , Valentin De Bortoli , Alain Durmus , Roland Badeau , Umut Şimşekli

We show how to develop sampling-based alternating least squares (ALS) algorithms for decomposition of tensors into any tensor network (TN) format. Provided the TN format satisfies certain mild assumptions, resulting algorithms will have…

Numerical Analysis · Mathematics 2022-10-11 Osman Asif Malik , Vivek Bharadwaj , Riley Murray

The curse of dimensionality presents a pervasive challenge in optimization problems, with exponential expansion of the search space rapidly causing traditional algorithms to become inefficient or infeasible. An adaptive sampling strategy is…

Numerical Analysis · Mathematics 2025-11-18 Julian Soltes

Representing a sparse histogram, or more generally a sparse vector, is a fundamental task in differential privacy. An ideal solution would use space close to information-theoretical lower bounds, have an error distribution that depends…

Cryptography and Security · Computer Science 2021-09-28 Martin Aumüller , Christian Janos Lebeda , Rasmus Pagh

Due to its self-regularizing nature and its ability to quantify uncertainty, the Bayesian approach has achieved excellent recovery performance across a wide range of sparse signal recovery applications. However, most existing methods are…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Zonglong Bai , Liming Shi , Jinwei Sun , Mads Græsbøll Christensen

A new method for analyzing high-dimensional categorical data, Linear Latent Structure (LLS) analysis, is presented. LLS models belong to the family of latent structure models, which are mixture distribution models constrained to satisfy the…

Probability · Mathematics 2007-06-13 Mikhail Kovtun , Igor Akushevich , Kenneth G. Manton , H. Dennis Tolley

In this work, we present Enhanced Representation-Based Sampling (ERBS), a novel enhanced sampling method designed to generate structurally diverse training datasets for machine-learned interatomic potentials. ERBS automatically identifies…

Chemical Physics · Physics 2026-01-23 Moritz René Schäfer , Johannes Kästner

We consider Bayesian variable selection in sparse high-dimensional regression, where the number of covariates $p$ may be large relative to the samples size $n$, but at most a moderate number $q$ of covariates are active. Specifically, we…

Statistics Theory · Mathematics 2015-03-31 Rina Foygel Barber , Mathias Drton , Kean Ming Tan

Ensuring reliable confidence scores from deep neural networks is of paramount significance in critical decision-making systems, particularly in real-world domains such as healthcare. Recent literature on calibrating deep segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Balamurali Murugesan , Sukesh Adiga Vasudeva , Bingyuan Liu , Hervé Lombaert , Ismail Ben Ayed , Jose Dolz

The Bayesian Lasso is constructed in the linear regression framework and applies the Gibbs sampling to estimate the regression parameters. This paper develops a new sparse learning model, named the Bayesian Lasso Sparse (BLS) model, that…

Machine Learning · Statistics 2022-07-15 Ingvild M. Helgøy , Yushu Li

Likelihood-free inference for simulator-based statistical models has developed rapidly from its infancy to a useful tool for practitioners. However, models with more than a handful of parameters still generally remain a challenge for the…