English
Related papers

Related papers: Scaling Nonparametric Bayesian Inference via Subsa…

200 papers

Our article deals with Bayesian inference for a general state space model with the simulated likelihood computed by the particle filter. We show empirically that the partially or fully adapted particle filters can be much more efficient…

Methodology · Statistics 2010-06-11 Michael Pitt , Ralph Silva , Paolo Giordani , Robert Kohn

A canonical approach to approximating the partition function of a Gibbs distribution via sampling is simulated annealing. This method has led to efficient reductions from counting to sampling, including: $\bullet$ classic non-adaptive…

Data Structures and Algorithms · Computer Science 2026-04-07 Hongyang Liu , Yitong Yin , Yiyao Zhang

Real-time nonlinear Bayesian filtering algorithms are overwhelmed by data volume, velocity and increasing complexity of computational models. In this paper, we propose a novel ensemble based nonlinear Bayesian filtering approach which only…

Computation · Statistics 2019-06-05 Xiao Lin , Gabriel Terejanu

One of the fundamental tasks of science is to find explainable relationships between observed phenomena. One approach to this task that has received attention in recent years is based on probabilistic graphical modelling with sparsity…

Machine Learning · Statistics 2014-04-16 Peter Orchard , Felix Agakov , Amos Storkey

Deep models are designed to operate on huge volumes of high dimensional data such as images. In order to reduce the volume of data these models must process, we propose a set-based two-stage end-to-end neural subsampling model that is…

Machine Learning · Computer Science 2022-05-31 Bruno Andreis , Seanie Lee , A. Tuan Nguyen , Juho Lee , Eunho Yang , Sung Ju Hwang

Sensitivity analyses reveal the influence of various modeling choices on the outcomes of statistical analyses. While theoretically appealing, they are overwhelmingly inefficient for complex Bayesian models. In this work, we propose…

We present the details of the numerical realization of the recently advanced algorithm developed to identify the fragmentation in heavy ion reactions. This new algorithm is based on the Simulated Annealing method and is dubbed as Simulated…

Nuclear Theory · Physics 2009-10-31 Rajeev K. Puri , Joerg Aichelin

Current statistics literature on statistical inference of random fields typically assumes that the fields are stationary or focuses on models of non-stationary Gaussian fields with parametric/semiparametric covariance families, which may…

Statistics Theory · Mathematics 2024-09-04 Yunyi Zhang , Zhou Zhou

Variational Bayesian inference and (collapsed) Gibbs sampling are the two important classes of inference algorithms for Bayesian networks. Both have their advantages and disadvantages: collapsed Gibbs sampling is unbiased but is also…

Machine Learning · Computer Science 2012-06-18 Max Welling , Yee Whye Teh , Hilbert Kappen

Scaling inference compute in large language models (LLMs) through repeated sampling consistently increases the coverage (fraction of problems solved) as the number of samples increases. We conjecture that this observed improvement is…

Computation and Language · Computer Science 2024-10-22 Gal Yona , Or Honovich , Omer Levy , Roee Aharoni

We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the…

Machine Learning · Statistics 2017-12-22 Christian Donner , Manfred Opper

In semi-supervised learning, the prevailing understanding suggests that observing additional unlabeled samples improves estimation accuracy for linear parameters only in the case of model misspecification. In this work, we challenge such a…

Methodology · Statistics 2025-09-03 Kai Chen , Yuqian Zhang

This work aims to improve the sample efficiency of parallel large-scale ranking and selection (R&S) problems by leveraging correlation information. We modify the commonly used "divide and conquer" framework in parallel computing by adding a…

Methodology · Statistics 2026-02-16 Zishi Zhang , Yijie Peng

In population studies, it is standard to sample data via designs in which the population is divided into strata, with the different strata assigned different probabilities of inclusion. Although there have been some proposals for including…

Methodology · Statistics 2014-09-29 T. Kunihama , A. H. Herring , C. T. Halpern , D. B. Dunson

Bayesian Generalized Nonlinear Models (BGNLM) offer a flexible nonlinear alternative to GLM while still providing better interpretability than machine learning techniques such as neural networks. In BGNLM, the methods of Bayesian Variable…

Computation · Statistics 2023-12-29 Jon Lachmann , Aliaksandr Hubin

Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods…

Methodology · Statistics 2023-11-28 Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

Multi-task learning leverages shared information among data sets to improve the learning performance of individual tasks. The paper applies this framework for data where each task is a phase-shifted periodic time series. In particular, we…

Machine Learning · Computer Science 2015-03-20 Yuyang Wang , Roni Khardon , Pavlos Protopapas

We introduce a new family of MCMC samplers that combine auxiliary variables, Gibbs sampling and Taylor expansions of the target density. Our approach permits the marginalisation over the auxiliary variables yielding marginal samplers, or…

Machine Learning · Statistics 2018-01-26 Michalis K. Titsias , Omiros Papaspiliopoulos

Energy-Based Models (EBMs) offer a versatile framework for modeling complex data distributions. However, training and sampling from EBMs continue to pose significant challenges. The widely-used Denoising Score Matching (DSM) method for…

Machine Learning · Statistics 2024-03-20 Mingtian Zhang , Alex Hawkins-Hooker , Brooks Paige , David Barber

Nonstationary non-Gaussian spatial data are common in many disciplines, including climate science, ecology, epidemiology, and social sciences. Examples include count data on disease incidence and binary satellite data on cloud mask…

Computation · Statistics 2020-11-30 Benjamin Seiyon Lee , Jaewoo Park