English
Related papers

Related papers: Scalable simulation-based inference for implicitly…

200 papers

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

We consider high-dimensional inference for potentially misspecified Cox proportional hazard models based on low dimensional results by Lin and Wei [1989]. A de-sparsified Lasso estimator is proposed based on the log partial likelihood…

Statistics Theory · Mathematics 2018-11-02 Shengchun Kong , Zhuqing Yu , Xianyang Zhang , Guang Cheng

For many stochastic models of interest in systems biology, such as those describing biochemical reaction networks, exact quantification of parameter uncertainty through statistical inference is intractable. Likelihood-free computational…

Molecular Networks · Quantitative Biology 2021-05-10 David J. Warne , Ruth E. Baker , Matthew J. Simpson

We consider the problem of setting confidence intervals on a parameter of interest from the maximum-likelihood fit of a physics model to a binned data set with a large number of bins, large event-counts per bin, and in the presence of…

Data Analysis, Statistics and Probability · Physics 2026-02-09 Cristina-Andreea Alexe , Joshua Bendavid , Lorenzo Bianchini , Davide Bruschini

We consider the problem of static Bayesian inference for partially observed Levy-process models. We develop a methodology which allows one to infer static parameters and some states of the process, without a bias from the…

Computation · Statistics 2022-04-01 Hamza Ruzayqat , Ajay Jasra

We develop a generally applicable full-information inference method for heterogeneous agent models, combining aggregate time series data and repeated cross sections of micro data. To handle unobserved aggregate state variables that affect…

Econometrics · Economics 2024-11-19 Laura Liu , Mikkel Plagborg-Møller

Accurate statistical inference in logistic regression models remains a critical challenge when the ratio between the number of parameters and sample size is not negligible. This is because approximations based on either classical asymptotic…

Methodology · Statistics 2022-08-19 Qian Zhao , Emmanuel J. Candes

Simulation-based inference (SBI) methods such as approximate Bayesian computation (ABC), synthetic likelihood, and neural posterior estimation (NPE) rely on simulating statistics to infer parameters of intractable likelihood models.…

Machine Learning · Statistics 2023-10-06 Daolang Huang , Ayush Bharti , Amauri Souza , Luigi Acerbi , Samuel Kaski

We propose a Monte Carlo algorithm to sample from high dimensional probability distributions that combines Markov chain Monte Carlo and importance sampling. We provide a careful theoretical analysis, including guarantees on robustness to…

Computation · Statistics 2019-09-18 Giacomo Zanella , Gareth Roberts

Markov Chain Monte Carlo (MCMC) requires to evaluate the full data likelihood at different parameter values iteratively and is often computationally infeasible for large data sets. In this paper, we propose to approximate the log-likelihood…

Methodology · Statistics 2020-05-26 Guanyu Hu , HaiYing Wang

Intractable generative models are models for which the likelihood is unavailable but sampling is possible. Most approaches to parameter inference in this setting require the computation of some discrepancy between the data and the…

Computation · Statistics 2022-07-05 Ziang Niu , Johanna Meier , François-Xavier Briol

The accuracy and precision of high-energy spallation models are key issues for the design and development of new applications and experiments. We present a method to estimate model parameters and associated uncertainties by leveraging the…

High Energy Physics - Phenomenology · Physics 2024-06-28 Jason Hirtz , Jean-Christophe David , Joseph Cugnon , Ingo Leya , José Luís Rodríguez-Sánchez , Georg Schnabel

Markov chain Monte Carlo (MCMC) methods provide powerful framework for sampling unknown probability measures across a wide range of scientific applications. In some settings, the target distribution is supported on a lower-dimensional…

Numerical Analysis · Mathematics 2026-04-27 Xuyuan Wang , Donglin Han

In many statistical problems, the data distribution is specified through a generative process for which the likelihood function is analytically intractable, yet inference on the associated model parameters remains of primary interest. We…

Methodology · Statistics 2026-04-01 Haoyu Jiang , Yuexi Wang , Yun Yang

We propose a multilevel Markov chain Monte Carlo (MCMC) method for the Bayesian inference of random field parameters in PDEs using high-resolution data. Compared to existing multilevel MCMC methods, we additionally consider level-dependent…

Numerical Analysis · Mathematics 2025-08-19 Pieter Vanmechelen , Geert Lombaert , Giovanni Samaey

Large language models (LLMs) have achieved significant performance gains via scaling up model sizes and/or data. However, recent evidence suggests diminishing returns from such approaches, motivating scaling the computation spent at…

Machine Learning · Computer Science 2025-08-15 Isha Puri , Shivchander Sudalairaj , Guangxuan Xu , Kai Xu , Akash Srivastava

Computing the variance of a conditional expectation has often been of importance in uncertainty quantification. Sun et al. has introduced an unbiased nested Monte Carlo estimator, which they call $1\frac{1}{2}$-level simulation since the…

Computation · Statistics 2019-12-09 Takashi Goda

Marginal-likelihood based model-selection, even though promising, is rarely used in deep learning due to estimation difficulties. Instead, most approaches rely on validation data, which may not be readily available. In this work, we present…

Machine Learning · Statistics 2021-06-16 Alexander Immer , Matthias Bauer , Vincent Fortuin , Gunnar Rätsch , Mohammad Emtiyaz Khan

This paper introduces a straightforward sieve-based approach for estimating and conducting inference on regression parameters in panel data models with interactive fixed effects. The method's key assumption is that factor loadings can be…

Econometrics · Economics 2025-02-26 Georg Keilbar , Juan M. Rodriguez-Poo , Alexandra Soberon , Weining Wang

We propose a novel estimation framework for path-dependent functionals of Levy processes from discretely observed data. Traditional approaches rely on Monte Carlo simulation of full paths, which requires complete model specification and…

Methodology · Statistics 2025-09-03 Yasutaka Shimizu , Hiroshi Shiraishi