English
Related papers

Related papers: Estimating Normalizing Constants for Log-Concave D…

200 papers

We study a sampling problem whose target distribution is $\pi \propto \exp(-f-r)$ where the data fidelity term $f$ is Lipschitz smooth while the regularizer term $r=r_1-r_2$ is a non-smooth difference-of-convex (DC) function, i.e.,…

Machine Learning · Computer Science 2026-05-21 Hoang Phuc Hau Luu , Zhongjian Wang

Models with intractable normalizing functions have numerous applications. Because the normalizing constants are functions of the parameters of interest, standard Markov chain Monte Carlo cannot be used for Bayesian inference for these…

Methodology · Statistics 2024-03-21 Bokgyeong Kang , John Hughes , Murali Haran

Doubly intractable distributions arise in many settings, for example in Markov models for point processes and exponential random graph models for networks. Bayesian inference for these models is challenging because they involve intractable…

Computation · Statistics 2019-04-03 Jaewoo Park , Murali Haran

The Conway-Maxwell-Poisson distribution is a two-parameter generalisation of the Poisson distribution that can be used to model data that is under- or over-dispersed relative to the Poisson distribution. The normalizing constant…

Statistics Theory · Mathematics 2019-04-05 Robert E. Gaunt , Satish Iyengar , Adri B. Olde Daalhuis , Burcin Simsek

Normalizing flows are a popular class of models for approximating probability distributions. However, their invertible nature limits their ability to model target distributions whose support have a complex topological structure, such as…

Machine Learning · Statistics 2022-02-25 Vincent Stimper , Bernhard Schölkopf , José Miguel Hernández-Lobato

We consider the problem of finding the minimizer of a convex function $F: \mathbb R^d \rightarrow \mathbb R$ of the form $F(w) := \sum_{i=1}^n f_i(w) + R(w)$ where a low-rank factorization of $\nabla^2 f_i(w)$ is readily available. We…

Optimization and Control · Mathematics 2016-07-07 Peng Xu , Jiyan Yang , Farbod Roosta-Khorasani , Christopher Ré , Michael W. Mahoney

We apply extensive Monte Carlo simulations to study the probability distribution $P(m)$ of the order parameter $m$ for the simple cubic Ising model with periodic boundary condition at the transition point. Sampling is performed with the…

Computational Physics · Physics 2020-03-18 Jiahao Xu , Alan M. Ferrenberg , David P. Landau

This paper deals with some computational aspects in the Bayesian analysis of statistical models with intractable normalizing constants. In the presence of intractable normalizing constants in the likelihood function, traditional MCMC…

Computation · Statistics 2008-04-22 Yves Atchade , Nicolas Lartillot , Christian P. Robert

With a graph $G=(V,E)$ we associate a collection of non-negative real weights $\cup_{v\in V}{\lambda_{i,v}:1\leq i \leq m} \cup \cup_{uv \in E} {\lambda_{ij,uv}:1\leq i \leq j \leq m}$. We consider the probability distribution on…

Combinatorics · Mathematics 2012-06-15 David Galvin

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric…

Computation · Statistics 2020-06-02 Valentin De Bortoli , Alain Durmus , Marcelo Pereyra , Ana F. Vidal

We present a new method for minimizing the sum of a differentiable convex function and an $\ell_1$-norm regularizer. The main features of the new method include: $(i)$ an evolving set of indices corresponding to variables that are predicted…

Optimization and Control · Mathematics 2016-02-24 Tianyi Chen , Frank E. Curtis , Daniel P. Robinson

We develop approximate estimation methods for exponential random graph models (ERGMs), whose likelihood is proportional to an intractable normalizing constant. The usual approach approximates this constant with Monte Carlo simulations,…

Methodology · Statistics 2023-01-11 Angelo Mele , Lingjiong Zhu

A central problem in computational statistics is to convert a procedure for sampling combinatorial from an objects into a procedure for counting those objects, and vice versa. Weconsider sampling problems coming from *Gibbs distributions*,…

Probability · Mathematics 2023-08-21 David G. Harris , Vladimir Kolmogorov

The contribution of this work is the introduction of a multivariate circular-linear (or poly- cylindrical) distribution obtained by combining the projected and the skew-normal. We show the flexibility of our proposal, its property of…

Methodology · Statistics 2017-11-29 Gianluca Mastrantonio

Posterior distributions often feature intractable normalizing constants, called marginal likelihoods or evidence, that are useful for model comparison via Bayes factors. This has motivated a number of methods for estimating ratios of…

Computation · Statistics 2018-10-03 Maxime Rischard , Pierre E. Jacob , Natesh Pillai

Equality-constrained models naturally arise in problems in which measurements are taken at different levels of resolution. The challenge in this setting is that the models usually induce a joint distribution which is intractable. Resorting…

Computation · Statistics 2025-04-28 Shenggang Hu , Hongsheng Dai , Fanlin Meng , Louis Aslett , Murray Pollock , Gareth O. Roberts

We analyze a recently proposed class of algorithms for the problem of sampling from probability distributions $\mu^\ast$ in $\mathbb{R}^d$ with a Lebesgue density of the form $\mu^\ast(x) \propto \exp(-f(Kx)-g(x))$, where $K$ is a linear…

Optimization and Control · Mathematics 2024-11-06 Martin Burger , Matthias J. Ehrhardt , Lorenz Kuger , Lukas Weigand

This paper considers stochastic first-order algorithms for convex-concave minimax problems of the form $\min_{\bf x}\max_{\bf y}f(\bf x, \bf y)$, where $f$ can be presented by the average of $n$ individual components which are $L$-average…

Optimization and Control · Mathematics 2022-02-01 Luo Luo , Guangzeng Xie , Tong Zhang , Zhihua Zhang

In this article, we consider the problem of sampling from a probability measure $\pi$ having a density on $\mathbb{R}^d$ known up to a normalizing constant, $x\mapsto \mathrm{e}^{-U(x)} / \int_{\mathbb{R}^d} \mathrm{e}^{-U(y)} \mathrm{d}…

Methodology · Statistics 2018-11-27 Nicolas Brosse , Alain Durmus , Éric Moulines , Sotirios Sabanis