English
Related papers

Related papers: Algorithms for Models with Intractable Normalizing…

200 papers

Can regularization terms in the training of invertible neural networks lead to known Bayesian point estimators in reconstruction? Invertible networks are attractive for inverse problems due to their inherent stability and interpretability.…

Machine Learning · Computer Science 2025-10-31 Nick Heilenkötter

In this work we deal with parametric inverse problems, which consist in recovering a finite number of parameters describing the structure of an unknown object, from indirect measurements. State-of-the-art methods for approximating a…

Numerical Analysis · Mathematics 2021-12-22 Paolo Massa , Sara Garbarino , Federico Benvenuto

Models for which the likelihood function can be evaluated only up to a parameter-dependent unknown normalising constant, such as Markov random field models, are used widely in computer science, statistical physics, spatial statistics, and…

Computation · Statistics 2016-02-12 Richard G. Everitt , Adam M. Johansen , Ellen Rowing , Melina Evdemon-Hogan

The analytical continuation of correlation functions from imaginary to real time is a crucial step in lattice gauge theories, and it challenges our ability to derive non-perturbative predictions from lattice simulations. We review aspects…

High Energy Physics - Lattice · Physics 2024-10-15 Luigi Del Debbio , Alessandro Lupo , Marco Panero , Nazario Tantalo

State estimation or filtering serves as a fundamental task to enable intelligent decision-making in applications such as autonomous vehicles, robotics, healthcare monitoring, smart grids, intelligent transportation, and predictive…

Machine Learning · Computer Science 2025-06-16 Aamir Hussain Chughtai

We provide a general theory of the expectation-maximization (EM) algorithm for inferring high dimensional latent variable models. In particular, we make two contributions: (i) For parameter estimation, we propose a novel high dimensional EM…

Machine Learning · Statistics 2015-01-28 Zhaoran Wang , Quanquan Gu , Yang Ning , Han Liu

For many optimization problems in machine learning, finding an optimal solution is computationally intractable and we seek algorithms that perform well in practice. Since computational intractability often results from pathological…

Machine Learning · Computer Science 2021-02-25 Eric Balkanski , Sharon Qian , Yaron Singer

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

The traditional approach of hand-crafting priors (such as sparsity) for solving inverse problems is slowly being replaced by the use of richer learned priors (such as those modeled by deep generative networks). In this work, we study the…

Machine Learning · Computer Science 2021-05-14 Viraj Shah , Rakib Hyder , M. Salman Asif , Chinmay Hegde

We derive a parallel sampling algorithm for computational inverse problems that present an unknown linear forcing term and a vector of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of…

Numerical Analysis · Mathematics 2022-03-24 Darko Volkov

We present a framework for the efficient computation of optimal Bayesian decisions under intractable likelihoods, by learning a surrogate model for the expected utility (or its distribution) as a function of the action and data spaces. We…

Machine Learning · Statistics 2023-11-13 Justin Alsing , Thomas D. P. Edwards , Benjamin Wandelt

Model fitting is possibly the most extended problem in science. Classical approaches include the use of least-squares fitting procedures and maximum likelihood methods to estimate the value of the parameters in the model. However, in recent…

Instrumentation and Methods for Astrophysics · Physics 2022-04-12 J. Lopez-Santiago , L. Martino , J. Miguez , M. A. Vazquez

We study the Inexact Restoration framework with random models for minimizing functions whose evaluation is subject to errors. We propose a constrained formulation that includes well-known stochastic problems and an algorithm applicable when…

Optimization and Control · Mathematics 2026-02-24 Benedetta Morini , Simone Rebegoldi

The EM algorithm is a powerful tool for maximum likelihood estimation with missing data. In practice, the calculations required for the EM algorithm are often intractable. We review numerous methods to circumvent this intractability, all of…

Computation · Statistics 2024-01-03 William Ruth

Latent space models have been widely adopted in modeling network data. Developing statistical inference for estimated model parameters enables quantifying associated uncertainty and is pivotal for downstream tasks. Despite recent progress…

Statistics Theory · Mathematics 2026-05-12 Yuang Tian , Jiajin Sun , Yinqiu He

The network inference problem arises in biological research when one needs to quantitatively choose the best protein-interaction model for explaining a phenotype. The diverse nature of the data and nonlinear dynamics pose significant…

Molecular Networks · Quantitative Biology 2025-12-22 Guy Karlebach

Topic models are Bayesian models that are frequently used to capture the latent structure of certain corpora of documents or images. Each data element in such a corpus (for instance each item in a collection of scientific articles) is…

Machine Learning · Statistics 2018-02-05 Behrooz Ghorbani , Hamid Javadi , Andrea Montanari

Integrative modeling of macromolecular assemblies allows for structural characterization of large assemblies that are recalcitrant to direct experimental observation. A Bayesian inference approach facilitates combining data from…

Biomolecules · Quantitative Biology 2026-01-13 Shreyas Arvindekar , Kartik Majila , Shruthi Viswanath

Advanced inference techniques allow one to reconstruct the pattern of interaction from high dimensional data sets. We focus here on the statistical properties of inferred models and argue that inference procedures are likely to yield models…

Data Analysis, Statistics and Probability · Physics 2013-10-09 Iacopo Mastromatteo , Matteo Marsili

We consider the task of performing probabilistic inference with probabilistic logical models. Many algorithms for approximate inference with such models are based on sampling. From a logic programming perspective, sampling boils down to…

Artificial Intelligence · Computer Science 2015-03-19 Daan Fierens