English
Related papers

Related papers: Scalable Maximum Entropy Population Synthesis via …

200 papers

A common statistical situation concerns inferring an unknown distribution Q(x) from a known distribution P(y), where X (dimension n), and Y (dimension m) have a known functional relationship. Most commonly, n<m, and the task is relatively…

Quantitative Methods · Quantitative Biology 2016-02-01 Jayajit Das , Sayak Mukherjee , Susan E. Hodge

We introduce a novel Entropy-driven Monte Carlo (EdMC) strategy to efficiently sample solutions of random Constraint Satisfaction Problems (CSPs). First, we extend a recent result that, using a large-deviation analysis, shows that the…

Disordered Systems and Neural Networks · Physics 2016-02-26 Carlo Baldassi , Alessandro Ingrosso , Carlo Lucibello , Luca Saglietti , Riccardo Zecchina

In most data-scientific approaches, the principle of Maximum Entropy (MaxEnt) is used to a posteriori justify some parametric model which has been already chosen based on experience, prior knowledge or computational simplicity. In a…

Methodology · Statistics 2022-06-29 Orestis Loukas , Ho Ryun Chung

Data-driven modelling and computational predictions based on maximum entropy principle (MaxEnt-principle) aim at finding as-simple-as-possible - but not simpler then necessary - models that allow to avoid the data overfitting problem. We…

Computation · Statistics 2020-11-25 Horenko Illia , Marchenko Ganna , Gagliardini Patrick

Maximum entropy (MAXENT) method has a large number of applications in theoretical and applied machine learning, since it provides a convenient non-parametric tool for estimating unknown probabilities. The method is a major contribution of…

Data Analysis, Statistics and Probability · Physics 2020-12-18 A. E. Allahverdyan , N. H. Martirosyan

Household and individual-level sociodemographic data are essential for understanding human-infrastructure interaction and policymaking. However, the Public Use Microdata Sample (PUMS) offers only a sample at the state level, while census…

Machine Learning · Computer Science 2024-07-03 Xiao Qian , Utkarsh Gangwal , Shangjia Dong , Rachel Davidson

The principle of maximum entropy (Maxent) is often used to obtain prior probability distributions as a method to obtain a Gibbs measure under some restriction giving the probability that a system will be in a certain state compared to the…

Information Theory · Computer Science 2019-06-26 Hector Zenil , Narsis A. Kiani , Jesper Tegnér

By formulating the inverse problem of partial differential equations (PDEs) as a statistical inference problem, the Bayesian approach provides a general framework for quantifying uncertainties. In the inverse problem of PDEs, parameters are…

Numerical Analysis · Mathematics 2026-02-10 Haoyu Lu , Junxiong Jia , Deyu Meng

Sequential Monte Carlo (SMC) algorithms were originally designed for estimating intractable conditional expectations within state-space models, but are now routinely used to generate approximate samples in the context of general-purpose…

Statistics Theory · Mathematics 2020-05-11 Jonathan H. Huggins , Daniel M. Roy

Recent years have seen the rise of convolutional neural network techniques in exemplar-based image synthesis. These methods often rely on the minimization of some variational formulation on the image space for which the minimizers are…

Statistics Theory · Mathematics 2019-12-05 Valentin De Bortoli , Agnes Desolneux , Alain Durmus , Bruno Galerne , Arthur Leclaire

Realistic models of biological processes typically involve interacting components on multiple scales, driven by changing environment and inherent stochasticity. Such models are often analytically and numerically intractable. We revisit a…

Populations and Evolution · Quantitative Biology 2022-01-19 K. Bodova , E. Szep , N. H. Barton

Semi-continuous data comes from a distribution that is a mixture of the point mass at zero and a continuous distribution with support on the positive real line. A clear example is the daily rainfall data. In this paper, we present a novel…

Methodology · Statistics 2021-06-17 Sai K. Popuri , Nagaraj K. Neerchal , Amita Mehta , Ahmad Mousavi

A well-known result across information theory, machine learning, and statistical physics shows that the maximum entropy distribution under a mean constraint has an exponential form called the Gibbs-Boltzmann distribution. This is used for…

Machine Learning · Computer Science 2020-06-26 Amir R. Asadi , Emmanuel Abbe

Mixture models are an expressive hypothesis class that can approximate a rich set of policies. However, using mixture policies in the Maximum Entropy (MaxEnt) framework is not straightforward. The entropy of a mixture model is not equal to…

Machine Learning · Computer Science 2021-03-19 Nir Baram , Guy Tennenholtz , Shie Mannor

Inferring the input parameters of simulators from observations is a crucial challenge with applications from epidemiology to molecular dynamics. Here we show a simple approach in the regime of sparse data and approximately correct models,…

Methodology · Statistics 2022-04-06 Rainier Barrett , Mehrad Ansari , Gourab Ghoshal , Andrew D White

The constrained generalized maximum-entropy sampling problem (CGMESP) is to select an order-s principal submatrix from an order-n covariance matrix, subject to some linear side constraints, so as to maximize the product of its t greatest…

Optimization and Control · Mathematics 2026-05-06 Gabriel Ponte , Kurt Anstreicher , Marcia Fampa , Jon Lee

A maximum entropy-based framework is presented for the synthesis of projections from multiple Earth climate models. This identifies the most representative (most probable) model from a set of climate models -- as defined by specified…

Geophysics · Physics 2017-08-23 Robert K. Niven

The traditional maximum likelihood estimator (MLE) is often of limited use in complex high-dimensional data due to the intractability of the underlying likelihood function. Maximum composite likelihood estimation (McLE) avoids full…

Methodology · Statistics 2015-02-18 Davide Ferrari , Guoqi Qian

An energy efficient use of large scale sensor networks necessitates activating a subset of possible sensors for estimation at a fusion center. The problem is inherently combinatorial; to this end, a set of iterative, randomized algorithms…

Information Theory · Computer Science 2017-09-13 Arpan Chattopadhyay , Urbashi Mitra

We investigate the stability of a Sequential Monte Carlo (SMC) method applied to the problem of sampling from a target distribution on $\mathbb{R}^d$ for large $d$. It is well known that using a single importance sampling step one produces…

Computation · Statistics 2012-04-19 Alexandros Beskos , Dan Crisan , Ajay Jasra