English
Related papers

Related papers: Massive optimal data compression and density estim…

200 papers

Composite likelihood provides approximate inference when the full likelihood is intractable and sub-likelihood functions of marginal events can be evaluated relatively easily. It has been successfully applied for many complex models.…

Methodology · Statistics 2024-09-05 Wentao Li , Rosabeth White , Dennis Prangle

Models of stochastic processes are widely used in almost all fields of science. Theory validation, parameter estimation, and prediction all require model calibration and statistical inference using data. However, data are almost always…

Computation · Statistics 2022-09-07 David J. Warne , Thomas P. Prescott , Ruth E. Baker , Matthew J. Simpson

Statistical models are often defined by a generative process for simulating synthetic data, but this can lead to intractable likelihoods. Likelihood free inference (LFI) methods enable Bayesian inference to be performed in this case.…

Methodology · Statistics 2025-06-05 David Chen , Xinwei Li , Eui-Jin Kim , Prateek Bansal , David Nott

In previous works, we proposed to estimate cosmological parameters with the artificial neural network (ANN) and the mixture density network (MDN). In this work, we propose an improved method called the mixture neural network (MNN) to…

Cosmology and Nongalactic Astrophysics · Physics 2023-08-23 Guo-Jian Wang , Cheng Cheng , Yin-Zhe Ma , Jun-Qing Xia , Amare Abebe , Aroonkumar Beesham

Standard cosmological analysis, which relies on two-point statistics, fails to extract the full information of the data. This limits our ability to constrain with precision cosmological parameters. Thus, recent years have seen a paradigm…

I consider two problems in machine learning and statistics: the problem of estimating the joint probability density of a collection of random variables, known as density estimation, and the problem of inferring model parameters when their…

Machine Learning · Statistics 2019-10-30 George Papamakarios

A computationally simple approach to inference in state space models is proposed, using approximate Bayesian computation (ABC). ABC avoids evaluation of an intractable likelihood by matching summary statistics for the observed data with…

Likelihood-free inference involves inferring parameter values given observed data and a simulator model. The simulator is computer code which takes parameters, performs stochastic calculations, and outputs simulated data. In this work, we…

Computation · Statistics 2023-01-30 Dennis Prangle , Cecilia Viscardi

We explore linear and non-linear dimensionality reduction techniques for statistical inference of parameters in cosmology. Given the importance of compressing the increasingly complex data vectors used in cosmology, we address questions…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-12 Minsu Park , Marco Gatti , Bhuvnesh Jain

Tree-based priors for probability distributions are usually specified using a predetermined, data-independent collection of candidate recursive partitions of the sample space. To characterize an unknown target density in detail over the…

Methodology · Statistics 2025-04-14 Li Ma , Benedetta Bruni

Data assimilation will be essential for the management and expansion of geological carbon storage operations. In traditional data assimilation approaches a fixed set of geological hyperparameters, such as mean and standard deviation of…

Machine Learning · Computer Science 2025-02-18 Wenchao Teng , Louis J. Durlofsky

We present a method to transform multivariate unimodal non-Gaussian posterior probability densities into approximately Gaussian ones via non-linear mappings, such as Box--Cox transformations and generalisations thereof. This permits an…

Cosmology and Nongalactic Astrophysics · Physics 2016-06-14 Robert L. Schuhmann , Benjamin Joachimi , Hiranya V. Peiris

Most parameter constraints obtained from cosmic microwave background (CMB) anisotropy data are based on power estimates and rely on approximate likelihood functions; computational difficulties generally preclude an exact analysis based on…

Astrophysics · Physics 2009-11-06 M. Douspis , J. G. Bartlett , A. Blanchard , M. Le Dour

Future large scale cosmological surveys will provide huge data sets whose analysis requires efficient data compression. Calculating accurate covariances is extremely challenging with increasing number of statistics used. Here we introduce a…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-03 Marika Asgari , Peter Schneider

Computational capability often falls short when confronted with massive data, posing a common challenge in establishing a statistical model or statistical inference method dealing with big data. While subsampling techniques have been…

Methodology · Statistics 2024-10-31 Yixiao Ruan , Zan Li , Zhaohui Li , Dennis K. J. Lin , Qingpei Hu , Dan Yu

In likelihood-free settings where likelihood evaluations are intractable, approximate Bayesian computation (ABC) addresses the formidable inference task to discover plausible parameters of simulation programs that explain the observations.…

Machine Learning · Statistics 2019-03-05 Kelvin Hsu , Fabio Ramos

Bayesian inference is a principled framework for dealing with uncertainty. The practitioner can perform an initial assumption for the physical phenomenon they want to model (prior belief), collect some data and then adjust the initial…

Machine Learning · Computer Science 2020-11-10 Vasileios Gkolemis , Michael Gutmann

Parametric statistical models that are implicitly defined in terms of a stochastic data generating process are used in a wide range of scientific disciplines because they enable accurate modeling. However, learning the parameters from…

Machine Learning · Statistics 2018-10-24 Traiko Dinev , Michael U. Gutmann

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

Methodology · Statistics 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang

Learning-based lossless image compression employs pixel-based or subimage-based auto-regression for probability estimation, which achieves desirable performances. However, the existing works only consider context dependencies in one…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Tiantian Li , Qunbing Xia , Yue Li , Ruixiao Guo , Gaobo Yang