English
Related papers

Related papers: Nonparametric Maximum Entropy Probability Density …

200 papers

Very often, in the course of uncertainty quantification tasks or data analysis, one has to deal with high-dimensional random variables (RVs). A high-dimensional RV can be described by its probability density (pdf) and/or by the…

Numerical Analysis · Mathematics 2022-09-09 Alexander Litvinenko , Youssef Marzouk , Hermann G. Matthies , Marco Scavino , Alessio Spantini

We study the problem of overcoming exponential sample complexity in differential entropy estimation under Gaussian convolutions. Specifically, we consider the estimation of the differential entropy $h(X+Z)$ via $n$ independently and…

Information Theory · Computer Science 2023-05-12 Kristjan Greenewald , Brian Kingsbury , Yuancheng Yu

Estimating the unknown density from which a given independent sample originates is more difficult than estimating the mean, in the sense that for the best popular non-parametric density estimators, the mean integrated square error converges…

Statistics Theory · Mathematics 2021-09-08 Pierre L'Ecuyer , Florian Puchhammer , Amal Ben Abdellah

Tuning of measurement models is challenging in real-world applications of sequential Monte Carlo methods. Recent advances in differentiable particle filters have led to various efforts to learn measurement models through neural networks.…

Artificial Intelligence · Computer Science 2022-03-17 Xiongjie Chen , Yunpeng Li

Multivariate extreme value statistical analysis is concerned with observations on several variables which are thought to possess some degree of tail-dependence. In areas such as the modeling of financial and insurance risks, or as the…

Applications · Statistics 2014-12-31 Alexis Bienvenüe , Christian Y. Robert

The density ratio of two probability distributions is one of the fundamental tools in mathematical and computational statistics and machine learning, and it has a variety of known applications. Therefore, density ratio estimation from…

Machine Learning · Statistics 2024-06-28 Masanari Kimura , Howard Bondell

Monte Carlo approximations for random linear elliptic PDE constrained optimization problems are studied. We use empirical process theory to obtain best possible mean convergence rates $O(n^{-\frac{1}{2}})$ for optimal values and solutions,…

Optimization and Control · Mathematics 2021-06-14 Werner Römisch , Thomas M. Surowiec

Without imposing prior distributional knowledge underlying multivariate time series of interest, we propose a nonparametric change-point detection approach to estimate the number of change points and their locations along the temporal axis.…

Methodology · Statistics 2021-05-13 Xiaodong Wang , Fushing Hsieh

A Bayesian nonparametric method for unimodal densities on the real line is provided by considering a class of species sampling mixture models containing random densities that are unimodal and not necessarily symmetric. This class of…

Statistics Theory · Mathematics 2007-06-13 Man-Wai Ho

A unified formulation of the density functional theory is constructed on the foundations of entropic inference in both the classical and the quantum regimes. The theory is introduced as an application of entropic inference for inhomogeneous…

Statistical Mechanics · Physics 2021-12-20 Ahmad Yousefi

We propose a novel method for estimating nonseparable selection models. We show that, for a given selection function, the potential outcome distributions are nonparametrically identified from the selected outcome distributions and can be…

Econometrics · Economics 2026-05-05 Fan Wu , Yi Xin

It is supposed that the exponential multiplier in the method of the non-equilibrium statistical operator (Zubarev`s approach) can be considered as a distribution density of the past lifetime of the system, and can be replaced by an…

Statistical Mechanics · Physics 2009-10-26 V. V. Ryazanov

This article addresses the different methods of estimation of the probability density function (PDF) and the cumulative distribution function (CDF) for the Lindley distribution. Following estimation methods are considered: uniformly minimum…

Applications · Statistics 2016-04-22 Sudhansu S. Maiti , Indrani Mukherjee

Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling…

Probability · Mathematics 2007-05-23 Andreas Eberle , Carlo Marinelli

This paper addresses a fundamental problem in random variate generation: given access to a random source that emits a stream of independent fair bits, what is the most accurate and entropy-efficient algorithm for sampling from a discrete…

Data Structures and Algorithms · Computer Science 2020-03-10 Feras A. Saad , Cameron E. Freer , Martin C. Rinard , Vikash K. Mansinghka

We consider a nonparametric Bayesian approach to estimation and testing for a multivariate monotone density. Instead of following the conventional Bayesian route of putting a prior distribution complying with the monotonicity restriction,…

Statistics Theory · Mathematics 2023-06-09 Kang Wang , Subhashis Ghosal

We study nonparametric maximum likelihood estimation of a log-concave probability density and its distribution and hazard function. Some general properties of these estimators are derived from two characterizations. It is shown that the…

Statistics Theory · Mathematics 2023-04-17 Lutz Duembgen , Kaspar Rufibach

The evolution of a quantum system, appropriate to describe nano-magnets, can be mapped on a Markov process, continuous in $\beta$. The mapping implies a probability assignment that can be used to study the probability density (PDF) of the…

Statistical Mechanics · Physics 2009-11-11 L. F. Lemmens , Burhan Bakar

For a collection of distributions over a countable support set, the worst case universal compression formulation by Shtarkov attempts to assign a universal distribution over the support set. The formulation aims to ensure that the universal…

Information Theory · Computer Science 2014-10-17 A. Orlitsky , N. Santhanam

The formula for probability density functions (PDFs) has been extended to include PDF for energy dissipation rates in addition to other PDFs such as for velocity fluctuations, velocity derivatives, fluid particle accelerations, energy…

Statistical Mechanics · Physics 2009-11-11 T. Arimitsu , N. Arimitsu