English
Related papers

Related papers: A Likelihood Ratio Approach for Probabilistic Ineq…

200 papers

We consider the stochastic integrals of multivariate point processes and study their concentration phenomena. In particular, we obtain a Bernstein type of concentration inequality through Dol\'eans-Dade exponential formula and a uniform…

Probability · Mathematics 2017-03-24 Hanchao Wang , Zhengyan Lin , Zhonggen Su

The behavior of maximum likelihood estimates (MLEs) and the likelihood ratio statistic in a family of problems involving pointwise nonparametric estimation of a monotone function is studied. This class of problems differs radically from the…

Statistics Theory · Mathematics 2009-09-29 Moulinath Banerjee

In this work, we present a method to generate probability distributions and classes of probability distributions, which broadens a process of probability distribution construction. In this method, distribution classes are built from…

Statistics Theory · Mathematics 2021-08-16 Cícero Carlos Ramos de Brito , Leandro Chaves Rêgo , Wilson Rosa de Oliveira

A composite likelihood is an inference function derived by multiplying a set of likelihood components. This approach provides a flexible framework for drawing inference when the likelihood function of a statistical model is computationally…

Methodology · Statistics 2024-12-10 Giuseppe Alfonzetti , Ruggero Bellio , Yunxiao Chen , Irini Moustaki

Floating-point round-off errors are ubiquitous in numerically intensive programs arising in fields such as scientific computing and optimization. As floating-point errors potentially lead to unexpected and catastrophic program failures, one…

Logic in Computer Science · Computer Science 2026-05-07 Yichen Tao , Hongfei Fu , Jiawei Chen , Jean-Baptiste Jeannin

Approximating integrals is a fundamental task in probability theory and statistical inference, and their applied fields of signal processing, and Bayesian learning, as soon as expectations over probability distributions must be computed…

Statistics Theory · Mathematics 2026-05-06 Solal Martin , Emilie Chouzenoux , Victor Elvira

In this note, we consider the performance of the classic method of moments for parameter estimation of symmetric variance-gamma (generalized Laplace) distributions. We do this through both theoretical analysis (multivariate delta method)…

Methodology · Statistics 2023-11-21 Adrian Fischer , Robert E. Gaunt , Andrey Sarantsev

We introduce a new version of Stein's method that reduces a large class of normal approximation problems to variance bounding exercises, thus making a connection between central limit theorems and concentration of measure. Unlike Skorokhod…

Probability · Mathematics 2009-09-29 Sourav Chatterjee

We consider trawl processes, which are stationary and infinitely divisible stochastic processes and can describe a wide range of statistical properties, such as heavy tails and long memory. In this paper, we develop the first…

Methodology · Statistics 2023-08-31 Dan Leonte , Almut E. D. Veraart

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho

The likelihood function plays a pivotal role in statistical inference; it is adaptable to a wide range of models and the resultant estimators are known to have good properties. However, these results hinge on correct specification of the…

Statistics Theory · Mathematics 2017-12-15 Adam Jaeger , Nicole Lazar

We introduce estimation and test procedures through divergence optimization for discrete or continuous parametric models. This approach is based on a new dual representation for divergences. We treat point estimation and tests for simple…

Statistics Theory · Mathematics 2008-12-02 Michel Broniatowski , Amor Keziou

Likelihood-free methods perform parameter inference in stochastic simulator models where evaluating the likelihood is intractable but sampling synthetic data is possible. One class of methods for this likelihood-free problem uses a…

Machine Learning · Statistics 2020-12-21 Conor Durkan , Iain Murray , George Papamakarios

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

Statistics Theory · Mathematics 2010-01-13 Yuan Liao , Wenxin Jiang

Probability density estimation is a core problem of statistics and signal processing. Moment methods are an important means of density estimation, but they are generally strongly dependent on the choice of feasible functions, which severely…

Machine Learning · Statistics 2023-07-06 Guangyu Wu , Anders Lindquist

Novel concentration inequalities are obtained for the missing mass, i.e. the total probability mass of the outcomes not observed in the sample. We derive distribution-free deviation bounds with sublinear exponents in deviation size for…

Machine Learning · Statistics 2015-12-02 Bahman Yari Saeed Khanloo

A composite likelihood is a non-genuine likelihood function that allows to make inference on limited aspects of a model, such as marginal or conditional distributions. Composite likelihoods are not proper likelihoods and need therefore…

Methodology · Statistics 2021-04-06 Michele Lambardi di San Miniato , Nicola Sartori

This paper develops systematic approaches to obtain $f$-divergence inequalities, dealing with pairs of probability measures defined on arbitrary alphabets. Functional domination is one such approach, where special emphasis is placed on…

Information Theory · Computer Science 2016-12-06 Igal Sason , Sergio Verdú

By using stochastic analysis, two probability versions of Li-Yau type inequalities are established for diffusion semigroups on a manifold possibly with (non-convex) boundary. The inequalities are explicitly given by the Bakry-Emery…

Probability · Mathematics 2024-11-07 Feng-Yu Wang , Li-Juan Cheng

Group-invariant probability distributions appear in many data-generative models in machine learning, such as graphs, point clouds, and images. In practice, one often needs to estimate divergences between such distributions. In this work, we…

Machine Learning · Computer Science 2026-02-05 Behrooz Tahmasebi , Stefanie Jegelka