English
Related papers

Related papers: Least informative distributions in Maximum q-log-l…

200 papers

Extracting structured information from academic PDF documents is non trivial: a single page typically combines free text metadata with tabular regions, exhibits cross program variation, and is susceptible to Unicode encoding artifacts that…

Computation and Language · Computer Science 2026-05-25 Muhammad Anis Al Hilmi , Neelansh Khare , Noel Framil Iglesias , Kurnia Adi Cahyanto , Azhar Al Afghani , Musfi Yuliadi

This article addresses the different methods of estimation of the probability density function (PDF) and the cumulative distribution function (CDF) for the Lindley distribution. Following estimation methods are considered: uniformly minimum…

Applications · Statistics 2016-04-22 Sudhansu S. Maiti , Indrani Mukherjee

The manifold hypothesis asserts that data of interest in high-dimensional ambient spaces, such as image data, lies on unknown low-dimensional submanifolds. Diffusion models (DMs) -- which operate by convolving data with progressively larger…

Machine Learning · Computer Science 2025-10-14 Kin Kwan Leung , Rasa Hosseinzadeh , Gabriel Loaiza-Ganem

Let X_1, ..., X_n be independent and identically distributed random vectors with a log-concave (Lebesgue) density f. We first prove that, with probability one, there exists a unique maximum likelihood estimator of f. The use of this…

Methodology · Statistics 2008-04-25 Madeleine Cule , Richard Samworth , Michael Stewart

Through viewing out the literature, many generated distributions took a new special form of probability density function (PDF) in which it is written as a linear combination of n other distributions. Therefore, we define in this paper a new…

Statistics Theory · Mathematics 2022-11-15 Therar Kadri , Amina Halat

The log-concave maximum likelihood estimator (MLE) problem answers: for a set of points $X_1,...X_n \in \mathbb R^d$, which log-concave density maximizes their likelihood? We present a characterization of the log-concave MLE that leads to…

Data Structures and Algorithms · Computer Science 2018-11-09 Brian Axelrod , Gregory Valiant

This paper applies the recently axiomatized Optimum Information Principle (minimize the Kullback-Leibler information subject to all relevant information) to nonparametric density estimation, which provides a theoretical foundation as well…

Statistics Theory · Mathematics 2011-03-28 Alexis Akira Toda

Assuming we have iid observations from two unknown probability density functions (pdfs), $p$ and $q$, the likelihood-ratio estimation (LRE) is an elegant approach to compare the two pdfs only by relying on the available data. In this paper,…

Machine Learning · Statistics 2024-02-02 Alejandro de la Concha , Nicolas Vayatis , Argyris Kalogeratos

Maximum likelihood estimation (MLE) is a statistical method used to estimate the parameters of a probability distribution that best explain the observed data. In the context of text generation, MLE is often used to train generative language…

Computation and Language · Computer Science 2023-10-27 Chenze Shao , Zhengrui Ma , Min Zhang , Yang Feng

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

Statistics Theory · Mathematics 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

Two maximum likelihood-based algorithms for unfolding or deconvolution are considered: the Richardson-Lucy method and the Data Unfolding method with Mean Integrated Square Error (MISE) optimization [10]. Unfolding is viewed as a procedure…

Data Analysis, Statistics and Probability · Physics 2025-11-18 Nikolay D. Gagunashvili

We consider the distributed detection problem of a temporally correlated random radio source signal using a wireless sensor network capable of measuring the energy of the received signals. It is well-known that optimal tests in the…

Signal Processing · Electrical Eng. & Systems 2023-12-20 Juan Augusto Maya , Leonardo Rey Vega , Andrea M. Tonello

We study three fundamental statistical-learning problems: distribution estimation, property estimation, and property testing. We establish the profile maximum likelihood (PML) estimator as the first unified sample-optimal approach to a wide…

Machine Learning · Statistics 2019-07-12 Yi Hao , Alon Orlitsky

Maximum likelihood estimation is one of the most used methods in quantum state tomography, where the aim is to reconstruct the density matrix of a physical system from measurement results. One strategy to deal with positivity and unit trace…

A method to approximate continuous multi-dimensional probability density functions (PDFs) using their projections and correlations is described. The method is particularly useful for event classification when estimates of systematic…

Data Analysis, Statistics and Probability · Physics 2009-10-31 Dean Karlen

Network diffusion models are applicable to many socioeconomic interactions, yet network interaction is hard to observe or measure. Whenever the diffusion process is unobserved, the number of possible realizations of the latent matrix that…

Econometrics · Economics 2023-09-06 L. S. Sanna Stephan

We consider the nonparametric maximum likelihood estimation for the underlying event time based on mixed-case interval-censored data, under a log-concavity assumption on its distribution function. This generalized framework relaxes the…

Computation · Statistics 2024-12-02 Chi Wing Chu , Hok Kan Ling , Chaoyu Yuan

The assumption of log-concavity is a flexible and appealing nonparametric shape constraint in distribution modelling. In this work, we study the log-concave maximum likelihood estimator (MLE) of a probability mass function (pmf). We show…

Methodology · Statistics 2023-04-17 Fadoua Balabdaoui , Hanna Jankowski , Kaspar Rufibach , Marios Pavlides

Optimal experimental design (OED) is a framework that leverages a mathematical model of the experiment to identify optimal conditions for conducting the experiment. Under a Bayesian approach, the design objective function is typically…

Computation · Statistics 2026-01-27 Thomas E. Coons , Xun Huan

We introduce one-sided versions of Huber's contamination model, in which corrupted samples tend to take larger values than uncorrupted ones. Two intertwined problems are addressed: estimation of the mean of uncorrupted samples (minimum…

Statistics Theory · Mathematics 2018-09-25 Alexandra Carpentier , Sylvain Delattre , Etienne Roquain , Nicolas Verzelen