English
Related papers

Related papers: Maximum likelihood estimation of a log-concave den…

200 papers

We consider the problem of stochastic convex optimization with exp-concave losses using Empirical Risk Minimization in a convex class. Answering a question raised in several prior works, we provide a $O( d / n + \log( 1 / \delta) / n )$…

Machine Learning · Computer Science 2023-07-06 Nikita Puchkin , Nikita Zhivotovskiy

Mean field variational inference (VI) is the problem of finding the closest product (factorized) measure, in the sense of relative entropy, to a given high-dimensional probability measure $\rho$. The well known Coordinate Ascent Variational…

Machine Learning · Statistics 2024-04-16 Manuel Arnese , Daniel Lacker

We study semiparametric time series models with innovations following a log-concave distribution. We propose a general maximum likelihood framework which allows us to estimate simultaneously the parameters of the model and the density of…

Methodology · Statistics 2018-01-30 Yining Chen

The log-density method is a powerful algorithmic framework which in recent years has given rise to the best-known approximations for a variety of problems, including Densest-$k$-Subgraph and Bipartite Small Set Vertex Expansion. These…

Data Structures and Algorithms · Computer Science 2018-04-24 Eden Chlamtáč , Pasin Manurangsi

We establish uniform estimates for order statistics of sequences of independent identically distributed random variables with log-concave distribution in terms of Orlicz norms associated with the distribution function of the random…

Probability · Mathematics 2008-09-18 Yehoram Gordon , Alexander Litvak , Carsten Schütt , Elisabeth Werner

We consider the problem of estimating probability density functions based on sample data, using a finite mixture of densities from some component class. To this end, we introduce the $h$-lifted Kullback--Leibler (KL) divergence as a…

Machine Learning · Statistics 2024-12-24 Mark Chiu Chong , Hien Duy Nguyen , TrungTin Nguyen

Let $(X_i)_{i\geq 1}$ be an i.i.d. sample on $\RRR^d$ having density $f$. Given a real function $\phi$ on $\RRR^d$ with finite variation and given an integer valued sequence $(j_n)$, let $\fn$ denote the estimator of $f$ by wavelet…

Statistics Theory · Mathematics 2012-01-27 Davit Varron

We prove a pointwise version of the multi-dimensional central limit theorem for convex bodies. Namely, let X be an isotropic random vector in R^n with a log-concave density. For a typical subspace E in R^n of dimension n^c, consider the…

Metric Geometry · Mathematics 2007-08-21 Ronen Eldan , Bo'az Klartag

We study the problem of nonparametric estimation under $\bL_p$-loss, $p\in [1,\infty)$, in the framework of the convolution structure density model on $\bR^d$. This observation scheme is a generalization of two classical statistical models,…

Statistics Theory · Mathematics 2017-04-17 Oleg Lepski , Thomas Willer

We consider a one-dimensional recurrent random walk in random environment (RWRE) when the environment is i.i.d. with a parametric, finitely supported distribution. Based on a single observation of the path, we provide a maximum likelihood…

Probability · Mathematics 2014-04-10 Francis Comets , Mikael Falconnet , Oleg Loukianov , Dasha Loukianova

By the Pr\'ekopa-Leindler inequality, the difference $X-X'$ has a log-concave density provided that $X$ has a log-concave density and $X, X'$ are independent and identically distributed. We prove that the opposite direction does not always…

Probability · Mathematics 2025-12-30 Min Wang

Bi-log-concavity of probability measures is a univariate extension of the notion of log-concavity that has been recently proposed in a statistical literature. Among other things, it has the nice property from a modelisation perspective to…

Probability · Mathematics 2019-03-20 Adrien Saumard

We consider a likelihood ratio method for testing whether a monotone baseline hazard function in the Cox model has a particular value at a fixed point. The characterization of the estimators involved is provided both in the nondecreasing…

Statistics Theory · Mathematics 2013-04-05 Gabriela F. Nane

We consider nonparametric statistical inference for L\'evy processes sampled irregularly, at low frequency. The estimation of the jump dynamics as well as the estimation of the distributional density are investigated. Non-asymptotic risk…

Statistics Theory · Mathematics 2015-11-23 Johanna Kappus

On a compact group the Haar probability measure plays the role of uniform distribution. The entropy and rate distortion theory for this uniform distribution is studied. New results and simplified proofs on convergence of convolutions on…

Information Theory · Computer Science 2010-05-27 Peter Harremoes

Let $X_1,\dots,X_n$ be i.i.d. log-concave random vectors in $\mathbb R^d$ with mean 0 and covariance matrix $\Sigma$. We study the problem of quantifying the normal approximation error for $W=n^{-1/2}\sum_{i=1}^nX_i$ with explicit…

Probability · Mathematics 2023-05-30 Xiao Fang , Yuta Koike

We propose an estimator of a concave cumulative distribution function under the measurement error model, where the non-negative variables of interest are perturbed by additive independent random noise. The estimator is defined as the least…

Statistics Theory · Mathematics 2026-03-03 Mohammed Es-Salih Benjrada , Cecile Durot , Tommaso Lando

A test of the null hypothesis that a hazard rate is monotone nondecreasing, versus the alternative that it is not, is proposed. Both the test statistic and the means of calibrating it are new. Unlike previous approaches, neither is based on…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Ingrid Van Keilegom

The problem of estimating the Kullback-Leibler divergence $D(P\|Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the distributions can scale to infinity. The estimation is…

Information Theory · Computer Science 2018-02-22 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

Maximum likelihood estimation is one of the most used methods in quantum state tomography, where the aim is to reconstruct the density matrix of a physical system from measurement results. One strategy to deal with positivity and unit trace…