English
Related papers

Related papers: Nonparametric estimation of multivariate convex-tr…

200 papers

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

We aim at estimating a function $\lambda:[0,1]\to \mathbb {R}$, subject to the constraint that it is decreasing (or increasing). We provide a unified approach for studying the $\mathbb {L}_p$-loss of an estimator defined as the slope of a…

Statistics Theory · Mathematics 2009-09-29 Cécile Durot

Let $(M,\omega)$ be a closed $2n$-dimensional symplectic manifold equipped with a Hamiltonian $T^{n-1}$-action. Then Atiyah-Guillemin-Sternberg convexity theorem implies that the image of the moment map is an $(n-1)$-dimensional convex…

Symplectic Geometry · Mathematics 2016-01-05 Yunhyung Cho , Min Kyu Kim

Unsupervised learning of probabilistic models is a central yet challenging problem in machine learning. Specifically, designing models with tractable learning, sampling, inference and evaluation is crucial in solving this task. We extend…

Machine Learning · Computer Science 2017-03-01 Laurent Dinh , Jascha Sohl-Dickstein , Samy Bengio

We consider nonparametric invariant density and drift estimation for a class of multidimensional degenerate resp. hypoelliptic diffusion processes, so-called stochastic damping Hamiltonian systems or kinetic diffusions, under anisotropic…

Statistics Theory · Mathematics 2022-05-24 Niklas Dexheimer , Claudia Strauch

In this paper we study the regularity of the local minima of integral functionals: in particular, not convexity (quasi-convexity, policonvexity or rank one convexity) hypothesis will be made on the density, neither structure hypothesis nor…

Optimization and Control · Mathematics 2023-02-07 Tiziano Granucci

In this paper we develop rate--optimal estimation procedures in the problem of estimating the $L_p$--norm, $p\in (0, \infty)$ of a probability density from independent observations. The density is assumed to be defined on $R^d$, $d\geq 1$…

Statistics Theory · Mathematics 2020-08-26 Alexander Goldenshluger , Oleg Lepski

Sampling from Gibbs distributions and computing their log-partition function are fundamental tasks in statistics, machine learning, and statistical physics. While efficient algorithms are known for log-concave densities, the worst-case…

Machine Learning · Statistics 2026-04-24 David Holzmüller , Francis Bach

We establish a new comparison between the Legendre transform of the cumulant generating function and the half-space depth of an arbitrary log-concave probability distribution on the real line, that carries on to the multidimensional…

Probability · Mathematics 2025-06-17 Silouanos Brazitikos , Giorgos Chasapis

We show that the likelihood function for a multinomial vector observed under arbitrary interval censoring constraints on the frequencies or their partial sums is completely log-concave by proving that the constrained sample spaces comprise…

Statistics Theory · Mathematics 2023-11-07 Bruce Levin , Erik Learned-Miller

Sobolev quantities (norms, inner products, and distances) of probability density functions are important in the theory of nonparametric statistics, but have rarely been used in practice, partly due to a lack of practical estimators. They…

Statistics Theory · Mathematics 2016-07-25 Shashank Singh , Simon S. Du , Barnabás Póczos

Let $p$ be a prime and let $L$ be a quadratic $\mathbb{Z}_p$-lattice with quadratic form $Q$. For $t\neq 0$ the local representation density $\alpha_p(t;L)$ is the stable normalised growth of the congruence counts of solutions to…

Number Theory · Mathematics 2026-02-25 Samuel Griffiths

An usual problem in statistics consists in estimating the minimizer of a convex function. When we have to deal with large samples taking values in high dimensional spaces, stochastic gradient algorithms and their averaged versions are…

Statistics Theory · Mathematics 2022-01-12 Antoine Godichon-Baggioni

We propose and study properties of maximum likelihood estimators in the class of conditional transformation models. Based on a suitable explicit parameterisation of the unconditional or conditional transformation function, we establish a…

Methodology · Statistics 2019-10-22 Torsten Hothorn , Lisa Möst , Peter Bühlmann

Given a suitably normalized $X\in\mathbb{R}^n$ we observe that the function $\theta\mapsto\mathbb{E}|X\cdot\theta|$, defined for $\theta\in S^{n-1}$, admits surprisingly strong concentration far surpassing what is expected on account of…

Functional Analysis · Mathematics 2020-08-04 Erez Buchweitz

For the task of sampling from a density $\pi \propto \exp(-V)$ on $\mathbb{R}^d$, where $V$ is possibly non-convex but $L$-gradient Lipschitz, we prove that averaged Langevin Monte Carlo outputs a sample with $\varepsilon$-relative Fisher…

Statistics Theory · Mathematics 2022-02-11 Krishnakumar Balasubramanian , Sinho Chewi , Murat A. Erdogdu , Adil Salim , Matthew Zhang

We consider a nonparametric regression model $Y=r(X)+\varepsilon$ with a random covariate $X$ that is independent of the error $\varepsilon$. Then the density of the response $Y$ is a convolution of the densities of $\varepsilon$ and…

Statistics Theory · Mathematics 2013-12-18 Anton Schick , Wolfgang Wefelmeyer

In decision-making problems under uncertainty, probabilistic constraints are a valuable tool to express safety of decisions. They result from taking the probability measure of a given set of random inequalities depending on the decision…

Optimization and Control · Mathematics 2021-02-09 Yassine Laguel , Wim van Ackooij , Jérôme Malick , Guilherme Ramalho

We consider deconvolution from repeated observations with unknown error distribution. So far, this model has mostly been studied under the additional assumption that the errors are symmetric. We construct an estimator for the non-symmetric…

Statistics Theory · Mathematics 2014-07-15 Johanna Kappus , Fabienne Comte

Nonparametric statistics for distribution functions F or densities f=F' under qualitative shape constraints provides an interesting alternative to classical parametric or entirely nonparametric approaches. We contribute to this area by…

Methodology · Statistics 2016-10-31 Lutz Duembgen , Petro Kolesnyk , Ralf A. Wilke