English
Related papers

Related papers: Density estimation from an individual numerical se…

200 papers

We study non-stationary averaging processes, where each term of a sequence is a weighted average of previous terms, namely $a_{n+1} = \sum_{j=1}^n p_n(j) a_j$. Our results extend classical theory in two distinct regimes. First, we prove a…

Probability · Mathematics 2026-03-18 Saba Lepsveridze , Elchanan Mossel

Binary density ratio estimation (DRE), the problem of estimating the ratio $p_1/p_2$ given their empirical samples, provides the foundation for many state-of-the-art machine learning algorithms such as contrastive representation learning…

Machine Learning · Computer Science 2021-12-08 Lantao Yu , Yujia Jin , Stefano Ermon

Let $f$ be a multivariate density and $f\_n$ be a kernel estimate of $f$ drawn from the $n$-sample $X\_1,...,X\_n$ of i.i.d. random variables with density $f$. We compute the asymptotic rate of convergence towards 0 of the volume of the…

Statistics Theory · Mathematics 2007-06-13 Benoit Cadre

Let f_n denote a kernel density estimator of a continuous density f in d dimensions, bounded and positive. Let \Psi(t) be a positive continuous function such that \|\Psi f^{\beta}\|_{\infty}<\infty for some 0<\beta<1/2. Under natural…

Probability · Mathematics 2016-09-07 Evarist Gine , Vladimir Koltchinskii , Joel Zinn

Density estimation is an interdisciplinary topic at the intersection of statistics, theoretical computer science and machine learning. We review some old and new techniques for bounding the sample complexity of estimating densities of…

Statistics Theory · Mathematics 2018-02-23 Hassan Ashtiani , Abbas Mehrabian

We give a highly efficient "semi-agnostic" algorithm for learning univariate probability distributions that are well approximated by piecewise polynomial density functions. Let $p$ be an arbitrary distribution over an interval $I$ which is…

Machine Learning · Computer Science 2013-05-15 Siu-On Chan , Ilias Diakonikolas , Rocco A. Servedio , Xiaorui Sun

Biological sequences do not come at random. Instead, they appear with particular frequencies that reflect properties of the associated system or phenomenon. Knowing how biological sequences are distributed in sequence space is thus a…

Biological Physics · Physics 2024-04-18 Wei-Chia Chen , Juannan Zhou , David M. McCandlish

This paper presents a novel power spectral density estimation technique for band-limited, wide-sense stationary signals from sub-Nyquist sampled data. The technique employs multi-coset sampling and incorporates the advantages of compressed…

Information Theory · Computer Science 2012-05-18 Michael A. Lexa , Mike E. Davies , John S. Thompson

In this paper we improve some existing results concerning the approximation of the distribution of extremes of a 1-dependent and stationary sequence of random variables. We enlarge the range of applicability and improve the approximation…

Probability · Mathematics 2012-11-26 Alexandru Amarioarei

In this article we give upper and lower bounds for the integrated density of states (IDS) of the 1D discrete Anderson-Bernoulli model when the disorder is strong enough to separate the two spectral bands. These bounds are uniform on the…

Mathematical Physics · Physics 2025-03-24 Daniel Sánchez-Mendoza

The standard definition of pedestrian density produces scattered values, hence, many approaches have been developed to improve the features of the estimated density. This paper provides a review of generally applied methods and presents a…

Physics and Society · Physics 2023-07-18 Jana Vacková , Marek Bukáček

Nonparametric estimation of a mixing distribution based on data coming from a mixture model is a challenging problem. Beyond estimation, there is interest in uncertainty quantification, e.g., confidence intervals for features of the mixing…

Methodology · Statistics 2019-06-14 Vaidehi Dixit , Ryan Martin

Density ratio estimation serves as an important technique in the unsupervised machine learning toolbox. However, such ratios are difficult to estimate for complex, high-dimensional data, particularly when the densities of interest are…

Machine Learning · Computer Science 2021-07-07 Kristy Choi , Madeline Liao , Stefano Ermon

Consider a panel data setting where repeated observations on individuals are available. Often it is reasonable to assume that there exist groups of individuals that share similar effects of observed characteristics, but the grouping is…

Methodology · Statistics 2024-02-09 Lu Yu , Jiaying Gu , Stanislav Volgushev

In this paper we study records obtained from partial comparisons within a sequence of independent and identically distributed (i.i.d.) random variables, indexed by positive integers, with a common density~\(f.\) Our main result is that if…

Probability · Mathematics 2018-06-20 Ghurumuruhan Ganesan

We consider the nonparametric estimation of the density function of weakly and strongly dependent processes with noisy observations. We show that in the ordinary smooth case the optimal bandwidth choice can be influenced by long range…

Statistics Theory · Mathematics 2008-08-13 Rafał Kulik

We show that ensembling effectively quantifies model uncertainty in Neural Radiance Fields (NeRFs) if a density-aware epistemic uncertainty term is considered. The naive ensembles investigated in prior work simply average rendered RGB…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Niko Sünderhauf , Jad Abou-Chakra , Dimity Miller

We study a control system resembling a singularly perturbed system whose variables are decomposed into groups that change their values with rates of different orders of magnitude. We establish that the slow trajectories of this system are…

Optimization and Control · Mathematics 2023-09-07 Vladimir Gaitsgory , Ilya Shvartsman

The paper considers nonparametric kernel density/regression estimation from a stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained…

Statistics Theory · Mathematics 2024-09-05 Vladimir Norkin , Vladimir Kirilyuk

The aim of this paper is to establish the uniform convergence of the densities of a sequence of random variables, which are functionals of an underlying Gaussian process, to a normal density. Precise estimates for the uniform distance are…

Probability · Mathematics 2013-08-30 Yaozhong Hu , Fei Lu , David Nualart