English
Related papers

Related papers: Density estimation in linear time

200 papers

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

Semi-discrete optimal transport problems, which evaluate the Wasserstein distance between a discrete and a generic (possibly non-discrete) probability measure, are believed to be computationally hard. Even though such problems are…

Machine Learning · Computer Science 2022-05-02 Bahar Taskesen , Soroosh Shafieezadeh-Abadeh , Daniel Kuhn

In this paper, we consider contention resolution algorithms that are augmented with predictions about the network. We begin by studying the natural setup in which the algorithm is provided a distribution defined over the possible network…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-27 Seth Gilbert , Calvin Newport , Nitin Vaidya , Alex Weaver

We study nonparametric density estimation problems where error is measured in the Wasserstein distance, a metric on probability distributions popular in many areas of statistics and machine learning. We give the first minimax-optimal rates…

Statistics Theory · Mathematics 2020-04-30 Jonathan Niles-Weed , Quentin Berthet

We consider the compressive sensing of a sparse or compressible signal ${\bf x} \in {\mathbb R}^M$. We explicitly construct a class of measurement matrices, referred to as the low density frames, and develop decoding algorithms that produce…

Information Theory · Computer Science 2009-03-05 Mehmet Akçakaya , Jinsoo Park , Vahid Tarokh

We consider semi-discrete first-order finite difference schemes for a nonlinear degenerate convection-diffusion equations in one space dimension, and prove an L1 error estimate. Precisely, we show that the L1 loc difference between the…

Analysis of PDEs · Mathematics 2012-09-20 K. H. Karlsen , U. Koley , N. H. Risebro

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

Statistics Theory · Mathematics 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

We propose a fundamental metric for measuring the distance between two distributions. This metric, referred to as the decision-focused (DF) divergence, is tailored to stochastic linear optimization problems in which the objective…

Statistics Theory · Mathematics 2026-02-04 Suhan Liu , Mo Liu

How might a smooth probability distribution be estimated, with accurately quantified uncertainty, from a limited amount of sampled data? Here we describe a field-theoretic approach that addresses this problem remarkably well in one…

Data Analysis, Statistics and Probability · Physics 2018-10-24 Wei-Chia Chen , Ammar Tareen , Justin B. Kinney

The effect of uncertainties and noise on a quantity of interest (model output) is often better described by its probability density function (PDF) than by its moments. Although density estimation is a common task, the adequacy of…

Numerical Analysis · Mathematics 2019-06-21 Adi Ditkowski , Gadi Fibich , Amir Sagiv

We address the following problem: given two smooth densities on a manifold, find an optimal diffeomorphism that transforms one density into the other. Our framework builds on connections between the Fisher-Rao information metric on the…

Optimization and Control · Mathematics 2016-09-05 Martin Bauer , Sarang Joshi , Klas Modin

The density ratio of two probability distributions is one of the fundamental tools in mathematical and computational statistics and machine learning, and it has a variety of known applications. Therefore, density ratio estimation from…

Machine Learning · Statistics 2024-06-28 Masanari Kimura , Howard Bondell

Sparse decision trees are one of the most common forms of interpretable models. While recent advances have produced algorithms that fully optimize sparse decision trees for prediction, that work does not address policy design, because the…

Machine Learning · Computer Science 2022-10-27 Ali Behrouz , Mathias Lecuyer , Cynthia Rudin , Margo Seltzer

This paper investigates two strategies to reduce the communication delay in future wireless networks: traffic dispersion and network densification. A hybrid scheme that combines these two strategies is also considered. The probabilistic…

Networking and Internet Architecture · Computer Science 2018-03-15 Guang Yang , Ming Xiao , H. Vincent Poor

We study dense packings of a large number of congruent non-overlapping circles inside a square by looking for configurations which maximize the packing density, defined as the ratio between the area occupied by the disks and the area of the…

Soft Condensed Matter · Physics 2022-05-23 Paolo Amore , Tenoch Morales

We present a numerical method to solve the optimal transport problem with a quadratic cost when the source and target measures are periodic probability densities. This method is based on a numerical resolution of the corresponding…

Numerical Analysis · Mathematics 2011-03-02 Louis-Philippe Saumier , Martial Agueh , Boualem Khouider

The density deconvolution problem involves recovering a target density g from a sample that has been corrupted by noise. From the perspective of Le Cam's local asymptotic normality theory, we show that non-parametric density deconvolution…

Statistics Theory · Mathematics 2015-07-06 Stefan Wager

In this paper, we study the problem of sampling from a given probability density function that is known to be smooth and strongly log-concave. We analyze several methods of approximate sampling based on discretizations of the (highly…

Statistics Theory · Mathematics 2024-02-26 Arnak S. Dalalyan , Avetik G. Karagulyan

To recover a sparse signal from an underdetermined system, we often solve a constrained L1-norm minimization problem. In many cases, the signal sparsity and the recovery performance can be further improved by replacing the L1 norm with a…

Computation · Statistics 2012-08-06 M. Salman Asif , Justin Romberg

Given a sample $\{X_i\}_{i=1}^n$ from $f_X$, we construct kernel density estimators for $f_Y$, the convolution of $f_X$ with a known error density $f_{\epsilon}$. This problem is known as density estimation with Berkson error and has…

Methodology · Statistics 2014-07-30 James P. Long , Noureddine El Karoui , John A. Rice