English
Related papers

Related papers: Density estimation in linear time

200 papers

We propose a scalable divergence estimation method based on hashing. Consider two continuous random variables $X$ and $Y$ whose densities have bounded support. We consider a particular locality sensitive random hashing, and consider the…

Information Theory · Computer Science 2018-01-03 Morteza Noshad , Alfred O. Hero

We discuss two new methods of recovery of sparse signals from noisy observation based on $\ell_1$- minimization. They are closely related to the well-known techniques such as Lasso and Dantzig Selector. However, these estimators come with…

Statistics Theory · Mathematics 2014-04-11 Anatoli Iouditski , Arkadii S. Nemirovski

Optimality results for two outstanding Bayesian estimation problems are given in this paper: the estimation of the sampling distribution for the squared total variation function and the estimation of the density for the $L^1$-squared loss…

Statistics Theory · Mathematics 2021-10-28 A. G. Nogales

This paper concerns the analysis of random second order linear differential equations. Usually, solving these equations consists of computing the first statistics of the response process, and that task has been an essential goal in the…

Probability · Mathematics 2020-02-14 Marc Jornet , Julia Calatayud , Olivier P. Le Ma^itre , Juan Carlos Cortés

This work proposes a method for sparse polynomial chaos (PC) approximation of high-dimensional stochastic functions based on non-adapted random sampling. We modify the standard l1 -minimization algorithm, originally proposed in the context…

Numerical Analysis · Mathematics 2015-06-16 Ji Peng , Jerrad Hampton , Alireza Doostan

We study the problem of bivariate discrete or continuous probability density estimation under low-rank constraints.For discrete distributions, we assume that the two-dimensional array to estimate is a low-rank probability matrix. In the…

Statistics Theory · Mathematics 2024-10-23 Julien Chhor , Olga Klopp , Alexandre Tsybakov

Modern computers enable methods for design optimization that account for uncertainty in the system---so-called optimization under uncertainty. We propose a metric for OUU that measures the distance between a designer-specified probability…

Optimization and Control · Mathematics 2015-08-10 Pranay Seshadri , Paul Constantine , Gianluca Iaccarino , Geoffrey Parks

Distributionally robust stochastic optimization (DRSO) is an approach to optimization under uncertainty in which, instead of assuming that there is a known true underlying probability distribution, one hedges against a chosen set of…

Optimization and Control · Mathematics 2022-05-03 Rui Gao , Anton J. Kleywegt

This paper revisits the ordered statistics decoding (OSD). It provides a comprehensive analysis of the OSD algorithm by characterizing the statistical properties, evolution and the distribution of the Hamming distance and weighted Hamming…

Information Theory · Computer Science 2021-05-10 Chentao Yue , Mahyar Shirvanimoghaddam , Branka Vucetic , Yonghui Li

The aim of this paper is to study different estimation procedures based on $\varphi-$divergences. The dual representation of $\varphi-$divergences based on the Fenchel-Legendre duality is the main interest of this study. It provides a way…

Methodology · Statistics 2015-10-13 Diaa Al Mohamad

A class of estimators of the R\'{e}nyi and Tsallis entropies of an unknown distribution $f$ in $\mathbb{R}^m$ is presented. These estimators are based on the $k$th nearest-neighbor distances computed from a sample of $N$ i.i.d. vectors with…

Statistics Theory · Mathematics 2012-11-16 Nikolai Leonenko , Luc Pronzato , Vippal Savani

In this paper we study the randomized non-autonomous complete linear differential equation. The diffusion coefficient and the source term in the differential equation are assumed to be stochastic processes and the initial condition is…

Probability · Mathematics 2018-02-13 J. Catatayud , J. -C. Cortes , M. Jornet

In this paper, we provide different splitting methods for solving distributionally robust optimization problems in cases where the uncertainties are described by discrete distributions. The first method involves computing the proximity…

Optimization and Control · Mathematics 2024-10-30 Luis Briceño-Arias , Sergio López-Rivera , Emilio Vilches

We investigate the use of diffusion models as neural density estimators. The current approach to this problem involves converting the generative process to a smooth flow, known as the Probability Flow ODE. The log density at a given sample…

Machine Learning · Computer Science 2024-10-10 Akhil Premkumar

We study the optimization version of the set partition problem (where the difference between the partition sums are minimized), which has numerous applications in decision theory literature. While the set partitioning problem is NP-hard and…

Data Structures and Algorithms · Computer Science 2021-09-13 Kaan Gokcesu , Hakan Gokcesu

Column-sparse packing problems arise in several contexts in both deterministic and stochastic discrete optimization. We present two unifying ideas, (non-uniform) attenuation and multiple-chance algorithms, to obtain improved approximation…

Data Structures and Algorithms · Computer Science 2019-08-07 Brian Brubach , Karthik Abinav Sankararaman , Aravind Srinivasan , Pan Xu

Given a hypergraph with uncertain node weights following known probability distributions, we study the problem of querying as few nodes as possible until the identity of a node with minimum weight can be determined for each hyperedge.…

Data Structures and Algorithms · Computer Science 2021-07-02 Evripidis Bampis , Christoph Dürr , Thomas Erlebach , Murilo S. de Lima , Nicole Megow , Jens Schlöter

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Data Structures and Algorithms · Computer Science 2014-11-11 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

Derivation of the probability density evolution provides invaluable insight into the behavior of many stochastic systems and their performance. However, for most real-time applica-tions, numerical determination of the probability density…

Machine Learning · Computer Science 2022-07-06 Seid H. Pourtakdoust , Amir H. Khodabakhsh

Accurate probabilistic predictions can be characterized by two properties -- calibration and sharpness. However, standard maximum likelihood training yields models that are poorly calibrated and thus inaccurate -- a 90% confidence interval…

Machine Learning · Computer Science 2025-05-14 Volodymyr Kuleshov , Shachi Deshpande