English
Related papers

Related papers: A short note on learning discrete distributions

200 papers

This paper introduces a new discrete distribution suggested by curtailed sampling rules common in early-stage clinical trials. We derive the distribution of the smallest number of independent Bernoulli(p) trials needed in order to observe…

Statistics Theory · Mathematics 2018-02-16 Michelle DeVeaux , Michael J. Kane , Daniel Zelterman

We propose a simpler derivation of the probability density function of Feller Diffusion using the Fourier Transform and solving the resulting equation via the Method of Characteristics. We also discuss simulation algorithms and confirm key…

Probability · Mathematics 2019-06-28 Ranjiva Munasinghe , Leslie Kanthan , Pathum Kossinna

Mathematical models for complex systems are often accompanied with uncertainties. The goal of this paper is to extract a stochastic differential equation governing model with observation on stationary probability distributions. We develop a…

Dynamical Systems · Mathematics 2023-04-05 Xiaoli Chen , Hui Wang , Jinqiao Duan

We consider the following basic learning task: given independent draws from an unknown distribution over a discrete support, output an approximation of the distribution that is as accurate as possible in $\ell_1$ distance (i.e. total…

Machine Learning · Computer Science 2015-11-12 Gregory Valiant , Paul Valiant

The paper advocates the use of a statistical tool dedicated to the exploration of data samples populated by several sources of events. This new technique, called sPlot, is able to unfold the contributions of the different sources to the…

Data Analysis, Statistics and Probability · Physics 2017-08-23 Muriel Pivk

We present a new analysis of the problem of learning with drifting distributions in the batch setting using the notion of discrepancy. We prove learning bounds based on the Rademacher complexity of the hypothesis set and the discrepancy of…

Machine Learning · Computer Science 2012-08-28 Mehryar Mohri , Andres Munoz Medina

Organisms and algorithms learn probability distributions from previous observations, either over evolutionary time or on the fly. In the absence of regularities, estimating the underlying distribution from data would require observing each…

Statistical Mechanics · Physics 2024-12-10 William Bialek , Stephanie E. Palmer , David J. Schwab

A core principle in statistical learning is that smoothness of target functions allows to break the curse of dimensionality. However, learning a smooth function seems to require enough samples close to one another to get meaningful estimate…

Machine Learning · Statistics 2023-10-18 Vivien Cabannes , Stefano Vigogna

A classical problem in statistics is estimating the expected coverage of a sample, which has had applications in gene expression, microbial ecology, optimization, and even numismatics. Here we consider a related extension of this problem to…

Statistics Theory · Mathematics 2013-02-11 Jerrad Hampton , Manuel E. Lladser

Consider a string of $n$ positions, i.e. a discrete string of length $n$. Units of length $k$ are placed at random on this string in such a way that they do not overlap, and as often as possible, i.e. until all spacings between neighboring…

Probability · Mathematics 2007-05-23 Chris A. J. Klaassen , J. Theo Runnenburg

An important problem in the analysis of experimental data showing fractal properties, is that such samples are composed by a set of points limited by an upper and a lower cut off. We study how finite size effect due to the discreteness of…

Condensed Matter · Physics 2007-05-23 A. Amici , M. Montuori

Few shot learning is an important problem in machine learning as large labelled datasets take considerable time and effort to assemble. Most few-shot learning algorithms suffer from one of two limitations- they either require the design of…

Machine Learning · Computer Science 2022-04-12 Shakti Kumar , Hussain Zaidi

We consider the closeness testing problem for discrete distributions. The goal is to distinguish whether two samples are drawn from the same unspecified distribution, or whether their respective distributions are separated in $L_1$-norm. In…

Statistics Theory · Mathematics 2021-01-20 Joseph Lam-Weil , Alexandra Carpentier , Bharath K. Sriperumbudur

Many algorithms have been developed to estimate probability distributions subject to differential privacy (DP): such an algorithm takes as input independent samples from a distribution and estimates the density function in a way that is…

Cryptography and Security · Computer Science 2024-12-17 Albert Cheu , Debanuj Nayak

We propose a new method for local distance metric learning based on sample similarity as side information. These local metrics, which utilize conical combinations of metric weight matrices, are learned from the pooled spatial…

Machine Learning · Computer Science 2019-02-25 YInjie Huang , Cong Li , Michael Georgiopoulos , Georgios C. Anagnostopoulos

The privacy loss distribution (PLD) provides a tight characterization of the privacy loss of a mechanism in the context of differential privacy (DP). Recent work has shown that PLD-based accounting allows for tighter $(\varepsilon,…

Data Structures and Algorithms · Computer Science 2022-07-12 Vadym Doroshenko , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

Clustering is a fundamental problem in data analysis. In differentially private clustering, the goal is to identify $k$ cluster centers without disclosing information on individual data points. Despite significant research progress, the…

Machine Learning · Computer Science 2021-12-30 Edith Cohen , Haim Kaplan , Yishay Mansour , Uri Stemmer , Eliad Tsfadia

Methods for global navigation satellite system fault detection using Euclidean Distance Matrices have been presented recently in the literature. Published methods define a test statistic in terms of eigenvalues of a certain matrix, but the…

Robotics · Computer Science 2024-05-17 Dawson Beatty

The goal of subspace learning is to find a $k$-dimensional subspace of $\mathbb{R}^d$, such that the expected squared distance between instance vectors and the subspace is as small as possible. In this paper we study subspace learning in a…

Machine Learning · Computer Science 2016-05-27 Alon Gonen , Dan Rosenbaum , Yonina Eldar , Shai Shalev-Shwartz

In this paper, we present a method for factor analysis of discrete data. This is accomplished by fitting a dependent Poisson model with a factor structure. To be able to analyze ordinal data, we also consider a truncated Poisson…

Methodology · Statistics 2019-03-13 Rolf Larsson