English
Related papers

Related papers: Learning Sums of Independent Random Variables with…

200 papers

The asymptotic tail behaviour of sums of independent subexponential random variables is well understood, one of the main characteristics being the principle of the single big jump. We study the case of dependent subexponential random…

Probability · Mathematics 2017-11-29 Sergey Foss , Andrew Richards

In this article we introduce associative Look-Up Tables. With their help, pseudo sums are correctly determined. The set of limit distributions in a pseudo-summation scheme of i.i.d. random variables is described. Also, two special cases…

Probability · Mathematics 2023-06-02 Ivan Alexeev , Ignat Melnikov , Artem Uglovski

Learning joint probability distributions on n random variables requires exponential sample size in the generic case. Here we consider the case that a temporal (or causal) order of the variables is known and that the (unknown) graph of…

Machine Learning · Computer Science 2007-05-23 Pawel Wocjan , Dominik Janzing , Thomas Beth

We study the problem of learning from unlabeled samples very general statistical mixture models on large finite sets. Specifically, the model to be learned, $\vartheta$, is a probability distribution over probability distributions $p$,…

Machine Learning · Computer Science 2015-04-13 Jian Li , Yuval Rabani , Leonard J. Schulman , Chaitanya Swamy

We develop improved rearrangement algorithms to find the dependence structure that minimizes a convex function of the sum of dependent variables with given margins. We propose a new multivariate dependence measure, which can assess the…

Computation · Statistics 2016-07-14 Carole Bernard , Don McLeish

We prove that any finite abelian group $G$ contains a collection of not too many subsets with a special structure, so that for every subset $A$ of $G$ with a small doubling, there is a member $F$ of the collection that is fully contained in…

Combinatorics · Mathematics 2025-09-03 Noga Alon , Huy Tuan Pham

We use the Sum of Squares method to develop new efficient algorithms for learning well-separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that substantially improve upon the statistical guarantees achieved…

Data Structures and Algorithms · Computer Science 2017-11-21 Samuel B. Hopkins , Jerry Li

This paper derives a new strong Gaussian approximation bound for the sum of independent random vectors. The approach relies on the optimal transport theory and yields \textit{explicit} dependence on the dimension size $p$ and the sample…

Statistics Theory · Mathematics 2021-09-06 Nazar Buzun , Nikolay Shvetsov , Dmitry V. Dylov

We propose a new belief update rule for Distributed Non-Bayesian learning in time-varying directed graphs, where a group of agents tries to collectively identify a hypothesis that best describes a sequence of observed data. We show that the…

Optimization and Control · Mathematics 2015-09-30 Angelia Nedić , Alex Olshevsky , César A. Uribe

This work represents a natural coalescence of two important lines of work: learning mixtures of Gaussians and algorithmic robust statistics. In particular we give the first provably robust algorithm for learning mixtures of any constant…

Data Structures and Algorithms · Computer Science 2021-07-27 Allen Liu , Ankur Moitra

We propose a new algorithm to compute numerically the distribution function of the sum of $d$ dependent, non-negative random variables with given joint distribution.

Statistics Theory · Mathematics 2011-06-16 Philipp Arbenz , Paul Embrechts , Giovanni Puccetti

We study an information analogue of infinitely divisible probability distributions, where the i.i.d. sum is replaced by the joint distribution of an i.i.d. sequence. A random variable $X$ is called informationally infinitely divisible if,…

Information Theory · Computer Science 2023-07-19 Cheuk Ting Li

We consider the problem of bounding large deviations for non-i.i.d. random variables that are allowed to have arbitrary dependencies. Previous works typically assumed a specific dependence structure, namely the existence of independent…

Probability · Mathematics 2018-11-06 Christoph H. Lampert , Liva Ralaivola , Alexander Zimin

The statistical analysis of massive and complex data sets will require the development of algorithms that depend on distributed computing and collaborative inference. Inspired by this, we propose a collaborative framework that aims to…

Statistics Theory · Mathematics 2015-07-02 Gérard Biau , Kevin Bleakley , Benoit Cadre

Given a finite set of integers $A$, its sumset is $A+A:= \{a_i+a_j \mid a_i,a_j\in A\}$. We examine $|A+A|$ as a random variable, where $A\subset I_n = [0,n-1]$, the set of integers from 0 to $n-1$, so that each element of $I_n$ is in $A$…

For any finite set of integers X, define its sumset X+X to be {x+y: x, y in X}. In a recent paper, Martin and O'Bryant investigated the distribution of |A+A| given the uniform distribution on subsets A of {0, 1, ..., n-1}. They also…

Number Theory · Mathematics 2012-12-24 Oleg Lazarev , Steven J. Miller , Kevin O'Bryant

This paper concerns the estimation of sums of functions of observable and unobservable variables. Lower bounds for the asymptotic variance and a convolution theorem are derived in general finite- and infinite-dimensional models. An explicit…

Statistics Theory · Mathematics 2007-06-13 Cun-Hui Zhang

Social and real-world considerations such as robustness, fairness, social welfare and multi-agent tradeoffs have given rise to multi-distribution learning paradigms, such as collaborative learning, group distributionally robust…

Machine Learning · Computer Science 2024-04-04 Nika Haghtalab , Michael I. Jordan , Eric Zhao

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings such as compressive sensing, and subset selection in…

Information Theory · Computer Science 2016-08-31 Jonathan Scarlett , Volkan Cevher

We study randomly stopped sums via their asymptotic scales. First, finiteness of moments is considered. To generalise this study, asymptotic scales applicable to the class of all heavy-tailed random variables are used. The stopping is…

Probability · Mathematics 2014-05-12 Jaakko Lehtomaa