English
Related papers

Related papers: Properly Learning Poisson Binomial Distributions i…

200 papers

We study the computational complexity of approximating general constrained Markov decision processes. Our primary contribution is the design of a polynomial time $(0,\epsilon)$-additive bicriteria approximation algorithm for finding optimal…

Data Structures and Algorithms · Computer Science 2025-02-12 Jeremy McMahan

We consider a learning problem of identifying a dictionary matrix D (M times N dimension) from a sample set of M dimensional vectors Y = N^{-1/2} DX, where X is a sparse matrix (N times P dimension) in which the density of non-zero entries…

Machine Learning · Computer Science 2014-02-06 Ayaka Sakata , Yoshiyuki Kabashima

We establish optimal Statistical Query (SQ) lower bounds for robustly learning certain families of discrete high-dimensional distributions. In particular, we show that no efficient SQ algorithm with access to an $\epsilon$-corrupted binary…

Data Structures and Algorithms · Computer Science 2022-06-10 Ilias Diakonikolas , Daniel M. Kane , Yuxin Sun

In this paper, we investigate the probabilistic set covering problem (PSCP) in which the right-hand side is a binary random vector and the covering constraint is required to be satisfied with a prespecified probability. We consider the case…

Optimization and Control · Mathematics 2026-03-24 Wei Lv , Wei-Kun Chen , Yi-Long Chen , Yu-Hong Dai

This paper revisits the ordered statistics decoding (OSD). It provides a comprehensive analysis of the OSD algorithm by characterizing the statistical properties, evolution and the distribution of the Hamming distance and weighted Hamming…

Information Theory · Computer Science 2021-05-10 Chentao Yue , Mahyar Shirvanimoghaddam , Branka Vucetic , Yonghui Li

Mixtures of Gaussian (or normal) distributions arise in a variety of application areas. Many heuristics have been proposed for the task of finding the component Gaussians given samples from the mixture, such as the EM algorithm, a…

Probability · Mathematics 2007-05-23 Sanjeev Arora , Ravi Kannan

We provide finite sample guarantees for the classical Chow-Liu algorithm (IEEE Trans.~Inform.~Theory, 1968) to learn a tree-structured graphical model of a distribution. For a distribution $P$ on $\Sigma^n$ and a tree $T$ on $n$ nodes, we…

Data Structures and Algorithms · Computer Science 2021-07-23 Arnab Bhattacharyya , Sutanu Gayen , Eric Price , N. V. Vinodchandran

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

A Bayesian net (BN) is more than a succinct way to encode a probabilistic distribution; it also corresponds to a function used to answer queries. A BN can therefore be evaluated by the accuracy of the answers it returns. Many algorithms for…

Artificial Intelligence · Computer Science 2013-02-08 Russell Greiner , Adam J. Grove , Dale Schuurmans

We investigate the problem of learning Bayesian networks in a robust model where an $\epsilon$-fraction of the samples are adversarially corrupted. In this work, we study the fully observable discrete case where the structure of the network…

Data Structures and Algorithms · Computer Science 2018-10-30 Yu Cheng , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

This article presents two novel adaptive-sparse polynomial dimensional decomposition (PDD) methods for solving high-dimensional uncertainty quantification problems in computational science and engineering. The methods entail global…

Numerical Analysis · Mathematics 2015-06-18 Vaibhav Yadav , Sharif Rahman

Sample- and computationally-efficient distribution estimation is a fundamental tenet in statistics and machine learning. We present SURF, an algorithm for approximating distributions by piecewise polynomials. SURF is: simple, replacing…

Machine Learning · Statistics 2021-02-15 Yi Hao , Ayush Jain , Alon Orlitsky , Vaishakh Ravindrakumar

We describe a novel approach to statistical learning from particles tracked while moving in a random environment. The problem consists in inferring properties of the environment from recorded snapshots. We consider here the case of a fluid…

Information Theory · Computer Science 2008-06-09 Michael Chertkov , Lukas Kroc , Massimo Vergassola

In this work, we continue the line of research on the complexity of distributions (Viola, Journal of Computing 2012), and study samplers defined by low degree polynomials. An $n$-tuple $P = (P_1,\dots, P_n)$ of functions $P_i \colon…

Computational Complexity · Computer Science 2026-05-05 Mohammad Mahdi Khodabandeh , Igor Shinkar

In many applications, data is collected in batches, some of which are corrupt or even adversarial. Recent work derived optimal robust algorithms for estimating discrete distributions in this setting. We consider a general framework of…

Machine Learning · Statistics 2020-02-26 Ayush Jain , Alon Orlitsky

We study the quickest detection problem of a sudden change in the arrival rate of a Poisson process from a known value to an unknown and unobservable value at an unknown and unobservable disorder time. Our objective is to design an alarm…

Probability · Mathematics 2007-08-03 Erhan Bayraktar , Savas Dayanik , Ioannis Karatzas

The ability to learn polynomials and generalize out-of-distribution is essential for simulation metamodels in many disciplines of engineering, where the time step updates are described by polynomials. While feed forward neural networks can…

Machine Learning · Computer Science 2023-07-21 Jesper Hauch , Christoffer Riis , Francisco C. Pereira

In this paper we develop a very general class of bivariate discrete distributions. The basic idea is very simple. The marginals are obtained by taking the random geometric sum of a baseline distribution function. The proposed class of…

Methodology · Statistics 2018-05-22 Debasis Kundu

The robust Poisson method is becoming increasingly popular when estimating the association of exposures with a binary outcome. Unlike the logistic regression model, the robust Poisson method yields results that can be interpreted as risk or…

Methodology · Statistics 2022-09-14 Denis Talbot , Miceline Mésidor , Yohann Chiu , Marc Simard , Caroline Sirois

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler