English
Related papers

Related papers: Testing noisy low-degree polynomials for sparsity

200 papers

We investigate the statistical task of closeness (or equivalence) testing for multidimensional distributions. Specifically, given sample access to two unknown distributions $\mathbf p, \mathbf q$ on $\mathbb R^d$, we want to distinguish…

Data Structures and Algorithms · Computer Science 2023-11-23 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu

We present a statistical learning framework for robust identification of partial differential equations from noisy spatiotemporal data. Extending previous sparse regression approaches for inferring PDE models from simulated data, we address…

Numerical Analysis · Mathematics 2019-07-19 Suryanarayana Maddu , Bevan L. Cheeseman , Ivo F. Sbalzarini , Christian L. Müller

We are motivated by problems that arise in a number of applications such as Online Marketing and explosives detection, where the observations are usually modeled using Poisson statistics. We model each observation as a Poisson random…

Statistics Theory · Mathematics 2016-11-17 D. Motamedvaziri , M. H. Rohban , V. Saligrama

Image noise can often be accurately fitted to a Poisson-Gaussian distribution. However, estimating the distribution parameters from a noisy image only is a challenging task. Here, we study the case when paired noisy and noise-free samples…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Nicolas Bähler , Majed El Helou , Étienne Objois , Kaan Okumuş , Sabine Süsstrunk

This paper proposes a sparse regression strategy for discovery of ordinary differential equations from incomplete and noisy data. Inference is performed over both equation parameters and state variables using a statistically motivated…

Dynamical Systems · Mathematics 2026-02-18 Teddy Meissner , Karl Glasner

A polynomial identity testing algorithm must determine whether an input polynomial (given for instance by an arithmetic circuit) is identically equal to 0. In this paper, we show that a deterministic black-box identity testing algorithm for…

Computational Complexity · Computer Science 2010-08-02 Pascal Koiran

We show that deciding whether a sparse univariate polynomial has a p-adic rational root can be done in NP for most inputs. We also prove a polynomial-time upper bound for trinomials with suitably generic p-adic Newton polygon. We thus…

Number Theory · Mathematics 2010-11-09 Martin Avendano , Ashraf Ibrahim , J. Maurice Rojas , Korben Rusek

We study the efficient learnability of low-degree polynomial threshold functions (PTFs) in the presence of a constant fraction of adversarial corruptions. Our main algorithmic result is a polynomial-time PAC learning algorithm for this…

Data Structures and Algorithms · Computer Science 2024-04-02 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Sihan Liu , Nikos Zarifis

Sparse regression on a library of candidate features has developed as the prime method to discover the partial differential equation underlying a spatio-temporal data-set. These features consist of higher order derivatives, limiting model…

Machine Learning · Computer Science 2021-05-05 Gert-Jan Both , Gijs Vermarien , Remy Kusters

We study the task of testable learning of general -- not necessarily homogeneous -- halfspaces with adversarial label noise with respect to the Gaussian distribution. In the testable learning framework, the goal is to develop a…

Machine Learning · Computer Science 2024-09-02 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Nikos Zarifis

We present algorithms revealing new families of polynomials allowing sub-exponential detection of p-adic rational roots, relative to the sparse encoding. For instance, we show that the case of honest n-variate (n+1)-nomials is doable in NP…

Number Theory · Mathematics 2010-11-09 Martín Avendaño , Ashraf Ibrahim , J. Maurice Rojas , Korben Rusek

Acquiring accurate labels on large-scale datasets is both time consuming and expensive. To reduce the dependency of deep learning models on learning from clean labeled data, several recent research efforts are focused on learning with noisy…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Arushi Goel , Yunlong Jiao , Jordan Massiah

We present a new computational approach to approximating a large, noisy data table by a low-rank matrix with sparse singular vectors. The approximation is obtained from thresholded subspace iterations that produce the singular vectors…

Methodology · Statistics 2011-12-13 Dan Yang , Zongming Ma , Andreas Buja

We consider the problem of detecting a small subset of defective items from a large set via non-adaptive "random pooling" group tests. We consider both the case when the measurements are noiseless, and the case when the measurements are…

Information Theory · Computer Science 2011-07-25 Chun Lam Chan , Pak Hou Che , Sidharth Jaggi , Venkatesh Saligrama

Let A be an M by N matrix (M < N) which is an instance of a real random Gaussian ensemble. In compressed sensing we are interested in finding the sparsest solution to the system of equations A x = y for a given y. In general, whenever the…

Information Theory · Computer Science 2011-03-09 Mihailo Stojnic , Farzad Parvaresh , Babak Hassibi

The relative-error property testing model was introduced in [CDHLNSY24] to facilitate the study of property testing for "sparse" Boolean-valued functions, i.e. ones for which only a small fraction of all input assignments satisfy the…

Data Structures and Algorithms · Computer Science 2026-04-03 Xi Chen , Anindya De , Yizhi Huang , Shivam Nadimpalli , Rocco A. Servedio , Tianqi Yang

We study the problem of high-dimensional sparse mean estimation in the presence of an $\epsilon$-fraction of adversarial outliers. Prior work obtained sample and computationally efficient algorithms for this task for identity-covariance…

Data Structures and Algorithms · Computer Science 2024-07-08 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

We study the efficient learnability of geometric concept classes - specifically, low-degree polynomial threshold functions (PTFs) and intersections of halfspaces - when a fraction of the data is adversarially corrupted. We give the first…

Machine Learning · Computer Science 2017-07-06 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes

A variety of machine learning tasks---e.g., matrix factorization, topic modelling, and feature allocation---can be viewed as learning the parameters of a probability distribution over bipartite graphs. Recently, a new class of models for…

Machine Learning · Statistics 2017-12-07 Victor Veitch , Ekansh Sharma , Zacharie Naulet , Daniel M. Roy