English
Related papers

Related papers: Hardness Results for Agnostically Learning Low-Deg…

200 papers

We prove the hardness of weakly learning halfspaces in the presence of adversarial noise using polynomial threshold functions (PTFs). In particular, we prove that for any constants $d \in \mathbb{Z}^+$ and $\varepsilon > 0$, it is NP-hard…

Computational Complexity · Computer Science 2017-07-07 Arnab Bhattacharyya , Suprovat Ghoshal , Rishi Saket

We show hardness of improperly learning halfspaces in the agnostic model, both in the distribution-independent as well as the distribution-specific setting, based on the assumption that worst-case lattice problems, such as GapSVP or SIVP,…

Machine Learning · Computer Science 2023-02-21 Stefan Tiegel

Rubinfeld & Vasilyan recently introduced the framework of testable learning as an extension of the classical agnostic model. It relaxes distributional assumptions which are difficult to verify by conditions that can be checked efficiently…

Machine Learning · Computer Science 2024-11-07 Lucas Slot , Stefan Tiegel , Manuel Wiedmer

We initiate the study of active learning polynomial threshold functions (PTFs). While traditional lower bounds imply that even univariate quadratics cannot be non-trivially actively learned, we show that allowing the learner basic access to…

Machine Learning · Computer Science 2022-10-04 Omri Ben-Eliezer , Max Hopkins , Chutong Yang , Hantao Yu

We give a "regularity lemma" for degree-d polynomial threshold functions (PTFs) over the Boolean cube {-1,1}^n. This result shows that every degree-d PTF can be decomposed into a constant number of subfunctions such that almost all of the…

Computational Complexity · Computer Science 2015-03-13 Ilias Diakonikolas , Rocco A. Servedio , Li-Yang Tan , Andrew Wan

We study the efficient learnability of low-degree polynomial threshold functions (PTFs) in the presence of a constant fraction of adversarial corruptions. Our main algorithmic result is a polynomial-time PAC learning algorithm for this…

Data Structures and Algorithms · Computer Science 2024-04-02 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Sihan Liu , Nikos Zarifis

We prove the following strong hardness result for learning: Given a distribution of labeled examples from the hypercube such that there exists a monomial consistent with $(1-\eps)$ of the examples, it is NP-hard to find a halfspace that is…

Computational Complexity · Computer Science 2010-12-06 Vitaly Feldman , Venkatesan Guruswami , Prasad Raghavendra , Yi Wu

A supervised learning algorithm has access to a distribution of labeled examples, and needs to return a function (hypothesis) that correctly labels the examples. The hypothesis of the learner is taken from some fixed class of functions…

Machine Learning · Computer Science 2020-08-25 Eran Malach , Shai Shalev-Shwartz

In pursuit of a deeper understanding of Boolean Promise Constraint Satisfaction Problems (PCSPs), we identify a class of problems with restricted structural complexity, which could serve as a promising candidate for complete…

Computational Complexity · Computer Science 2025-10-01 Katzper Michno

The degree-$d$ Chow parameters of a Boolean function $f: \{-1,1\}^n \to \mathbb{R}$ are its degree at most $d$ Fourier coefficients. It is well-known that degree-$d$ Chow parameters uniquely characterize degree-$d$ polynomial threshold…

Machine Learning · Computer Science 2018-11-09 Ilias Diakonikolas , Daniel M. Kane

We give a deterministic algorithm for approximately counting satisfying assignments of a degree-$d$ polynomial threshold function (PTF). Given a degree-$d$ input polynomial $p(x_1,\dots,x_n)$ over $R^n$ and a parameter $\epsilon> 0$, our…

Computational Complexity · Computer Science 2013-12-02 Anindya De , Rocco Servedio

We study the efficient learnability of geometric concept classes - specifically, low-degree polynomial threshold functions (PTFs) and intersections of halfspaces - when a fraction of the data is adversarially corrupted. We give the first…

Machine Learning · Computer Science 2017-07-06 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We give the first non-trivial upper bounds on the average sensitivity and noise sensitivity of degree-$d$ polynomial threshold functions (PTFs). These bounds hold both for PTFs over the Boolean hypercube and for PTFs over $\R^n$ under the…

Computational Complexity · Computer Science 2009-10-19 Ilias Diakonikolas , Prasad Raghavendra , Rocco A. Servedio , Li-Yang Tan

The low-rank matrix completion problem asks whether a given real matrix with missing values can be completed so that the resulting matrix has low rank or is close to a low-rank matrix. The completed matrix is often required to satisfy…

Computational Complexity · Computer Science 2025-06-24 Dror Chawin , Ishay Haviv

This work studies information-computation gaps for statistical problems. A common approach for providing evidence of such gaps is to show sample complexity lower bounds (that are stronger than the information-theoretic optimum) against…

Data Structures and Algorithms · Computer Science 2025-11-25 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Thanasis Pittas

We say that a classifier is \emph{adversarially robust} to perturbations of norm $r$ if, with high probability over a point $x$ drawn from the input distribution, there is no point within distance $\le r$ from $x$ that is classified…

Data Structures and Algorithms · Computer Science 2025-05-21 Jane Lange , Arsen Vasilyan

For $S \subseteq \{0,1\}^n$ a Boolean function $f \colon S \to \{-1,1\}$ is a polynomial threshold function (PTF) of degree $d$ and weight $W$ if there is a polynomial $p$ with integer coefficients of degree $d$ and with sum of absolute…

Computational Complexity · Computer Science 2022-12-22 Vladimir Podolskii , Nikolay V. Proskurin

The problem of learning $t$-term DNF formulas (for $t = O(1)$) has been studied extensively in the PAC model since its introduction by Valiant (STOC 1984). A $t$-term DNF can be efficiently learnt using a $t$-term DNF only if $t = 1$ i.e.,…

Computational Complexity · Computer Science 2019-11-18 Suprovat Ghoshal , Rishi Saket

This paper studies the fundamental limits of reinforcement learning (RL) in the challenging \emph{partially observable} setting. While it is well-established that learning in Partially Observable Markov Decision Processes (POMDPs) requires…

Machine Learning · Computer Science 2023-02-03 Fan Chen , Huan Wang , Caiming Xiong , Song Mei , Yu Bai

What kinds of functions are learnable from their satisfying assignments? Motivated by this simple question, we extend the framework of De, Diakonikolas, and Servedio [DDS15], which studied the learnability of probability distributions over…

Data Structures and Algorithms · Computer Science 2019-07-04 Clément L. Canonne , Anindya De , Rocco A. Servedio
‹ Prev 1 2 3 10 Next ›