English
Related papers

Related papers: Sublinear-query relative-error testing of halfspac…

200 papers

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

Machine Learning · Computer Science 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

Given Boolean functions \( f, g : \mathbb{F}_2^n \to \{-1,+1\} \), we say they are {\em linearly isomorphic} if there exists \( A \in \mathrm{GL}_n(\mathbb{F}_2) \) such that \( f(x)=g(Ax) \) for all \( x \). We study this problem in the…

Computational Complexity · Computer Science 2026-01-14 Swarnalipa Datta , Arijit Ghosh , Chandrima Kayal , Manaswi Paraashar , Manmatha Roy

We consider the following basic inference problem: there is an unknown high-dimensional vector $w \in \mathbb{R}^n$, and an algorithm is given access to labeled pairs $(x,y)$ where $x \in \mathbb{R}^n$ is a measurement and $y = w \cdot x +…

Computational Complexity · Computer Science 2019-11-05 Xue Chen , Anindya De , Rocco A. Servedio

We define tests of boolean functions which distinguish between linear (or quadratic) polynomials, and functions which are very far, in an appropriate sense, from these polynomials. The tests have optimal or nearly optimal trade-offs between…

Combinatorics · Mathematics 2007-05-23 Alex Samorodnitsky

We present several new examples of speed-ups obtainable by quantum algorithms in the context of property testing. First, motivated by sampling algorithms, we consider probability distributions given in the form of an oracle $f:[n]\to[m]$.…

Quantum Physics · Physics 2010-05-13 Sourav Chakraborty , Eldar Fischer , Arie Matsliah , Ronald de Wolf

Property testers form an important class of sublinear algorithms. In the standard property testing model, an algorithm accesses the input function via an oracle that returns function values at all queried domain points. In many realistic…

Data Structures and Algorithms · Computer Science 2016-07-21 Kashyap Dixit , Sofya Raskhodnikova , Abhradeep Thakurta , Nithin Varma

We consider the problem of testing whether an unknown and arbitrary set $S \subseteq \mathbb{R}^n$ (given as a black-box membership oracle) is convex, versus $\varepsilon$-far from every convex set, under the standard Gaussian distribution.…

Computational Complexity · Computer Science 2024-10-24 Xi Chen , Anindya De , Shivam Nadimpalli , Rocco A. Servedio , Erik Waingarten

We revisit the fundamental problem of learning with distribution shift, in which a learner is given labeled samples from training distribution $D$, unlabeled samples from test distribution $D'$ and is asked to output a classifier with low…

Data Structures and Algorithms · Computer Science 2024-05-22 Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

One of the motivations for property testing of boolean functions is the idea that testing can serve as a preprocessing step before learning. However, in most machine learning applications, it is not possible to request for labels of…

Data Structures and Algorithms · Computer Science 2012-04-18 Maria-Florina Balcan , Eric Blais , Avrim Blum , Liu Yang

The framework of distribution testing is currently ubiquitous in the field of property testing. In this model, the input is a probability distribution accessible via independently drawn samples from an oracle. The testing task is to…

Data Structures and Algorithms · Computer Science 2022-09-22 Sourav Chakraborty , Eldar Fischer , Arijit Ghosh , Gopinath Mishra , Sayantan Sen

We study the task of agnostically learning halfspaces under the Gaussian distribution. Specifically, given labeled examples $(\mathbf{x},y)$ from an unknown distribution on $\mathbb{R}^n \times \{ \pm 1\}$, whose marginal distribution on…

Machine Learning · Computer Science 2023-02-14 Ilias Diakonikolas , Daniel M. Kane , Lisheng Ren

Rubinfeld & Vasilyan recently introduced the framework of testable learning as an extension of the classical agnostic model. It relaxes distributional assumptions which are difficult to verify by conditions that can be checked efficiently…

Machine Learning · Computer Science 2024-11-07 Lucas Slot , Stefan Tiegel , Manuel Wiedmer

We give a $\mathrm{poly}(\log n, 1/\epsilon)$-query adaptive algorithm for testing whether an unknown Boolean function $f: \{-1,1\}^n \to \{-1,1\}$, which is promised to be a halfspace, is monotone versus $\epsilon$-far from monotone. Since…

Computational Complexity · Computer Science 2017-06-20 Xi Chen , Rocco A. Servedio , Li-Yang Tan , Erik Waingarten

Sparsity is a basic property of real vectors that is exploited in a wide variety of applications. In this work, we describe property testing algorithms for sparsity that observe a low-dimensional projection of the input. We consider two…

Data Structures and Algorithms · Computer Science 2017-09-14 Siddharth Barman , Arnab Bhattacharyya , Suprovat Ghoshal

We consider the well-studied problem of learning intersections of halfspaces under the Gaussian distribution in the challenging \emph{agnostic learning} model. Recent work of Diakonikolas et al. (2021) shows that any Statistical Query (SQ)…

Machine Learning · Computer Science 2022-02-11 Daniel Hsu , Clayton Sanford , Rocco Servedio , Emmanouil-Vasileios Vlatakis-Gkaragkounis

We consider the problem of testing whether a Boolean function has Fourier degree $\leq k$ or it is $\epsilon$-far from any Boolean function with Fourier degree $\leq k$. We improve the known lower bound of $\Omega(k)$ \cite{BBM11,CGM10}, to…

Computational Complexity · Computer Science 2013-08-27 Pooya Hatami

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

We initiate a systematic study of the computational complexity of property testing, focusing on the relationship between query and time complexity. While traditional work in property testing has emphasized query complexity, relatively…

Computational Complexity · Computer Science 2026-03-12 Renato Ferreira Pinto , Diptaksho Palit , Sofya Raskhodnikova

Hypothesis testing procedures are developed to assess linear operator constraints in function-on-scalar regression when incomplete functional responses are observed. The approach enables statistical inferences about the shape and other…

Methodology · Statistics 2022-12-06 Yeonjoo Park , Kyunghee Han , Douglas G. Simpson

We study the problem of PAC learning halfspaces in the reliable agnostic model of Kalai et al. (2012). The reliable PAC model captures learning scenarios where one type of error is costlier than the others. Our main positive result is a new…

Machine Learning · Computer Science 2024-11-19 Ilias Diakonikolas , Lisheng Ren , Nikos Zarifis