English
Related papers

Related papers: Sublinear-query relative-error testing of halfspac…

200 papers

In recent years the framework of learning from label proportions (LLP) has been gaining importance in machine learning. In this setting, the training examples are aggregated into subsets or bags and only the average label per bag is…

Computational Complexity · Computer Science 2024-03-29 Venkatesan Guruswami , Rishi Saket

We study distribution-free property testing and learning problems where the unknown probability distribution is a product distribution over $\mathbb{R}^d$. For many important classes of functions, such as intersections of halfspaces,…

Data Structures and Algorithms · Computer Science 2021-11-17 Nathaniel Harms , Yuichi Yoshida

Let a Boolean function be available as a black-box (oracle) and one likes to devise an algorithm to test whether it has certain property or it is $\epsilon$-far from having that property. The efficiency of the algorithm is judged by the…

Quantum Physics · Physics 2013-06-27 Kaushik Chakraborty , Subhamoy Maitra

Motivated by applications to property testing in the online-erasure model of Kalemaj, Raskhodnikova, and Varma (ITCS 2022 and Theory of Computing 2023), we define and analyze {\em semi-sample-based testers} for Reed-Muller codes. The task…

Data Structures and Algorithms · Computer Science 2026-05-22 Esty Kelman , Uri Meir , Kai Zhe Zheng

The (low soundness) linearity testing problem for the middle slice of the Boolean cube is as follows. Let $\varepsilon>0$ and $f$ be a function on the middle slice on the Boolean cube, such that when choosing a uniformly random quadruple…

Combinatorics · Mathematics 2024-08-02 Gil Kalai , Noam Lifshitz , Dor Minzer , Tamar Ziegler

We give the first algorithm that is both query-efficient and time-efficient for testing whether an unknown function $f: \{0,1\}^n \to \{0,1\}$ is an $s$-sparse GF(2) polynomial versus $\eps$-far from every such polynomial. Our algorithm…

Computational Complexity · Computer Science 2008-05-14 Ilias Diakonikolas , Homin K. Lee , Kevin Matulef , Rocco A. Servedio , Andrew Wan

The noise sensitivity of a Boolean function $f: \{0,1\}^n \rightarrow \{0,1\}$ is one of its fundamental properties. A function of a positive noise parameter $\delta$, it is denoted as $NS_{\delta}[f]$. Here we study the algorithmic problem…

Data Structures and Algorithms · Computer Science 2019-04-16 Ronitt Rubinfeld , Arsen Vasilyan

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces under the Gaussian distribution on $R^d$ in the presence of some form of query access. In the classical pool-based active learning model, where the…

Machine Learning · Computer Science 2025-01-03 Ilias Diakonikolas , Daniel M. Kane , Mingchen Ma

Distribution testing is a fundamental statistical task with many applications, but we are interested in a variety of problems where systematic mislabelings of the sample prevent us from applying the existing theory. To apply distribution…

Data Structures and Algorithms · Computer Science 2023-04-05 Renato Ferreira Pinto , Nathaniel Harms

Sequential testing problems involve a complex system with several components, each of which is "working" with some independent probability. The outcome of each component can be determined by performing a test, which incurs some cost. The…

Data Structures and Algorithms · Computer Science 2023-08-22 Rohan Ghuge , Anupam Gupta , Viswanath Nagarajan

We study the problem of testing whether a function f:R^n->R is linear (i.e., both additive and homogeneous) in the distribution-free property testing model, where the distance between functions is measured with respect to an unknown…

Data Structures and Algorithms · Computer Science 2019-09-10 Noah Fleming , Yuichi Yoshida

We interpret likelihood-based test functions from a geometric perspective where the Kullback-Leibler (KL) divergence is adopted to quantify the distance from a distribution to another. Such a test function can be seen as a sub-Gaussian…

Information Theory · Computer Science 2021-01-05 Yan Wang

Given a property of Boolean functions, what is the minimum number of queries required to determine with high probability if an input function satisfies this property or is "far" from satisfying it? This is a fundamental question in Property…

Data Structures and Algorithms · Computer Science 2016-01-13 Noga Alon , Rani Hod , Amit Weinstein

We develop fast and memory efficient numerical methods for learning functions of many variables that admit sparse representations in terms of general bounded orthonormal tensor product bases. Such functions appear in many applications…

Numerical Analysis · Mathematics 2020-05-11 Bosu Choi , Mark Iwen , Felix Krahmer

We study the general problem of testing whether an unknown distribution belongs to a specified family of distributions. More specifically, given a distribution family $\mathcal{P}$ and sample access to an unknown discrete distribution…

Data Structures and Algorithms · Computer Science 2017-08-09 Clément L. Canonne , Ilias Diakonikolas , Alistair Stewart

A dimension reduction method based on the "Nonlinear Level set Learning" (NLL) approach is presented for the pointwise prediction of functions which have been sparsely sampled. Leveraging geometric information provided by the Implicit…

Machine Learning · Statistics 2021-08-10 Anthony Gruber , Max Gunzburger , Lili Ju , Yuankai Teng , Zhu Wang

Partial penalized tests provide flexible approaches to testing linear hypotheses in high dimensional generalized linear models. However, because the estimators used in these tests are local minimizers of potentially non-convex…

Statistics Theory · Mathematics 2024-08-02 Tate Jacobson

We describe a $\tilde{O}(d^{5/6})$-query monotonicity tester for Boolean functions $f:[n]^d \to \{0,1\}$ on the $n$-hypergrid. This is the first $o(d)$ monotonicity tester with query complexity independent of $n$. Motivated by this…

Discrete Mathematics · Computer Science 2019-12-11 Hadley Black , Deeparnab Chakrabarty , C. Seshadhri

We pose a fundamental question in computational learning theory: can we efficiently test whether a training set satisfies the assumptions of a given noise model? This question has remained unaddressed despite decades of research on learning…

Machine Learning · Computer Science 2026-05-11 Surbhi Goel , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We study the problem of agnostically learning halfspaces under the Gaussian distribution. Our main result is the {\em first proper} learning algorithm for this problem whose sample complexity and computational complexity qualitatively match…

Machine Learning · Computer Science 2021-02-11 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis