English
Related papers

Related papers: Hardness Results for Agnostically Learning Low-Deg…

200 papers

The UNIQUE GAMES problem is a central problem in algorithms and complexity theory. Given an instance of UNIQUE GAMES, the STRONG UNIQUE GAMES problem asks to find the largest subset of vertices, such that the UNIQUE GAMES instance induced…

Data Structures and Algorithms · Computer Science 2020-05-19 Suprovat Ghoshal , Anand Louis

The low-degree polynomial framework has been highly successful in predicting computational versus statistical gaps for high-dimensional problems in average-case analysis and machine learning. This success has led to the low-degree…

Machine Learning · Statistics 2026-03-04 He Jia , Aravindan Vijayaraghavan

The hardcore model is a model of lattice gas systems which has received much attention in statistical physics, probability theory and theoretical computer science. It is the probability distribution over independent sets $I$ of a graph…

Computational Complexity · Computer Science 2010-06-01 Allan Sly

Contrastive learning is a powerful technique for discovering meaningful data representations by optimizing objectives based on $\textit{contrastive information}$, often given as a set of weighted triplets $\{(x_i, y_i^+, z_{i}^-)\}_{i =…

Machine Learning · Computer Science 2025-09-23 Jingming Yan , Yiyuan Luo , Vaggos Chatziafratis , Ioannis Panageas , Parnian Shahkar , Stelios Stavroulakis

We give a {\em deterministic} algorithm for approximately computing the fraction of Boolean assignments that satisfy a degree-$2$ polynomial threshold function. Given a degree-2 input polynomial $p(x_1,\dots,x_n)$ and a parameter $\eps >…

Computational Complexity · Computer Science 2013-11-28 Anindya De , Ilias Diakonikolas , Rocco A. Servedio

In recent years the framework of learning from label proportions (LLP) has been gaining importance in machine learning. In this setting, the training examples are aggregated into subsets or bags and only the average label per bag is…

Computational Complexity · Computer Science 2024-03-29 Venkatesan Guruswami , Rishi Saket

Reinforcement learning with function approximation has recently achieved tremendous results in applications with large state spaces. This empirical success has motivated a growing body of theoretical work proposing necessary and sufficient…

Machine Learning · Computer Science 2022-07-05 Daniel Kane , Sihan Liu , Shachar Lovett , Gaurav Mahajan

We consider the question of approximating Max 2-CSP where each variable appears in at most $d$ constraints (but with possibly arbitrarily large alphabet). There is a simple $(\frac{d+1}{2})$-approximation algorithm for the problem. We prove…

Data Structures and Algorithms · Computer Science 2023-09-11 Euiwoong Lee , Pasin Manurangsi

We say that a function is rare-case hard against a given class of algorithms (the adversary) if all algorithms in the class can compute the function only on an $o(1)$-fraction of instances of size $n$ for large enough $n$. Starting from any…

Computational Complexity · Computer Science 2025-02-11 Tejas Nareddy , Abhishek Mishra

The seminar assignment problem is a variant of the generalized assignment problem in which items have unit size and the amount of space allowed in each bin is restricted to an arbitrary set of values. The problem has been shown to be…

Data Structures and Algorithms · Computer Science 2016-10-18 Amotz Bar-Noy , George Rabanca

Polynomial approximations to boolean functions have led to many positive results in computer science. In particular, polynomial approximations to the sign function underly algorithms for agnostically learning halfspaces, as well as…

Computational Complexity · Computer Science 2014-12-09 Mark Bun , Thomas Steinke

An approximation algorithm for a constraint satisfaction problem is called robust if it outputs an assignment satisfying a $(1 - f(\epsilon))$-fraction of the constraints on any $(1-\epsilon)$-satisfiable instance, where the loss function…

Data Structures and Algorithms · Computer Science 2022-11-09 Antoine Méot , Arnaud de Mesmay , Moritz Mühlenthaler , Alantha Newman

We study when low coordinate degree functions (LCDF) -- linear combinations of functions depending on small subsets of entries of a vector -- can hypothesis test between high-dimensional probability measures. These functions are a…

Statistics Theory · Mathematics 2024-03-13 Dmitriy Kunisky

We show that for all $\varepsilon>0$, for sufficiently large $q\in\mathbb{N}$ power of $2$, for all $\delta>0$, it is NP-hard to distinguish whether a given $2$-Prover-$1$-Round projection game with alphabet size $q$ has value at least…

Computational Complexity · Computer Science 2026-05-15 Dor Minzer , Kai Zhe Zheng

We develop an extension of recently developed methods for obtaining time-space tradeoff lower bounds for problems of learning from random test samples to handle the situation where the space of tests is signficantly smaller than the space…

Machine Learning · Computer Science 2017-08-10 Paul Beame , Shayan Oveis Gharan , Xin Yang

We show that there is a randomized algorithm that, when given a small constant-depth Boolean circuit $C$ made up of gates that compute constant-degree Polynomial Threshold functions or PTFs (i.e., Boolean functions that compute signs of…

Computational Complexity · Computer Science 2018-09-18 Swapnam Bajpai , Vaibhav Krishan , Deepanshu Kush , Nutan Limaye , Srikanth Srinivasan

We study the hardness of approximation of clause minimum and literal minimum representations of pure Horn functions in $n$ Boolean variables. We show that unless P=NP, it is not possible to approximate in polynomial time the minimum number…

Computational Complexity · Computer Science 2014-03-12 Endre Boros , Aritanan Gruber

Reinforcement Learning (RL) has demonstrated tremendous empirical success across numerous challenging domains. However, we lack a strong theoretical understanding of the statistical complexity of RL in environments with large state spaces,…

Machine Learning · Computer Science 2025-06-03 Gene Li

The basic problem in the PAC model of computational learning theory is to determine which hypothesis classes are efficiently learnable. There is presently a dearth of results showing hardness of learning problems. Moreover, the existing…

Machine Learning · Computer Science 2014-03-11 Amit Daniely , Nati Linial , Shai Shalev-Shwartz

We introduce a practical method to enforce partial differential equation (PDE) constraints for functions defined by neural networks (NNs), with a high degree of accuracy and up to a desired tolerance. We develop a differentiable…

Machine Learning · Computer Science 2023-04-19 Geoffrey Négiar , Michael W. Mahoney , Aditi S. Krishnapriyan