English
Related papers

Related papers: Hardness Results for Agnostically Learning Low-Deg…

200 papers

It is shown that a class of optical physical unclonable functions (PUFs) can be learned to arbitrary precision with arbitrarily high probability, even in the presence of noise, given access to polynomially many challenge-response pairs and…

Machine Learning · Computer Science 2023-09-08 Apollo Albright , Boris Gelfand , Michael Dixon

We prove that the most natural low-degree test for polynomials over finite fields is ``robust'' in the high-error regime for linear-sized fields. Specifically we consider the ``local'' agreement of a function $f: \mathbb{F}_q^m \to…

Computational Complexity · Computer Science 2023-11-22 Prahladh Harsha , Mrinal Kumar , Ramprasad Saptharishi , Madhu Sudan

Embedding-based representations in Euclidean space $\mathbb{R}^d$ are a cornerstone of modern machine learning, where a major goal is to use the \emph{smallest dimension} that faithfully captures data relations. In this work, we prove sharp…

Data Structures and Algorithms · Computer Science 2026-05-06 Dionysis Arvanitakis , Vaggos Chatziafratis , Yiyuan Luo

We prove the #P-hardness of the counting problems associated with various satisfiability, graph and combinatorial problems, when restricted to planar instances. These problems include \begin{romannum} \item[{}] {\sc 3Sat, 1-3Sat, 1-Ex3Sat,…

Computational Complexity · Computer Science 2007-05-23 Harry B. Hunt , Madhav V. Marathe , Venkatesh Radhakrishnan , Richard E. Stearns

Two models were recently proposed to explore the robust hardness of Gr\"obner basis computation. Given a polynomial system, both models allow an algorithm to selectively ignore some of the polynomials: the algorithm is only responsible for…

Symbolic Computation · Computer Science 2018-07-18 Gwen Spencer

A fundamental question in reinforcement learning theory is: suppose the optimal value functions are linear in given features, can we learn them efficiently? This problem's counterpart in supervised learning, linear regression, can be solved…

Machine Learning · Computer Science 2023-02-28 Daniel Kane , Sihan Liu , Shachar Lovett , Gaurav Mahajan , Csaba Szepesvári , Gellért Weisz

We study the problem of agnostically learning halfspaces which is defined by a fixed but unknown distribution $\mathcal{D}$ on $\mathbb{Q}^n\times \{\pm 1\}$. We define $\mathrm{Err}_{\mathrm{HALF}}(\mathcal{D})$ as the least error of a…

Computational Complexity · Computer Science 2016-03-15 Amit Daniely

We study the task of bandit learning, also known as best-arm identification, under the assumption that the true reward function f belongs to a known, but arbitrary, function class F. We seek a general theory of bandit learnability, akin to…

Machine Learning · Computer Science 2025-06-18 Nataly Brukhim , Aldo Pacchiano , Miroslav Dudik , Robert Schapire

Let $\mathscr{F}_{n,d}$ be the class of all functions $f:\{-1,1\}^n\to[-1,1]$ on the $n$-dimensional discrete hypercube of degree at most $d$. In the first part of this paper, we prove that any (deterministic or randomized) algorithm which…

Machine Learning · Computer Science 2024-10-23 Alexandros Eskenazis , Paata Ivanisvili , Lauritz Streck

We study the problem of agnostic learning under the Gaussian distribution. We develop a method for finding hard families of examples for a wide class of problems by using LP duality. For Boolean-valued concept classes, we show that the…

Machine Learning · Computer Science 2021-02-09 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas , Nikos Zarifis

In this paper, we establish hardness and approximation results for various $L_p$-ball constrained homogeneous polynomial optimization problems, where $p \in [2,\infty]$. Specifically, we prove that for any given $d \ge 3$ and $p \in…

Optimization and Control · Mathematics 2012-11-01 Ke Hou , Anthony Man-Cho So

We design new polynomials for representing threshold functions in three different regimes: probabilistic polynomials of low degree, which need far less randomness than previous constructions, polynomial threshold functions (PTFs) with…

Data Structures and Algorithms · Computer Science 2016-08-16 Josh Alman , Timothy M. Chan , Ryan Williams

The concept class of low-degree polynomial threshold functions (PTFs) plays a fundamental role in machine learning. In this paper, we study PAC learning of $K$-sparse degree-$d$ PTFs on $\mathbb{R}^n$, where any such concept depends only on…

Data Structures and Algorithms · Computer Science 2024-03-20 Shiwei Zeng , Jie Shen

Over the past decade, the low-degree heuristic has been used to estimate the algorithmic thresholds for a wide range of average-case planted vs null distinguishing problems. Such results rely on the hypothesis that if the low-degree moments…

Computational Complexity · Computer Science 2026-01-12 Jun-Ting Hsieh , Daniel M. Kane , Pravesh K. Kothari , Jerry Li , Sidhanth Mohanty , Stefan Tiegel

If a two-player social welfare maximization problem does not admit a PTAS, we prove that any maximal-in-range truthful mechanism that runs in polynomial time cannot achieve an approximation factor better than 1/2. Moreover, for the k-player…

Computer Science and Game Theory · Computer Science 2009-12-18 Shaddin Dughmi , Hu Fu , Robert Kleinberg

We study the optimization problem faced by a perfectly informed principal in a Bayesian game, who reveals information to the players about the state of nature to obtain a desirable equilibrium. This signaling problem is the natural design…

Computer Science and Game Theory · Computer Science 2016-11-01 Umang Bhaskar , Yu Cheng , Young Kun Ko , Chaitanya Swamy

This thesis investigates the extent to which the optimal value of a constraint satisfaction problem (CSP) can be approximated by some sentence of fixed point logic with counting (FPC). It is known that, assuming $\mathsf{P} \neq…

Logic in Computer Science · Computer Science 2020-08-10 Jamie Tucker-Foltz

We establish new hardness results for decision tree optimization problems, adding to a line of work that dates back to Hyafil and Rivest in 1976. We prove, under randomized ETH, superpolynomial lower bounds for two basic problems: given an…

Computational Complexity · Computer Science 2022-10-13 Caleb Koch , Carmen Strassle , Li-Yang Tan

Recent work by Atserias and Dawar (J. Log. Comp 2019) and Tucker-Foltz (LMCS 2024) has established undefinability results in fixed-point logic with counting (FPC) corresponding to many classical complexity results from the hardness of…

Logic in Computer Science · Computer Science 2026-03-03 Anuj Dawar , Bálint Molnár

We prove that unless P=NP, there exists no polynomial time (or even pseudo-polynomial time) algorithm that can test whether the optimal value of a nonlinear optimization problem where the objective and constraints are given by low-degree…

Optimization and Control · Mathematics 2019-05-01 Amir Ali Ahmadi , Jeffrey Zhang