English
Related papers

Related papers: The Quasi-Polynomial Low-Degree Conjecture is Fals…

200 papers

We explore why many recently proposed robust estimation problems are efficiently solvable, even though the underlying optimization problems are non-convex. We study the loss landscape of these robust estimation problems, and identify the…

Machine Learning · Statistics 2020-05-29 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

We study the question of local testability of low (constant) degree functions from a product domain $S_1 \times \dots \times {S}_n$ to a field $\mathbb{F}$, where ${S_i} \subseteq \mathbb{F}$ can be arbitrary constant sized sets. We show…

Computational Complexity · Computer Science 2024-11-12 Prashanth Amireddy , Srikanth Srinivasan , Madhu Sudan

We prove an entropy versus degree dichotomy for low-degree tests and the Sum-of-Squares (SoS) hierarchy on a calibrated window after a gadget layer. For a target distribution \(\mu\) and a product-like proxy \(u\), we study the low-degree…

Computational Complexity · Computer Science 2025-09-30 Marko Lela

Multi-objective optimization (MOO) is receiving more attention in various fields such as multi-task learning. Recent works provide some effective algorithms with theoretical analysis but they are limited by the standard $L$-smooth or…

Machine Learning · Computer Science 2025-03-11 Qi Zhang , Peiyao Xiao , Shaofeng Zou , Kaiyi Ji

We revisit the fundamental problem of learning with distribution shift, in which a learner is given labeled samples from training distribution $D$, unlabeled samples from test distribution $D'$ and is asked to output a classifier with low…

Data Structures and Algorithms · Computer Science 2024-05-22 Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

The planted densest subgraph detection problem refers to the task of testing whether in a given (random) graph there is a subgraph that is unusually dense. Specifically, we observe an undirected and unweighted graph on $n$ vertices. Under…

Data Structures and Algorithms · Computer Science 2024-05-06 Wasim Huleihel , Arya Mazumdar , Soumyabrata Pal

We give a quasipolynomial-time algorithm for learning stochastic decision trees that is optimally resilient to adversarial noise. Given an $\eta$-corrupted set of uniform random samples labeled by a size-$s$ stochastic decision tree, our…

Machine Learning · Computer Science 2021-05-11 Guy Blanc , Jane Lange , Li-Yang Tan

We propose a novel nonparametric online predictor for discrete labels conditioned on multivariate continuous features. The predictor is based on a feature space discretization induced by a full-fledged k-d tree with randomly picked…

Machine Learning · Computer Science 2020-02-03 Alix Lhéritier , Frédéric Cazals

Zeroth-order optimization aims to minimize an objective function using only function evaluations, and is therefore fundamental in black-box optimization, hyperparameter tuning, bandit learning, and adversarial machine learning. While…

Optimization and Control · Mathematics 2026-04-28 Haishan Ye

We prove that it is NP-hard to properly PAC learn decision trees with queries, resolving a longstanding open problem in learning theory (Bshouty 1993; Guijarro-Lavin-Raghavan 1999; Mehta-Raghavan 2002; Feldman 2016). While there has been a…

Computational Complexity · Computer Science 2023-07-11 Caleb Koch , Carmen Strassle , Li-Yang Tan

An open problem that is widely regarded as one of the most important in quantum query complexity is to resolve the quantum query complexity of the k-distinctness function on inputs of size N. While the case of k=2 (also called Element…

Quantum Physics · Physics 2023-03-15 Nikhil S. Mande , Justin Thaler , Shuchen Zhu

We consider the problem of Robust PCA in the fully and partially observed settings. Without corruptions, this is the well-known matrix completion problem. From a statistical standpoint this problem has been recently well-studied, and…

Information Theory · Computer Science 2016-09-20 Xinyang Yi , Dohyung Park , Yudong Chen , Constantine Caramanis

Let $f$ be a polynomial of degree $d$ in $n$ variables over a finite field $\mathbb{F}$. The polynomial is said to be unbiased if the distribution of $f(x)$ for a uniform input $x \in \mathbb{F}^n$ is close to the uniform distribution over…

Discrete Mathematics · Computer Science 2022-01-21 Abhishek Bhowmick , Shachar Lovett

In this set of three companion manuscripts/articles, we unveil our new results on primality testing and reveal new primality testing algorithms enabled by those results. The results have been classified (and referred to) as…

Cryptography and Security · Computer Science 2019-08-21 Dhananjay Phatak , Alan T. Sherman , Steven D. Houston , Andrew Henry

We consider low-space algorithms for the classic Element Distinctness problem: given an array of $n$ input integers with $O(\log n)$ bit-length, decide whether or not all elements are pairwise distinct. Beame, Clifford, and Machmouchi [FOCS…

Data Structures and Algorithms · Computer Science 2021-11-03 Lijie Chen , Ce Jin , R. Ryan Williams , Hongxun Wu

We give a new framework for proving the existence of low-degree, polynomial approximators for Boolean functions with respect to broad classes of non-product distributions. Our proofs use techniques related to the classical moment problem…

Computational Complexity · Computer Science 2013-01-07 Adam Klivans , Raghu Meka

We study active learning of homogeneous $s$-sparse halfspaces in $\mathbb{R}^d$ under the setting where the unlabeled data distribution is isotropic log-concave and each label is flipped with probability at most $\eta$ for a parameter $\eta…

Machine Learning · Computer Science 2021-08-16 Chicheng Zhang , Jie Shen , Pranjal Awasthi

Dimensionality reduction is a crucial step for pattern recognition and data mining tasks to overcome the curse of dimensionality. Principal component analysis (PCA) is a traditional technique for unsupervised dimensionality reduction, which…

Machine Learning · Computer Science 2017-05-04 Zan Gao , Guotai Zhang , Feiping Nie , Hua Zhang

We introduce the problem of learning mixtures of $k$ subcubes over $\{0,1\}^n$, which contains many classic learning theory problems as a special case (and is itself a special case of others). We give a surprising $n^{O(\log k)}$-time…

Machine Learning · Computer Science 2019-02-20 Sitan Chen , Ankur Moitra

Let $\mathrm{R}$ be a real closed field. We prove that for any fixed $d$, the equivariant rational cohomology groups of closed symmetric semi-algebraic subsets of $\mathrm{R}^k$ defined by polynomials of degrees bounded by $d$ vanishes in…

Algebraic Topology · Mathematics 2018-02-15 Saugata Basu , Cordian Riener