English
Related papers

Related papers: PTF Testing Lower Bounds for Non-Gaussian Componen…

200 papers

Non-Gaussian Component Analysis (NGCA) is the statistical task of finding a non-Gaussian direction in a high-dimensional dataset. Specifically, given i.i.d.\ samples from a distribution $P^A_{v}$ on $\mathbb{R}^n$ that behaves like a known…

Machine Learning · Computer Science 2024-10-30 Ilias Diakonikolas , Sushrut Karmalkar , Shuo Pang , Aaron Potechin

Low-degree polynomials have emerged as a powerful paradigm for providing evidence of statistical-computational gaps across a variety of high-dimensional statistical models [Wein25]. For detection problems -- where the goal is to test a…

Machine Learning · Statistics 2026-01-06 Alexandra Carpentier , Simone Maria Giancola , Christophe Giraud , Nicolas Verzelen

We study the complexity of Non-Gaussian Component Analysis (NGCA) in the Statistical Query (SQ) model. Prior work developed a general methodology to prove SQ lower bounds for this task that have been applicable to a wide range of contexts.…

Machine Learning · Computer Science 2024-03-08 Ilias Diakonikolas , Daniel Kane , Lisheng Ren , Yuxin Sun

The problem of Non-Gaussian Component Analysis (NGCA) is about finding a maximal low-dimensional subspace $E$ in $\mathbb{R}^n$ so that data points projected onto $E$ follow a non-gaussian distribution. Although this is an appropriate model…

Machine Learning · Computer Science 2017-04-05 Yan Shuo Tan , Roman Vershynin

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Non-Gaussian component analysis (NGCA) is a problem in multidimensional data analysis which, since its formulation in 2006, has attracted considerable attention in statistics and machine learning. In this problem, we have a random variable…

Machine Learning · Computer Science 2019-07-25 Navin Goyal , Abhishek Shetty

Researchers currently use a number of approaches to predict and substantiate information-computation gaps in high-dimensional statistical estimation problems. A prominent approach is to characterize the limits of restricted models of…

Computational Complexity · Computer Science 2021-06-29 Matthew Brennan , Guy Bresler , Samuel B. Hopkins , Jerry Li , Tselil Schramm

Non-Gaussian Component Analysis (NGCA) is the following distribution learning problem: Given i.i.d. samples from a distribution on $\mathbb{R}^d$ that is non-gaussian in a hidden direction $v$ and an independent standard Gaussian in the…

Data Structures and Algorithms · Computer Science 2021-12-17 Ilias Diakonikolas , Daniel M. Kane

This is a survey on the use of low-degree polynomials to predict and explain the apparent statistical-computational tradeoffs in a variety of average-case computational problems. In a nutshell, this framework measures the complexity of a…

Statistics Theory · Mathematics 2025-06-13 Alexander S. Wein

In this note, we propose a framework for proving computational lower bounds in norm approximation by leveraging a reverse detection--estimation gap. The starting point is a testing problem together with an estimator whose error is…

Statistics Theory · Mathematics 2026-04-07 Runshi Tang , Yuefeng Han , Anru R. Zhang

Bandeira et al. (2022) introduced the Franz-Parisi (FP) criterion for characterizing the computational hard phases in statistical detection problems. The FP criterion, based on an annealed version of the celebrated Franz-Parisi potential…

Statistics Theory · Mathematics 2025-06-09 Siyu Chen , Theodor Misiakiewicz , Ilias Zadik , Peiyuan Zhang

We give the first non-trivial upper bounds on the average sensitivity and noise sensitivity of degree-$d$ polynomial threshold functions (PTFs). These bounds hold both for PTFs over the Boolean hypercube and for PTFs over $\R^n$ under the…

Computational Complexity · Computer Science 2009-10-19 Ilias Diakonikolas , Prasad Raghavendra , Rocco A. Servedio , Li-Yang Tan

We give a deterministic algorithm for approximately counting satisfying assignments of a degree-$d$ polynomial threshold function (PTF). Given a degree-$d$ input polynomial $p(x_1,\dots,x_n)$ over $R^n$ and a parameter $\epsilon> 0$, our…

Computational Complexity · Computer Science 2013-12-02 Anindya De , Rocco Servedio

In many high-dimensional problems, like sparse-PCA, planted clique, or clustering, the best known algorithms with polynomial time complexity fail to reach the statistical performance provably achievable by algorithms free of computational…

Statistics Theory · Mathematics 2025-06-17 Bertrand Even , Christophe Giraud , Nicolas Verzelen

We study when low coordinate degree functions (LCDF) -- linear combinations of functions depending on small subsets of entries of a vector -- can hypothesis test between high-dimensional probability measures. These functions are a…

Statistics Theory · Mathematics 2024-03-13 Dmitriy Kunisky

We study the efficient learnability of geometric concept classes - specifically, low-degree polynomial threshold functions (PTFs) and intersections of halfspaces - when a fraction of the data is adversarially corrupted. We give the first…

Machine Learning · Computer Science 2017-07-06 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Non-gaussian component analysis (NGCA) introduced in offered a method for high dimensional data analysis allowing for identifying a low-dimensional non-Gaussian component of the whole distribution in an iterative and structure adaptive way.…

Statistics Theory · Mathematics 2009-04-24 Elmar Diederichs , Anatoli Juditsky , Vladimir Spokoiny , Christof Schuette

Given a single observation from a Gaussian distribution with unknown mean $\theta$, we design computationally efficient procedures that can approximately generate an observation from a different target distribution $Q_{\theta}$ uniformly…

Statistics Theory · Mathematics 2025-10-09 Mengqi Lou , Guy Bresler , Ashwin Pananjady

The quantum statistics mechanism is very powerful for investigating the equilibrium states and the phase transitions in complex spin disorder systems. The spin disorder systems act as an interdisciplinary platform for solving the optimum…

General Physics · Physics 2025-06-17 Zhidong Zhang

Hardness results for maximum agreement problems have close connections to hardness results for proper learning in computational learning theory. In this paper we prove two hardness results for the problem of finding a low degree polynomial…

Machine Learning · Computer Science 2010-10-19 Ilias Diakonikolas , Ryan O'Donnell , Rocco A. Servedio , Yi Wu
‹ Prev 1 2 3 10 Next ›