English
Related papers

Related papers: Detecting Low-Degree Truncation

200 papers

We show how any PAC learning algorithm that works under the uniform distribution can be transformed, in a blackbox fashion, into one that works under an arbitrary and unknown distribution $\mathcal{D}$. The efficiency of our transformation…

Machine Learning · Statistics 2023-03-31 Guy Blanc , Jane Lange , Ali Malik , Li-Yang Tan

We consider the problem of distinguishing between two arbitrary black-box distributions defined over the domain [n], given access to $s$ samples from both. It is known that in the worst case O(n^{2/3}) samples is both necessary and…

Data Structures and Algorithms · Computer Science 2011-10-17 Eyal Even Dar , Mark Sandler

Partial differential equations (PDEs) with uncertain or random inputs have been considered in many studies of uncertainty quantification. In forward uncertainty quantification, one is interested in analyzing the stochastic response of the…

Numerical Analysis · Mathematics 2023-12-19 Philipp A. Guth , Vesa Kaarnioja

Many high-dimensional uncertainty quantification problems are solved by polynomial dimensional decomposition (PDD), which represents Fourier-like series expansion in terms of random orthonormal polynomials with increasing dimensions. This…

Numerical Analysis · Mathematics 2018-04-06 Sharif Rahman

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

Machine Learning · Computer Science 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

Polynomial regression is a basic primitive in learning and statistics. In its most basic form the goal is to fit a degree $d$ polynomial to a response variable $y$ in terms of an $n$-dimensional input vector $x$. This is extremely…

Data Structures and Algorithms · Computer Science 2020-04-30 Sitan Chen , Raghu Meka

Detecting out-of-distribution (OOD) samples is essential for ensuring the reliability of deep neural networks (DNNs) in real-world scenarios. While previous research has predominantly investigated the disparity between in-distribution (ID)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yingwen Wu , Tao Li , Xinwen Cheng , Jie Yang , Xiaolin Huang

We give a polynomial-time algorithm for learning high-dimensional halfspaces with margins in $d$-dimensional space to within desired TV distance when the ambient distribution is an unknown affine transformation of the $d$-fold product of an…

Machine Learning · Computer Science 2023-11-03 Xinyuan Cao , Santosh S. Vempala

We consider the problem of testing whether an unknown low-degree polynomial $p$ over $\mathbb{R}^n$ is sparse versus far from sparse, given access to noisy evaluations of the polynomial $p$ at \emph{randomly chosen points}. This is a…

Data Structures and Algorithms · Computer Science 2025-11-12 Yiqiao Bao , Anindya De , Shivam Nadimpalli , Rocco A. Servedio , Nathan White

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

Machine Learning · Computer Science 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

Out-of-distribution (OOD) detection is a critical issue for the stable and reliable operation of systems using a deep neural network (DNN). Although many OOD detection methods have been proposed, it remains unclear how the differences…

Machine Learning · Computer Science 2024-10-30 Kazuki Uematsu , Kosuke Haruki , Taiji Suzuki , Mitsuhiro Kimura , Takahiro Takimoto , Hideyuki Nakagawa

Classification tasks present challenges due to class imbalances and evolving data distributions. Addressing these issues requires a robust method to handle imbalances while effectively detecting out-of-distribution (OOD) samples not…

Machine Learning · Computer Science 2024-09-05 Priyanka Chudasama , Anil Surisetty , Aakarsh Malhotra , Alok Singh

A low-degree test is a collection of simple, local rules for checking the proximity of an arbitrary function to a low-degree polynomial. Each rule depends on the function's values at a small number of places. If a function satisfies many…

Computational Complexity · Computer Science 2013-07-16 Katalin Friedl , Madhu Sudan

Decentralized stochastic gradient descent (D-SGD) is an efficient method for large-scale distributed learning. Existing generalization studies mainly address expected results, achieving rates limited to $\mathcal{O}\left(\frac{1}{\delta…

Machine Learning · Computer Science 2026-05-12 Jiahuan Wang , Ping Luo , Ziqing Wen , Dongsheng Li , Tao Sun

We consider the problem of PAC-learning decision trees, i.e., learning a decision tree over the n-dimensional hypercube from independent random labeled examples. Despite significant effort, no polynomial-time algorithm is known for learning…

Machine Learning · Computer Science 2008-12-05 Adam Tauman Kalai , Shang-Hua Teng

Deep Learning (DL) models tend to perform poorly when the data comes from a distribution different from the training one. In critical applications such as medical imaging, out-of-distribution (OOD) detection helps to identify such data…

Image and Video Processing · Electrical Eng. & Systems 2023-06-26 Daria Frolova , Anton Vasiliuk , Mikhail Belyaev , Boris Shirokikh

We study the problem of out-of-distribution dynamics (OODD) detection, which involves detecting when the dynamics of a temporal process change compared to the training-distribution dynamics. This is relevant to applications in control,…

Machine Learning · Computer Science 2022-05-25 Mohamad H Danesh , Alan Fern

We study the density estimation problem defined as follows: given $k$ distributions $p_1, \ldots, p_k$ over a discrete domain $[n]$, as well as a collection of samples chosen from a ``query'' distribution $q$ over $[n]$, output $p_i$ that…

Data Structures and Algorithms · Computer Science 2024-10-31 Anders Aamand , Alexandr Andoni , Justin Y. Chen , Piotr Indyk , Shyam Narayanan , Sandeep Silwal , Haike Xu

We provide improved differentially private algorithms for identity testing of high-dimensional distributions. Specifically, for $d$-dimensional Gaussian distributions with known covariance $\Sigma$, we can test whether the distribution…

Data Structures and Algorithms · Computer Science 2022-07-26 Shyam Narayanan