English
Related papers

Related papers: Cryptographic Hardness of Score Estimation

200 papers

Gaussian process regression is a powerful Bayesian nonlinear regression method. Recent research has enabled the capture of many types of observations using non-Gaussian likelihoods. To deal with various tasks in spatial modeling, we benefit…

Machine Learning · Statistics 2025-08-26 Yuta Shikuri

The discrete Gaussian $D_{L- t, s}$ is the distribution that assigns to each vector $x$ in a shifted lattice $L - t$ probability proportional to $e^{-\pi \|x\|^2/s^2}$. It has long been an important tool in the study of lattices. More…

Computational Complexity · Computer Science 2019-01-28 Noah Stephens-Davidowitz

The increased use of cryptography to protect our personal information makes us want to understand the security of cryptosystems. The security of many cryptosystems relies on solving the discrete logarithm, which is thought to be relatively…

Cryptography and Security · Computer Science 2016-09-27 Mitchell Orzech

Many high-dimensional statistical inference problems are believed to possess inherent computational hardness. Various frameworks have been proposed to give rigorous evidence for such hardness, including lower bounds against restricted…

Score-based methods, such as diffusion models and Bayesian inverse problems, are often interpreted as learning the data distribution in the low-noise limit ($\sigma \to 0$). In this work, we propose an alternative perspective: their success…

Machine Learning · Statistics 2026-03-17 Xiang Li , Zebang Shen , Ya-Ping Hsieh , Niao He

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

Score matching is a popular method for estimating unnormalized statistical models. However, it has been so far limited to simple, shallow models or low-dimensional data, due to the difficulty of computing the Hessian of log-density…

Machine Learning · Computer Science 2019-06-28 Yang Song , Sahaj Garg , Jiaxin Shi , Stefano Ermon

We develop a principled way of identifying probability distributions whose independent and identically distributed (iid) realizations are compressible, i.e., can be well-approximated as sparse. We focus on Gaussian random underdetermined…

Statistics Theory · Mathematics 2012-04-27 Rémi Gribonval , Volkan Cevher , Mike E. Davies

We give a highly efficient "semi-agnostic" algorithm for learning univariate probability distributions that are well approximated by piecewise polynomial density functions. Let $p$ be an arbitrary distribution over an interval $I$ which is…

Machine Learning · Computer Science 2013-05-15 Siu-On Chan , Ilias Diakonikolas , Rocco A. Servedio , Xiaorui Sun

In this paper, we provide new complexity results for algorithms that learn discrete-variable Bayesian networks from data. Our results apply whenever the learning algorithm uses a scoring criterion that favors the simplest model able to…

Machine Learning · Computer Science 2012-12-12 David Maxwell Chickering , Christopher Meek , David Heckerman

A fundamental problem in computer science is to find all the common zeroes of $m$ quadratic polynomials in $n$ unknowns over $\mathbb{F}_2$. The cryptanalysis of several modern ciphers reduces to this problem. Up to now, the best complexity…

Symbolic Computation · Computer Science 2015-03-19 Magali Bardet , Jean-Charles Faugère , Bruno Salvy , Pierre-Jean Spaenlehauer

We study the problem of robust estimation under heterogeneous corruption rates, where each sample may be independently corrupted with a known but non-identical probability. This setting arises naturally in distributed and federated…

Machine Learning · Computer Science 2025-10-02 Syomantak Chaudhuri , Jerry Li , Thomas A. Courtade

Recent oracle separations [Kretschmer, TQC'21, Kretschmer et. al., STOC'23] have raised the tantalizing possibility of building quantum cryptography from sources of hardness that persist even if the polynomial hierarchy collapses. We…

Quantum Physics · Physics 2024-10-11 Dakshita Khurana , Kabir Tomer

Safe artificial intelligence for perception tasks remains a major challenge, partly due to the lack of data with high-quality labels. Annotations themselves are subject to aleatoric and epistemic uncertainty, which is typically ignored…

Machine Learning · Computer Science 2026-02-05 Jonathan Klees , Tobias Riedlinger , Peter Stehr , Bennet Böddecker , Daniel Kondermann , Matthias Rottmann

Gaussian graphical models are widely used to represent correlations among entities but remain vulnerable to data corruption. In this work, we introduce a modified trimmed-inner-product algorithm to robustly estimate the covariance in an…

Machine Learning · Computer Science 2023-09-19 Tong Yao , Shreyas Sundaram

Likelihood analysis is typically limited to normally distributed noise due to the difficulty of determining the probability density function of complex, high-dimensional, non-Gaussian, and anisotropic noise. This is a major limitation for…

Instrumentation and Methods for Astrophysics · Physics 2023-06-14 Ronan Legin , Alexandre Adam , Yashar Hezaveh , Laurence Perreault Levasseur

The distance from calibration, introduced by B{\l}asiok, Gopalan, Hu, and Nakkiran (STOC 2023), has recently emerged as a central measure of miscalibration for probabilistic predictors. We study the fundamental problems of computing and…

Data Structures and Algorithms · Computer Science 2026-03-20 Mingda Qiao

We develop a penalized likelihood estimation framework to estimate the structure of Gaussian Bayesian networks from observational data. In contrast to recent methods which accelerate the learning problem by restricting the search space, our…

Methodology · Statistics 2015-12-24 Bryon Aragam , Qing Zhou

The problem of low-rank matrix completion with heterogeneous and sub-exponential (as opposed to homogeneous and Gaussian) noise is particularly relevant to a number of applications in modern commerce. Examples include panel sales data and…

Machine Learning · Statistics 2021-10-26 Vivek F. Farias , Andrew A. Li , Tianyi Peng

We show hardness of improperly learning halfspaces in the agnostic model, both in the distribution-independent as well as the distribution-specific setting, based on the assumption that worst-case lattice problems, such as GapSVP or SIVP,…

Machine Learning · Computer Science 2023-02-21 Stefan Tiegel