English
Related papers

Related papers: A Probabilistic Subspace Bound with Application to…

200 papers

The task of compressed sensing is to recover a sparse vector from a small number of linear and non-adaptive measurements, and the problem of finding a suitable measurement matrix is very important in this field. While most recent works…

Information Theory · Computer Science 2012-12-18 Yi-Zheng Fan , Tao Huang , Ming Zhu

Intuitively, one would expect accuracy of a trained neural network's prediction on test samples to correlate with how densely the samples are surrounded by seen training samples in representation space. We find that a bound on empirical…

Machine Learning · Computer Science 2022-07-29 Xu Ji , Razvan Pascanu , Devon Hjelm , Balaji Lakshminarayanan , Andrea Vedaldi

We consider best approximation problems in a nonlinear subset $\mathcal{M}$ of a Banach space of functions $(\mathcal{V},\|\bullet\|)$. The norm is assumed to be a generalization of the $L^2$-norm for which only a weighted Monte Carlo…

Numerical Analysis · Mathematics 2021-05-13 Martin Eigel , Reinhold Schneider , Philipp Trunschke

We consider ensembles of real symmetric band matrices with entries drawn from an infinite sequence of exchangeable random variables, as far as the symmetry of the matrices permits. In general the entries of the upper triangular parts of…

Probability · Mathematics 2020-01-22 Werner Kirsch , Thomas Kriecherbauer

Conventional Monte Carlo simulations are stochastic in the sense that the acceptance of a trial move is decided by comparing a computed acceptance probability with a random number, uniformly distributed between 0 and 1. Here we consider the…

Statistical Mechanics · Physics 2018-05-24 Daan Frenkel , K. Julian Schrenk , Stefano Martiniani

Due to their importance in both data analysis and numerical algorithms, low rank approximations have recently been widely studied. They enable the handling of very large matrices. Tight error bounds for the computationally efficient…

Numerical Analysis · Mathematics 2023-04-06 Frank de Hoog , Markus Hegland

We study the limiting behavior of smooth linear statistics of the spectrum of random permutation matrices in the mesoscopic regime, when the permutation follows one of the Ewens measures on the symmetric group. If we apply a smooth enough…

Probability · Mathematics 2019-10-10 Valentin Bahier , Joseph Najnudel

This article considers stochastic algorithms for efficiently solving a class of large scale non-linear least squares (NLS) problems which frequently arise in applications. We propose eight variants of a practical randomized algorithm where…

Numerical Analysis · Mathematics 2015-01-27 Farbod Roosta-Khorasani , Gábor J. Székely , Uri Ascher

In this work, we develop new insights into the fundamental problem of convexity testing of real-valued functions over the domain $[n]$. Specifically, we present a nonadaptive algorithm that, given inputs $\eps \in (0,1), s \in \mathbb{N}$,…

Data Structures and Algorithms · Computer Science 2021-10-26 Abhiruk Lahiri , Ilan Newman , Nithin Varma

Sampling-based motion planners have proven to be efficient solutions to a variety of high-dimensional, geometrically complex motion planning problems with applications in several domains. The traditional view of these approaches is that…

Robotics · Computer Science 2014-04-09 Andrew Dobson , George V. Moustakides , Kostas E. Bekris

Estimating failure probabilities of engineering systems is an important problem in many engineering fields. In this work we consider such problems where the failure probability is extremely small (e.g $\leq10^{-10}$). In this case, standard…

Numerical Analysis · Mathematics 2017-05-24 Xinjuan Chen , Jinglai Li

Eigenmaps are important in analysis, geometry, and machine learning, especially in nonlinear dimension reduction. Approximation of the eigenmaps of a Laplace operator depends crucially on the scaling parameter $\epsilon$. If $\epsilon$ is…

In this paper we study constrained subspace approximation problem. Given a set of $n$ points $\{a_1,\ldots,a_n\}$ in $\mathbb{R}^d$, the goal of the {\em subspace approximation} problem is to find a $k$ dimensional subspace that best…

Data Structures and Algorithms · Computer Science 2025-04-30 Aditya Bhaskara , Sepideh Mahabadi , Madhusudhan Reddy Pittu , Ali Vakilian , David P. Woodruff

Nonprobability (convenience) samples are increasingly sought to reduce the estimation variance for one or more population variables of interest that are estimated using a randomized survey (reference) sample by increasing the effective…

Metrics of model goodness-of-fit, model comparison, and model parameter estimation are the main categories of statistical problems in science. Bayesian and frequentist methods that address these questions often rely on a likelihood…

Data Analysis, Statistics and Probability · Physics 2019-06-26 Carlos A. Argüelles , Austin Schneider , Tianlu Yuan

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann

Niederreiter [H.Niederreiter, Error bounds for quasi-Monte Carlo integration with uniform point sets, Journal of computational and applied mathematics 150 (2003), 283-292] established new bounds for quasi-Monte Carlo integration for nodes…

Number Theory · Mathematics 2010-12-01 Su Hu , Yan Li

Approximate Bayes Computations (ABC) are used for parameter inference when the likelihood function of the model is expensive to evaluate but relatively cheap to sample from. In particle ABC, an ensemble of particles in the product space of…

Computation · Statistics 2016-04-15 Carlo Albert , Hans R. Kuensch , Andreas Scheidegger

The preferential sampling of locations chosen to observe a spatio-temporal process has been identified as a major problem across multiple fields. Predictions of the process can be severely biased when standard statistical methodologies are…

Methodology · Statistics 2020-03-05 Joe Watson

Probabilistic (or Bayesian) modeling and learning offers interesting possibilities for systematic representation of uncertainty using probability theory. However, probabilistic learning often leads to computationally challenging problems.…

Computation · Statistics 2018-03-14 Andreas Svensson , Thomas B. Schön , Fredrik Lindsten