English
Related papers

Related papers: Dependence on the Dimension for Complexity of Appr…

200 papers

We study the complexity of approximating complex zero sets of certain $n$-variate exponential sums. We show that the real part, $R$, of such a zero set can be approximated by the $(n-1)$-dimensional skeleton, $T$, of a polyhedral…

Algebraic Geometry · Mathematics 2021-04-22 Alperen Ergür , Grigoris Paouris , J. Maurice Rojas

We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…

Information Theory · Computer Science 2011-04-05 Paul M. B. Vitányi

We study the randomized $n$-th minimal errors (and hence the complexity) of vector valued mean computation, which is the discrete version of parametric integration. The results of the present paper form the basis for the complexity analysis…

Numerical Analysis · Mathematics 2023-06-26 Stefan Heinrich

We present an orthogonal expansion for real, function-regulated, second-order random measures over $\mathbb{R}^{d}$ with measure covariance. Such a expansion, which can be seen as a Karhunen-Lo\`eve decomposition, consists in a series of…

Probability · Mathematics 2025-06-23 Ricardo Carrizo Vergara

We consider a random walk in random environment in the low disorder regime on $\mathbb Z^d$. That is, the probability that the random walk jumps from a site $x$ to a nearest neighboring site $x+e$ is given by $p(e)+\epsilon \xi(x,e)$, where…

Probability · Mathematics 2015-11-11 David Campos , Alejandro F. Ramirez

Despite their many appealing properties, kernel methods are heavily affected by the curse of dimensionality. For instance, in the case of inner product kernels in $\mathbb{R}^d$, the Reproducing Kernel Hilbert Space (RKHS) norm is often…

Machine Learning · Computer Science 2021-11-09 Michael Celentano , Theodor Misiakiewicz , Andrea Montanari

We consider a stationary Poisson hyperplane process with given directional distribution and intensity in $d$-dimensional Euclidean space. Generalizing the zero cell of such a process, we fix a convex body $K$ and consider the intersection…

Probability · Mathematics 2013-12-17 Daniel Hug , Rolf Schneider

Decision-theoretic troubleshooting is one of the areas to which Bayesian networks can be applied. Given a probabilistic model of a malfunctioning man-made device, the task is to construct a repair strategy with minimal expected cost. The…

Artificial Intelligence · Computer Science 2013-08-02 Václav Lín

Let $K(=K_{n,\theta})$ be a positive integer-valued random variable whose distribution is given by ${\rm P}(K = x) = \bar{s}(n,x) \theta^x/(\theta)_n$ $(x=1,\ldots,n) $, where $\theta$ is a positive number, $n$ is a positive integer,…

Statistics Theory · Mathematics 2022-03-29 Koji Tsukuda

Near-Gaussian probability densities are common in many important physical applications. Here we develop an asymptotic expansion methodology for computing entropic functionals for such densities. The expansion proposed is a close relative of…

Statistics Theory · Mathematics 2016-06-29 Gordon V. Chavez , Richard Kleeman

A burgeoning line of research leverages deep neural networks to approximate the solutions to high dimensional PDEs, opening lines of theoretical inquiry focused on explaining how it is that these models appear to evade the curse of…

Machine Learning · Computer Science 2023-03-28 Tanya Marwah , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

We study the complexity of the maximum coverage problem, restricted to set systems of bounded VC-dimension. Our main result is a fixed-parameter tractable approximation scheme: an algorithm that outputs a $(1-\eps)$-approximation to the…

Computational Geometry · Computer Science 2011-12-06 Ashwinkumar Badanidiyuru , Robert Kleinberg , Hooyeon Lee

Parameterization and approximation are two popular ways of coping with NP-hard problems. More recently, the two have also been combined to derive many interesting results. We survey developments in the area both from the algorithmic and…

Data Structures and Algorithms · Computer Science 2020-06-09 Andreas Emil Feldmann , Karthik C. S. , Euiwoong Lee , Pasin Manurangsi

We propose a measure of learning efficiency for non-finite state spaces. We characterize the complexity of a learning problem by the metric entropy of its state space. We then describe how learning efficiency is determined by this measure…

Theoretical Economics · Economics 2024-08-28 Martin W Cripps

The entropy of a finite probability space $X$ measures the observable cardinality of large independent products $X^{\otimes n}$ of the probability space. If two probability spaces $X$ and $Y$ have the same entropy, there is an almost…

Metric Geometry · Mathematics 2017-06-19 Rostislav Matveev , Jacobus W. Portegies

How many bits of information are required to PAC learn a class of hypotheses of VC dimension $d$? The mathematical setting we follow is that of Bassily et al. (2018), where the value of interest is the mutual information…

Machine Learning · Computer Science 2018-04-20 Ido Nachum , Jonathan Shafer , Amir Yehudayoff

The problem of maximizing the $p$-th power of a $p$-norm over a halfspace-presented polytope in $\R^d$ is a convex maximization problem which plays a fundamental role in computational convexity. It has been shown in 1986 that this problem…

Computational Complexity · Computer Science 2013-07-25 Christian Knauer , Stefan König , Daniel Werner

The hierarchical (multi-linear) rank of an order-$d$ tensor is key in determining the cost of representing a tensor as a (tree) Tensor Network (TN). In general, it is known that, for a fixed accuracy, a tensor with random entries cannot be…

Numerical Analysis · Mathematics 2022-01-12 Mazen Ali

We give a general framework for approximations to combinatorial assemblies, especially suitable to the situation where the number $k$ of components is specified, in addition to the overall size $n$. This involves a Poisson process, which,…

Probability · Mathematics 2016-07-06 Richard Arratia , Stephen DeSalvo

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Information Theory · Computer Science 2016-11-17 Igal Sason