English
Related papers

Related papers: Sampling discretization and related problems

200 papers

Complex systems are fascinating because their rich macroscopic properties emerge from the interaction of many simple parts. Understanding the building principles of these emergent phenomena in nature requires assessing natural complex…

Neurons and Cognition · Quantitative Biology 2022-11-17 Anna Levina , Viola Priesemann , Johannes Zierenberg

When combining the numerical concept of variational discretization and semi-smooth Newton methods for the numerical solution of pde constrained optimization with control constraints, special emphasis has to be taken on the implementation,…

Optimization and Control · Mathematics 2009-12-03 Michael Hinze , Morten Vierling

We consider several coding discretizations of continuous functions which reflect their variation at some given precision. We study certain statistical and combinatorial properties of the sequence of finite words obtained by coding a typical…

Dynamical Systems · Mathematics 2012-01-19 Cristobal Rojas , Serge Troubetzkoy

Recently, it was discovered that for a given function class $\mathbf{F}$ the error of best linear recovery in the square norm can be bounded above by the Kolmogorov width of $\mathbf{F}$ in the uniform norm. That analysis is based on deep…

Numerical Analysis · Mathematics 2023-05-17 F. Dai , V. Temlyakov

A protocol for distributed estimation of discrete distributions is proposed. Each agent begins with a single sample from the distribution, and the goal is to learn the empirical distribution of the samples. The protocol is based on a simple…

Optimization and Control · Mathematics 2014-06-06 Anand D. Sarwate , Tara Javidi

Retraction maps have been generalized to discretization maps in (Barbero Li\~n\'an and and Mart\'{\i}n de Diego, 2022). Discretization maps are used to systematically derive numerical integrators that preserve the symplectic structure, as…

Numerical Analysis · Mathematics 2024-01-29 María Barbero-Liñán , Juan Carlos Marrero , David Martín de Diego

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

We study the problem of quantization of discrete probability distributions, arising in universal coding, as well as other applications. We show, that in many situations this problem can be reduced to the covering problem for the unit…

Information Theory · Computer Science 2010-08-24 Yuriy A. Reznik

Computing the rate-distortion function for continuous sources is commonly regarded as a standard continuous optimization problem. When numerically addressing this problem, a typical approach involves discretizing the source space and…

Information Theory · Computer Science 2024-05-02 Lingyi Chen , Shitong Wu , Wenyi Zhang , Huihui Wu , Hao Wu

This paper presents an algorithm for sampling random variables that allows to separation of the sampling process into subproblems by dividing the sample space into overlapping parts. The subproblems can be solved independently of each other…

Computation · Statistics 2016-01-26 Jonas Hallgren , Timo Koski

Random embeddings project high-dimensional spaces to low-dimensional ones; they are careful constructions which allow the approximate preservation of key properties, such as the pair-wise distances between points. Often in the field of…

Optimization and Control · Mathematics 2022-06-08 Zhen Shao

We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish…

Optimization and Control · Mathematics 2024-06-04 Jochen Schmid , Philipp Seufert , Michael Bortz

It is shown that space-time may possess the differentiability properties of manifolds as well as the ultraviolet finiteness properties of lattices. Namely, if a field's amplitudes are given on any sufficiently dense set of discrete points…

General Relativity and Quantum Cosmology · Physics 2016-11-09 Achim Kempf

We consider the problem of subspace estimation in situations where the number of available snapshots and the observation dimension are comparable in magnitude. In this context, traditional subspace methods tend to fail because the…

Information Theory · Computer Science 2016-11-15 Pascal Vallet , Philippe Loubaton , Xavier Mestre

An empirical investigation of the interaction of sample size and discretization - in this case the entropy-based method CAIM (Class-Attribute Interdependence Maximization) - was undertaken to evaluate the impact and potential bias…

Machine Learning · Statistics 2012-01-09 Casey Bennett

$D$-optimal designs originate in statistics literature as an approach for optimal experimental designs. In numerical analysis points and weights resulting from maximal determinants turned out to be useful for quadrature and interpolation.…

Numerical Analysis · Mathematics 2024-12-04 Felix Bartel , Lutz Kämmerer , Kateryna Pozharska , Martin Schäfer , Tino Ullrich

The diffraction of stochastic point sets, both Bernoulli and Markov, and of random tilings with crystallographic symmetries is investigated in rigorous terms. In particular, we derive the diffraction spectrum of 1D random tilings, of…

Mathematical Physics · Physics 2015-06-26 Michael Baake , Moritz Hoeffe

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

We study regularization in the context of small sample-size learning with over-parameterized neural networks. Specifically, we shift focus from architectural properties, such as norms on the network weights, to properties of the internal…

Machine Learning · Computer Science 2021-05-18 Christoph D. Hofer , Florian Graf , Marc Niethammer , Roland Kwitt

We study several numerical discretization techniques for the one-space plus one-time dimensional Dirac equation, including finite difference and space-time finite element methods. Two finite difference schemes and several space-time finite…

Numerical Analysis · Mathematics 2014-12-04 Robert Vaselaar , Hyun Lim , Jung-Han Kimn