English
Related papers

Related papers: High-Dimensional Function Approximation: Breaking …

200 papers

We present an algorithm (CoDeFi) which overcomes the curse of dimensionality (CoD) in scientific computations and, especially, in mathematical finance (Fi). Our method applies a broad class of partial differential equations such as…

Numerical Analysis · Mathematics 2016-10-07 Philippe G. LeFloch , Jean-Marc Mercier

In a recent paper Beskos et al (2011), the Sequential Monte Carlo (SMC) sampler introduced in Del Moral et al (2006), Neal (2001) has been shown to be asymptotically stable in the dimension of the state space d at a cost that is only…

Computation · Statistics 2011-12-08 Alexandros Beskos , Dan Crisan , Ajay Jasra , Nick Whiteley

In recent work it has been shown that determining a feedforward ReLU neural network to within high uniform accuracy from point samples suffers from the curse of dimensionality in terms of the number of samples needed. As a consequence,…

Machine Learning · Statistics 2024-11-11 Yuanyuan Li , Philipp Grohs , Philipp Petersen

A statistical learning approach for parametric PDEs related to Uncertainty Quantification is derived. The method is based on the minimization of an empirical risk on a selected model class and it is shown to be applicable to a broad range…

Numerical Analysis · Mathematics 2020-01-07 Martin Eigel , Reinhold Schneider , Philipp Trunschke , Sebastian Wolf

We study the problem of estimating multivariate log-concave probability density functions. We prove the first sample complexity upper bound for learning log-concave densities on $\mathbb{R}^d$, for all $d \geq 1$. Prior to our work, no…

Machine Learning · Computer Science 2017-06-07 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Recently a new class of techniques termed the max-plus curse of dimensionality-free methods have been developed to solve nonlinear optimal control problems. In these methods the discretization in state space is avoided by using a max-plus…

Optimization and Control · Mathematics 2015-01-05 Stephane Gaubert , Zheng Qu , Srinivas Sridharan

In recent work it has been established that deep neural networks are capable of approximating solutions to a large class of parabolic partial differential equations without incurring the curse of dimension. However, all this work has been…

Numerical Analysis · Mathematics 2020-08-18 Philipp Grohs , Lukas Herrmann

This paper investigates a class of algorithms for numerical integration of a function in d dimensions over a compact domain by Monte Carlo methods. We construct a histogram approximation to the function using a partition of the integration…

Computational Physics · Physics 2015-06-11 Rudy Arthur , A. D. Kennedy

In this article we identify a general class of high-dimensional continuous functions that can be approximated by deep neural networks (DNNs) with the rectified linear unit (ReLU) activation without the curse of dimensionality. In other…

Numerical Analysis · Mathematics 2023-04-13 Adrian Riekert

Single-level reformulations of (non-convex) distributionally robust optimization (DRO) problems are often intractable, as they contain semiinfinite dual constraints. Based on such a semiinfinite reformulation, we present a safe…

Optimization and Control · Mathematics 2025-06-09 J. Dienstbier , F. Liers , J. Rolfes

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

Penalized likelihood methods are fundamental to ultra-high dimensional variable selection. How high dimensionality such methods can handle remains largely unknown. In this paper, we show that in the context of generalized linear models,…

Statistics Theory · Mathematics 2009-10-08 Jianqing Fan , Jinchi Lv

In the last 20 years a whole hierarchy of notions of tractability was proposed and analyzed by several authors. These notions are used to classify the computational hardness of continuous numerical problems $S=(S_d)_{d\in\mathbb{N}}$ in…

Numerical Analysis · Mathematics 2014-11-14 Paweł Siedlecki , Markus Weimar

Neural Networks have been widely used to solve Partial Differential Equations. These methods require to approximate definite integrals using quadrature rules. Here, we illustrate via 1D numerical examples the quadrature problems that may…

Numerical Analysis · Mathematics 2022-03-09 Jon A. Rivera , Jamie M. Taylor , Ángel J. Omella , David Pardo

A large literature specifies conditions under which the information complexity for a sequence of numerical problems defined for dimensions $1, 2, \ldots$ grows at a moderate rate, i.e., the sequence of problems is tractable. Here, we focus…

Numerical Analysis · Mathematics 2024-04-24 Onyekachi Emenike , Fred J. Hickernell , Peter Kritzer

Courcelle's theorem and its adaptations to cliquewidth have shaped the field of exact parameterized algorithms and are widely considered the archetype of algorithmic meta-theorems. In the past decade, there has been growing interest in…

Computational Complexity · Computer Science 2023-05-04 Jan Dreier , Robert Ganian , Thekla Hamm

For classification problems, feature extraction is a crucial process which aims to find a suitable data representation that increases the performance of the machine learning algorithm. According to the curse of dimensionality theorem, the…

Machine Learning · Computer Science 2010-10-12 Ilknur Icke , Andrew Rosenberg

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states:…

Machine Learning · Computer Science 2020-01-22 Alexander N. Gorban , Valery A. Makarov , Ivan Y. Tyukin

Approximate Thompson sampling with Langevin Monte Carlo broadens its reach from Gaussian posterior sampling to encompass more general smooth posteriors. However, it still encounters scalability issues in high-dimensional problems when…

Machine Learning · Statistics 2024-06-24 Haoyang Zheng , Wei Deng , Christian Moya , Guang Lin

Robust inference for stochastic dynamical systems is often hampered by sparse sampling and the absence of closed-form likelihoods. We introduce a Monte Carlo path-inference framework that leverages full-path statistics and bridge processes…

Statistical Mechanics · Physics 2025-10-07 Javier Aguilar , Miguel A. Muñoz , Sandro Azaele