English
Related papers

Related papers: A Multilevel Stochastic Collocation Method for Par…

200 papers

We propose an efficient probabilistic method to solve a deterministic problem -- we present a randomized optimization approach that drastically reduces the enormous computational cost of optimizing designs under many load cases for both…

Optimization and Control · Mathematics 2017-10-11 Xiaojia Zhang , Eric de Sturler , Glaucio H. Paulino

In this work, we study the approximation of expected values of functional quantities on the solution of a stochastic differential equation (SDE), where we replace the Monte Carlo estimation with the evaluation of a deep neural network. Once…

Numerical Analysis · Mathematics 2021-02-18 Thomas Gerstner , Bastian Harrach , Daniel Roth , Martin Simon

General elliptic equations with spatially discontinuous diffusion coefficients may be used as a simplified model for subsurface flow in heterogeneous or fractured porous media. In such a model, data sparsity and measurement errors are often…

Numerical Analysis · Mathematics 2022-08-29 Andrea Barth , Robin Merkle

Most approximation methods in high dimensions exploit smoothness of the function being approximated. These methods provide poor convergence results for non-smooth functions with kinks. For example, such kinks can arise in the uncertainty…

Numerical Analysis · Mathematics 2019-02-19 Barbara Fuchs , Jochen Garcke

Variable selection is a key issue when analyzing high-dimensional data. The explosion of data with large sample sizes and dimensionality brings new challenges to this problem in both inference accuracy and computational complexity. To…

Methodology · Statistics 2016-11-30 Xu Chen , Shaan Qamar , Surya T. Tokdar

Stochastic domain decomposition is proposed as a novel method for solving the two-dimensional Maxwell's equations as used in the magnetotelluric method. The stochastic form of the exact solution of Maxwell's equations is evaluated using…

We introduce a proximal version of the stochastic dual coordinate ascent method and show how to accelerate the method using an inner-outer iteration procedure. We analyze the runtime of the framework and obtain rates that improve…

Machine Learning · Statistics 2013-10-09 Shai Shalev-Shwartz , Tong Zhang

Monte Carlo (MC) sampling is a popular method for estimating the statistics (e.g. expectation and variance) of a random variable. Its slow convergence has led to the emergence of advanced techniques to reduce the variance of the MC…

Statistics Theory · Mathematics 2024-06-21 Mohamed Reda El Amri , Paul Mycek , Sophie Ricci , Matthias De Lozzo

The recently introduced full-history recursive multilevel Picard (MLP) approximation methods have turned out to be quite successful in the numerical approximation of solutions of high-dimensional nonlinear PDEs. In particular, there are…

Numerical Analysis · Mathematics 2020-10-12 Martin Hutzenthaler , Arnulf Jentzen , Thomas Kruse , Tuan Anh Nguyen

We propose an accurate data-driven numerical scheme to solve Stochastic Differential Equations (SDEs), by taking large time steps. The SDE discretization is built up by means of a polynomial chaos expansion method, on the basis of…

Numerical Analysis · Mathematics 2021-09-24 Shuaiqiang Liu , Lech A. Grzelak , Cornelis W. Oosterlee

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

This work addresses uncertainty quantification of electromagnetic devices determined by the eddy current problem. The multilevel Monte Carlo (MLMC) method is used for the treatment of uncertain parameters while the devices are discretized…

Computational Engineering, Finance, and Science · Computer Science 2020-03-24 Armin Galetzka , Zeger Bontinck , Ulrich Römer , Sebastian Schöps

Two-level stochastic optimization formulations have become instrumental in a number of machine learning contexts such as continual learning, neural architecture search, adversarial learning, and hyperparameter tuning. Practical stochastic…

Optimization and Control · Mathematics 2023-11-08 Tommaso Giovannelli , Griffin Dean Kent , Luis Nunes Vicente

A common way to simulate the transport and spread of pollutants in the atmosphere is via stochastic Lagrangian dispersion models. Mathematically, these models describe turbulent transport processes with stochastic differential equations…

We propose a novel training method based on nonlinear multilevel minimization techniques, commonly used for solving discretized large scale partial differential equations. Our multilevel training method constructs a multilevel hierarchy by…

Machine Learning · Computer Science 2020-06-30 Vanessa Braglia , Alena Kopaničáková , Rolf Krause

Methods for generating sequences of surrogates approximating fine scale models of two-phase random heterogeneous media are presented that are designed to adaptively control the modeling error in key quantities of interest (QoIs). For…

Numerical Analysis · Mathematics 2019-03-07 Laura Scarabosio , Barbara Wohlmuth , J. Tinsley Oden , Danial Faghihi

We describe stochastic Newton and stochastic quasi-Newton approaches to efficiently solve large linear least-squares problems where the very large data sets present a significant computational burden (e.g., the size may exceed computer…

Numerical Analysis · Mathematics 2017-02-27 Julianne Chung , Matthias Chung , J. Tanner Slagel , Luis Tenorio

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

This position paper summarizes a recently developed research program focused on inference in the context of data centric science and engineering applications, and forecasts its trajectory forward over the next decade. Often one endeavours…

Computation · Statistics 2021-12-06 Ajay Jasra , Kody J. H. Law , Alexander Tarakanov , Fangyuan Yu

We propose extensions and improvements of the statistical analysis of distributed multipoles (SADM) algorithm put forth by Chipot et al. in [6] for the derivation of distributed atomic multipoles from the quantum-mechanical electrostatic…

Numerical Analysis · Mathematics 2010-07-28 Nicolas Champagnat , Christophe Chipot , Erwan Faou