English
Related papers

Related papers: Randomized residual-based error estimators for the…

200 papers

Probabilistic variants of Model Order Reduction (MOR) methods have recently emerged for improving stability and computational performance of classical approaches. In this paper, we propose a probabilistic Reduced Basis Method (RBM) for the…

Numerical Analysis · Mathematics 2023-12-06 Marie Billaud-Friess , Arthur Macherey , Anthony Nouy , Clémentine Prieur

Iterative procedures for parameter estimation based on stochastic gradient descent allow the estimation to scale to massive data sets. However, in both theory and practice, they suffer from numerical instability. Moreover, they are…

Methodology · Statistics 2016-06-08 Panos Toulis , Dustin Tran , Edoardo M. Airoldi

We present large sample results for partitioning-based least squares nonparametric regression, a popular method for approximating conditional expectation functions in statistics, econometrics, and machine learning. First, we obtain a…

Statistics Theory · Mathematics 2020-07-20 Matias D. Cattaneo , Max H. Farrell , Yingjie Feng

We consider a two dimensional biharmonic problem and its discretization by means of a symmetric interior penalty discontinuous Galerkin method. A novel split of an error measure based on a generalized Hessian into two terms measuring the…

Numerical Analysis · Mathematics 2025-12-18 Théophile Chaumont-Frelet , Joscha Gedicke , Lorenzo Mascotto

We propose a novel a posteriori error estimator for conforming finite element discretizations of two- and three-dimensional Helmholtz problems. The estimator is based on an equilibrated flux that is computed by solving patchwise mixed…

Numerical Analysis · Mathematics 2021-05-05 T. Chaumont-Frelet , A. Ern , M. Vohralík

We derive globally reliable a posteriori error estimators for a PDE-constrained optimization problem involving linear models in fluid dynamics as state equation; control constraints are also considered. The corresponding local error…

Numerical Analysis · Mathematics 2017-08-03 Alejandro Allendes , Enrique Otarola , Richard Rankin

This paper is concerned with the analysis and implementation of robust finite element approximation methods for mixed formulations of linear elasticity problems where the elastic solid is almost incompressible. Several novel a posteriori…

Numerical Analysis · Mathematics 2018-06-15 Arbaz Khan , Catherine E. Powell , David J. Silvester

We present a method for computing reduced-order models of parameterized partial differential equation solutions. The key analytical tool is the singular value expansion of the parameterized solution, which we approximate with a singular…

Numerical Analysis · Mathematics 2014-11-03 Paul G. Constantine , David F. Gleich , Yangyang Hou , Jeremy Templeton

We propose a novel a posteriori error estimator for the N\'ed\'elec finite element discretization of time-harmonic Maxwell's equations. After the approximation of the electric field is computed, we propose a fully localized algorithm to…

Numerical Analysis · Mathematics 2024-02-28 T. Chaumont-Frelet

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learning problems such as regression and classification. The…

Machine Learning · Computer Science 2019-04-08 Craig Wilson , Yuheng Bu , Venugopal Veeravalli

We introduce novel dynamical low-rank methods for solving large-scale matrix differential equations, motivated by algorithms from randomized numerical linear algebra. In terms of performance (cost and accuracy), our methods overperform…

Numerical Analysis · Mathematics 2025-10-13 Benjamin Carrel

Gaussian stochastic process emulation is a powerful tool for approximating computationally intensive computer models. However, estimation of parameters in the GaSP emulator is a challenging task. No closed-form estimator is available, and…

Computation · Statistics 2026-05-06 Mengyang Gu , Jesús Palomo , James O. Berger

An ensemble method is introduced that utilizes randomization and loss function gradients to compute a prediction. Multiple weakly-correlated estimators approximate the gradient at randomly sampled points on the error surface and are…

Machine Learning · Computer Science 2020-09-15 Nicholas Smith

Classical stochastic gradient methods are well suited for minimizing expected-value objective functions. However, they do not apply to the minimization of a nonlinear function involving expected values or a composition of two expected-value…

Machine Learning · Statistics 2014-11-17 Mengdi Wang , Ethan X. Fang , Han Liu

The purpose of the paper is to provide a characterization of the error of the best polynomial approximation of composite functions in weighted spaces. Such a characterization is essential for the convergence analysis of numerical methods…

Numerical Analysis · Mathematics 2023-08-14 Luisa Fermo , Concetta Laurita , Maria Grazia Russo

The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Anthony W. Helmstetter , Saeed Vatankhah

The success of deep learning has led to a rising interest in the generalization property of the stochastic gradient descent (SGD) method, and stability is one popular approach to study it. Existing works based on stability have studied…

Machine Learning · Statistics 2019-03-08 Yi Zhou , Yingbin Liang , Huishuai Zhang

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

Stochastic gradient descent (SGD) and its variants have established themselves as the go-to algorithms for large-scale machine learning problems with independent samples due to their generalization performance and intrinsic computational…

Machine Learning · Statistics 2025-08-25 Hao Chen , Lili Zheng , Raed Al Kontar , Garvesh Raskutti