English
Related papers

Related papers: Enhanced Error Estimates for Augmented Subspace Me…

200 papers

A multilevel adaptive refinement strategy for solving linear elliptic partial differential equations with random data is recalled in this work. The strategy extends the a posteriori error estimation framework introduced by Guignard and…

Numerical Analysis · Mathematics 2022-02-21 Alex Bespalov , David J. Silvester

This paper develops a new class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized sketching to accelerate subspace projection methods, such as GMRES and Rayleigh--Ritz. This approach…

Numerical Analysis · Mathematics 2022-02-17 Yuji Nakatsukasa , Joel A. Tropp

As we stride toward the exascale era, due to increasing complexity of supercomputers, hard and soft errors are causing more and more problems in high-performance scientific and engineering computation. In order to improve reliability…

Numerical Analysis · Mathematics 2013-09-03 Tao Cui , Jinchao Xu , Chen-Song Zhang

The experimental results of improved underwater image enhancement algorithms based on partial differential equations (PDEs) are presented in this report. This second work extends the study of previous work and incorporating several…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 U. A. Nnolim

We present new error estimates for the finite volume and finite difference methods applied to the compressible Navier-Stokes equations. The main innovative ingredients of the improved error estimates are a refined consistency analysis…

Numerical Analysis · Mathematics 2022-05-10 Eduard Feireisl , Mária Lukáčová-Medviďová , Bangwei She

In this paper, we study inexact high-order Tensor Methods for solving convex optimization problems with composite objective. At every step of such methods, we use approximate solution of the auxiliary problem, defined by the bound for the…

Optimization and Control · Mathematics 2020-12-23 Nikita Doikov , Yurii Nesterov

Bilevel optimization is a powerful tool for many machine learning problems, such as hyperparameter optimization and meta-learning. Estimating hypergradients (also known as implicit gradients) is crucial for developing gradient-based methods…

Optimization and Control · Mathematics 2025-05-06 Youran Dong , Junfeng Yang , Wei Yao , Jin Zhang

We propose an extrapolation technique that allows accuracy improvement of the discrete dipole approximation computations. The performance of this technique was studied empirically based on extensive simulations for 5 test cases using many…

Optics · Physics 2008-07-29 Maxim A. Yurkin , Valeri P. Maltsev , Alfons G. Hoekstra

Several problems in machine learning, statistics, and other fields rely on computing eigenvectors. For large scale problems, the computation of these eigenvectors is typically performed via iterative schemes such as subspace iteration or…

Numerical Analysis · Mathematics 2020-11-03 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Depth information plays a crucial role in autonomous systems for environmental perception and robot state estimation. With the rapid development of deep neural network technology, depth estimation has been extensively studied and shown…

Robotics · Computer Science 2024-11-11 Quang Truong Nguyen , Thanh Nguyen Canh , Xiem HoangVan

Multilevel methods represent a powerful approach in numerical solution of partial differential equations. The multilevel structure can also be used to construct estimates for total and algebraic errors of computed approximations. This paper…

Numerical Analysis · Mathematics 2024-05-13 Petr Vacek , Jan Papež , Zdeněk Strakoš

In this paper, we study a class of bilevel programming problem where the inner objective function is strongly convex. More specifically, under some mile assumptions on the partial derivatives of both inner and outer objective functions, we…

Optimization and Control · Mathematics 2018-02-08 Saeed Ghadimi , Mengdi Wang

In this paper, we generalize (accelerated) Newton's method with cubic regularization under inexact second-order information for (strongly) convex optimization problems. Under mild assumptions, we provide global rate of convergence of these…

Optimization and Control · Mathematics 2017-10-17 Saeed Ghadimi , Han Liu , Tong Zhang

We adapt a symmetric interior penalty discontinuous Galerkin method using a patch reconstructed approximation space to solve elliptic eigenvalue problems, including both second and fourth order problems in 2D and 3D. It is a direct…

Numerical Analysis · Mathematics 2019-11-26 Ruo Li , Zhiyuan Sun , Fanyi Yang

Optimization plays a key role in machine learning. Recently, stochastic second-order methods have attracted much attention due to their low computational cost in each iteration. However, these algorithms might perform poorly especially if…

Machine Learning · Computer Science 2017-10-25 Haishan Ye , Zhihua Zhang

Learning the distance metric between pairs of samples has been studied for image retrieval and clustering. With the remarkable success of pair-based metric learning losses, recent works have proposed the use of generated synthetic points on…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Byungsoo Ko , Geonmo Gu

Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training robust…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Sangnie Bhardwaj , Willie McClinton , Tongzhou Wang , Guillaume Lajoie , Chen Sun , Phillip Isola , Dilip Krishnan

We present convergence results in expectation for stochastic subspace correction schemes and their accelerated versions to solve symmetric positive-definite variational problems, and discuss their potential for achieving fault tolerance in…

Numerical Analysis · Mathematics 2018-07-31 Michael Griebel , Peter Oswald

This paper addresses the problem of inverse covariance (also known as precision matrix) estimation in high-dimensional settings. Specifically, we focus on two classes of estimators: linear shrinkage estimators with a target proportional to…

Machine Learning · Statistics 2025-11-21 Lucas Morisset , Adrien Hardy , Alain Durmus

In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic…

Optimization and Control · Mathematics 2019-03-20 Nicolas Loizou , Peter Richtárik