English
Related papers

Related papers: Enhanced Error Estimates for Augmented Subspace Me…

200 papers

We propose and analyze random subspace variants of the second-order Adaptive Regularization using Cubics (ARC) algorithm. These methods iteratively restrict the search space to some random subspace of the parameters, constructing and…

Optimization and Control · Mathematics 2025-01-17 Coralia Cartis , Zhen Shao , Edward Tansley

We construct an extended Lagrange FE space to solve the Maxwell equation and its eigenvalue problem in $\mathbb R^d$ $(d=2,3)$, which is the sum of the vectorial $p-$order Lagrange FE space ($p\ge1$) and the gradient of the $p+1-$order…

Numerical Analysis · Mathematics 2026-03-03 Jiayu Han

In this paper, the generalized finite element method (GFEM) for solving second order elliptic equations with rough coefficients is studied. New optimal local approximation spaces for GFEMs based on local eigenvalue problems involving a…

Numerical Analysis · Mathematics 2021-12-22 Chupeng Ma , Robert Scheichl , Tim Dodwell

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Bilevel learning has gained prominence in machine learning, inverse problems, and imaging applications, including hyperparameter optimization, learning data-adaptive regularizers, and optimizing forward operators. The large-scale nature of…

Optimization and Control · Mathematics 2025-05-20 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

We consider the minimization or maximization of the $J$th largest eigenvalue of an analytic and Hermitian matrix-valued function, and build on Mengi et al. (2014, SIAM J. Matrix Anal. Appl., 35, 699-724). This work addresses the setting…

Numerical Analysis · Mathematics 2017-06-19 Fatih Kangal , Karl Meerbergen , Emre Mengi , Wim Michiels

Optimization plays a key role in machine learning. Recently, stochastic second-order methods have attracted much attention due to their low computational cost in each iteration. However, these algorithms might perform poorly especially if…

Machine Learning · Computer Science 2017-10-25 Haishan Ye , Zhihua Zhang

Studies in environmental and epidemiological sciences are often spatially varying and observational in nature with the aim of establishing cause and effect relationships. One of the major challenges with such studies is the presence of…

Methodology · Statistics 2023-05-16 Sayli Pokal , Yawen Guan , Honglang Wang , Yuzhen Zhou

This paper presents two new techniques relating to inexact solution of subproblems in augmented Lagrangian methods for convex programming. The first involves combining a relative error criterion for solution of the subproblems with over- or…

Optimization and Control · Mathematics 2025-09-17 Jonathan Eckstein , Chang Yu

In this paper, we consider finite difference approximations of the second order wave equation. We use finite difference operators satisfying the summation-by-parts property to discretize the equation in space. Boundary conditions and grid…

Numerical Analysis · Mathematics 2015-09-04 Siyang Wang , Gunilla Kreiss

Inverse problems use physical measurements along with a computational model to estimate the parameters or state of a system of interest. Errors in measurements and uncertainties in the computational model lead to inaccurate estimates. This…

Numerical Analysis · Mathematics 2015-02-02 Vishwas Rao , Adrian Sandu

Deep learning methods have been employed in gravitational-wave astronomy to accelerate the construction of surrogate waveforms for the inspiral of spin-aligned black hole binaries, among other applications. We face the challenge of modeling…

Instrumentation and Methods for Astrophysics · Physics 2023-08-24 Styliani-Christina Fragkouli , Paraskevi Nousi , Nikolaos Passalis , Panagiotis Iosif , Nikolaos Stergioulas , Anastasios Tefas

A space-time adaptive scheme is presented for solving advection equations in two space dimensions. The gradient-augmented level set method using a semi-Lagrangian formulation with backward time integration is coupled with a point value…

Computational Physics · Physics 2015-04-20 Dmitry Kolomenskiy , Jean-Christophe Nave , Kai Schneider

We propose an augmented Lagrangian-type algorithm for the solution of generalized Nash equilibrium problems (GNEPs). Specifically, we discuss the convergence properties with regard to both feasibility and optimality of limit points. This is…

Optimization and Control · Mathematics 2018-07-13 Christian Kanzow , Daniel Steck

This contribution introduces a novel signal extrapolation algorithm and its application to image error concealment. The signal extrapolation is carried out by iteratively generating a model of the signal suffering from distortion. Thereby,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-15 Jürgen Seiler , André Kaup

The task of estimating the 6D pose of an object from RGB images can be broken down into two main steps: an initial pose estimation step, followed by a refinement procedure to correctly register the object and its observation. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Stefan Stevsic , Otmar Hilliges

We here adapt an extended version of the adaptive cubic regularisation method with dynamic inexact Hessian information for nonconvex optimisation in [3] to the stochastic optimisation setting. While exact function evaluations are still…

Numerical Analysis · Mathematics 2020-09-15 Stefania Bellavia , Gianmarco Gurioli

This paper introduces the multiplicative variant of the recently proposed asynchronous additive coarse-space correction method. Definition of an asynchronous extension of multiplicative correction is not straightforward, however, our…

Numerical Analysis · Mathematics 2023-12-20 Guillaume Gbikpi-Benissan , Frédéric Magoulès

In this paper, we study the adaptive planewave discretization for a cluster of eigenvalues of second-order elliptic partial differential equations. We first design an a posteriori error estimator and prove both the upper and lower bounds.…

Numerical Analysis · Mathematics 2022-10-28 Xiaoying Dai , Yan Pan , Bin Yang , Aihui Zhou

In this paper, we study a stochastic strongly convex optimization problem and propose three classes of variable sample-size stochastic first-order methods including the standard stochastic gradient descent method, its accelerated variant,…

Optimization and Control · Mathematics 2024-05-08 Jinlong Lei , Uday V. Shanbhag