English
Related papers

Related papers: The Optimal Error Bound for the Method of Simultan…

200 papers

A linear implicit finite difference method is proposed for the approximation of the solution to a periodic, initial value problem for a Schrodinger-Hirota equation. Optimal, second order convergence in the discrete $H^1-$norm is proved,…

Numerical Analysis · Mathematics 2017-06-14 Georgios E. Zouraris

Let $L_1,L_2,\dots,L_K$ be a family of closed subspaces of a Hilbert space $H$, $L_1\cap \dots \cap L_K =\{0\}$; let $P_k$ be the orthogonal projection onto $L_k$. We consider two types of consecutive projections of an element $x_0\in H$:…

Functional Analysis · Mathematics 2019-11-15 Petr A. Borodin , Eva Kopecká

Subspace methods are commonly used for finding approximate eigenvalues and singular values of large-scale matrices. Once a subspace is found, the Rayleigh-Ritz method (for symmetric eigenvalue problems) and Petrov-Galerkin projection (for…

Numerical Analysis · Mathematics 2025-10-07 Irina-Beatrice Haas , Yuji Nakatsukasa

Given two arbitrary closed sets in Euclidean space, a simple transversality condition guarantees that the method of alternating projections converges locally, at linear rate, to a point in the intersection. Exact projection onto nonconvex…

Optimization and Control · Mathematics 2018-11-06 Dmitriy Drusvyatskiy , Adrian S. Lewis

We consider the problem of maximizing a convex function over a closed convex set in a real Hilbert space. For linear functions, we show that a single orthogonal projection suffices to obtain an approximate solution. For continuous convex…

Optimization and Control · Mathematics 2026-02-23 Pedro Felzenszwalb , Heon Lee

We study algorithms for online linear optimization in Hilbert spaces, focusing on the case where the player is unconstrained. We develop a novel characterization of a large class of minimax algorithms, recovering, and even improving,…

Machine Learning · Computer Science 2014-05-22 H. Brendan McMahan , Francesco Orabona

In this paper, we consider a functional linear regression model, where both the covariate and the response variable are functional random variables. We address the problem of optimal nonparametric estimation of the conditional expectation…

Statistics Theory · Mathematics 2022-03-02 Gaëlle Chagny , Anouar Meynaoui , Angelina Roche

We revisit the method of Carleman linearization for systems of ordinary differential equations with polynomial right-hand sides. This transformation provides an approximate linearization in a higher-dimensional space through the exact…

Numerical Analysis · Mathematics 2017-11-08 Marcelo Forets , Amaury Pouly

The variational inequality problem in finite-dimensional Euclidean space is addressed in this paper, and two inexact variants of the extragradient method are proposed to solve it. Instead of computing exact projections on the constraint…

Optimization and Control · Mathematics 2024-06-24 R. Díaz Millán , O. P. Ferreira , J. Ugon

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

We study methods based on reproducing kernel Hilbert spaces for estimating the value function of an infinite-horizon discounted Markov reward process (MRP). We study a regularized form of the kernel least-squares temporal difference (LSTD)…

Machine Learning · Statistics 2021-09-27 Yaqi Duan , Mengdi Wang , Martin J. Wainwright

We study the finite-time convergence of projected linear two-time-scale stochastic approximation with constant step sizes and Polyak--Ruppert averaging. We establish an explicit mean-square error bound, decomposing it into two interpretable…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Yitao Bai , Thinh T. Doan , Justin Romberg

In this paper, we employ a space-time finite element method to discretize the parabolic initial-boundary value problem and extend its error analysis with refined estimates on unstructured space-time meshes. We establish higher-order…

Numerical Analysis · Mathematics 2025-03-13 Thi Thanh Mai Ta , Quang Huy Nguyen , Phi Hung Pham

We derive aposteriori error estimates for fully discrete approximations to solutions of linear parabolic equations on the space-time domain. The space discretization uses finite element spaces, that are allowed to change in time. Our main…

Numerical Analysis · Mathematics 2024-12-10 Omar Lakkis , Charalambos Makridakis

Error bounds have been studied for more than seventy years, beginning with the seminal result of Hoffman (1952) [{\it J. Res. Natl. Bur. Standards}, 49 (1952), 263--265], which establishes an upper bound for the distance from an arbitrary…

Optimization and Control · Mathematics 2026-05-25 Zhou Wei , Michel Thera , Jen-Chih Yao

This paper proposes two linear projection methods for supervised dimension reduction using only the first and second-order statistics. The methods, each catering to a different parameter regime, are derived under the general Gaussian model…

Information Theory · Computer Science 2024-08-13 Biao Chen , Joshua Kortje

In this work, we deal with approximations for distribution functions of non-negative random variables. More specifically, we construct continuous approximants using an acceleration technique over a well-know inversion formula for Laplace…

Statistics Theory · Mathematics 2010-10-12 Carmen Sangüesa

We study finite element approximations of second-order elliptic problems with measure-valued right-hand sides supported on lower-dimensional sets. The exact solution generally lacks $H^1$-regularity due to the source singularity, which…

Numerical Analysis · Mathematics 2026-03-10 Huadong Gao , Yuhui Huang

In semidefinite programming a proposed optimal solution may be quite poor in spite of having sufficiently small residual in the optimality conditions. This issue may be framed in terms of the discrepancy between forward error (the…

Optimization and Control · Mathematics 2019-08-14 Stefan Sremac , Hugo J. Woerdeman , Henry Wolkowicz

Two of the most popular parallel-in-time methods are Parareal and multigrid-reduction-in-time (MGRIT). Recently, a general convergence theory was developed in Southworth (2019) for linear two-level MGRIT/Parareal that provides necessary and…

Numerical Analysis · Mathematics 2020-10-23 Ben S. Southworth , Wayne Mitchell , Andreas Hessenthaler , Federico Danieli