English
Related papers

Related papers: The Optimal Error Bound for the Method of Simultan…

200 papers

We study the Stochastic Shortest Path (SSP) problem with a linear mixture transition kernel, where an agent repeatedly interacts with a stochastic environment and seeks to reach certain goal state while minimizing the cumulative cost.…

Machine Learning · Computer Science 2024-02-15 Qiwei Di , Jiafan He , Dongruo Zhou , Quanquan Gu

This paper investigates the least-squares projection method for bounded linear operators, which provides a natural regularization scheme by projection for many ill-posed problems. Yet, without additional assumptions, the convergence of this…

Numerical Analysis · Mathematics 2014-08-26 Shukai Du , Nailin Du

We study a parabolic system with $p(t,x)$-structure under Dirichlet boundary conditions. In particular, we deduce the optimal convergence rate for the error of the gradient of a finite element based space-time approximation. The error is…

Numerical Analysis · Mathematics 2019-04-02 Dominic Breit , Prince Romeo Mensah

We study prediction in the functional linear model with functional outputs : $Y=SX+\epsilon $ where the covariates $X$ and $Y$ belong to some functional space and $S$ is a linear operator. We provide the asymptotic mean square prediction…

Statistics Theory · Mathematics 2011-02-14 Christophe Crambes , André Mas

We consider an elliptic linear-quadratic parameter estimation problem with a finite number of parameters. A novel a priori bound for the parameter error is proved and, based on this bound, an adaptive finite element method driven by an a…

Numerical Analysis · Mathematics 2022-09-05 Roland Becker , Michael Innerberger , Dirk Praetorius

This paper is concerned with estimating the intersection point of two densities, given a sample of both of the densities. This problem arises in classification theory. The main results provide lower bounds for the probability of the…

Statistics Theory · Mathematics 2007-12-18 Franz Merkl , Leila Mohammadi

A class of linear parabolic equations is considered. We derive a framework for the a posteriori error analysis of time discretisations by Richardson extrapolation of arbitrary order combined with finite element discretisations in space. We…

Numerical Analysis · Mathematics 2024-11-22 Torsten Linß , Goran Radojev

In this paper, we propose a novel primal-dual inexact gradient projection method for nonlinear optimization problems with convex-set constraint. This method only needs inexact computation of the projections onto the convex set for each…

Optimization and Control · Mathematics 2019-11-19 Fan Zhang , Hao Wang , Jiashan Wang , Kai Yang

We develop a spectral low-mode reduced solver for second-order elliptic boundary value problems with spatially varying diffusion coefficients. The approach projects standard finite difference or finite element discretization onto a global…

Numerical Analysis · Mathematics 2025-12-23 Prosper Torsu

We address the problem of sequential prediction with expert advice in a non-stationary environment with long-term memory guarantees in the sense of Bousquet and Warmuth [4]. We give a linear-time algorithm that improves on the best known…

Machine Learning · Computer Science 2021-06-25 James Robinson , Mark Herbster

In this paper, we provide a generic anytime lower bounding procedure for minmax regret optimization problems. We show that the lower bound obtained is always at least as accurate as the lower bound recently proposed by Chassein and Goerigk…

Data Structures and Algorithms · Computer Science 2017-07-12 Hugo Gilbert , Olivier Spanjaard

In this paper, we consider an approach to the parallelizing of the algorithms realizing the modified probability changigng method with adaptation and partial rollback procedure for constrained pseudo-Boolean optimization problems. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-03 Lev Kazakovtsev

Efficient global optimization is a widely used method for optimizing expensive black-box functions such as tuning hyperparameter, and designing new material, etc. Despite its popularity, less attention has been paid to analyzing the…

Optimization and Control · Mathematics 2022-09-21 Wenjie Xu , Yuning Jiang , Emilio T. Maddalena , Colin N. Jones

We develop a new theoretical framework to analyze the generalization error of deep learning, and derive a new fast learning rate for two representative algorithms: empirical risk minimization and Bayesian deep learning. The series of…

Statistics Theory · Mathematics 2017-05-31 Taiji Suzuki

In this paper, the a posteriori error estimates of the exponential midpoint method for time discretization are studied for linear and semilinear parabolic equations. Using the exponential midpoint approximation defined by a continuous and…

Numerical Analysis · Mathematics 2024-06-13 Xianfa Hu , Wansheng Wang , Mengli Mao , Jiliang Cao

We present a unified theoretical framework for parametric low-rank approximation, a research area devoted to the development of efficient algorithms that act as adaptive alternatives of traditional methods such as Singular Value…

Numerical Analysis · Mathematics 2025-09-22 Nicola Rares Franco

Randomized matrix sparsification has proven to be a fruitful technique for producing faster algorithms in applications ranging from graph partitioning to semidefinite programming. In the decade or so of research into this technique, the…

Numerical Analysis · Mathematics 2009-11-23 Alex Gittens , Joel A. Tropp

This paper is concerned with distributed limited memory prediction for continuous-time linear stochastic systems with multiple sensors. A distributed fusion with the weighted sum structure is applied to the optimal local limited memory…

Other Computer Science · Computer Science 2010-02-18 Ha-ryong Song , Vladimir Shin

Motivated by optimization with differential equations, we consider optimization problems with Hilbert spaces as decision spaces. As a consequence of their infinite dimensionality, the numerical solution necessitates finite dimensional…

Optimization and Control · Mathematics 2025-07-01 Danlin Li , Johannes Milz

The quest for an algorithm that solves an $n\times n$ linear system in $O(n^2)$ time complexity, or $O(n^2 \text{poly}(1/\epsilon))$ when solving up to $\epsilon$ relative error, is a long-standing open problem in numerical linear algebra…

Numerical Analysis · Mathematics 2026-05-26 Michał Dereziński , Yuji Nakatsukasa , Elizaveta Rebrova