English
Related papers

Related papers: Error Bounds for the Method of Simultaneous Projec…

200 papers

A common problem in applied mathematics is to find a function in a Hilbert space with prescribed best approximations from a finite number of closed vector subspaces. In the present paper we study the question of the existence of solutions…

Functional Analysis · Mathematics 2009-05-22 P. L. Combettes , N. N. Reyes

The subgradient projection iteration is a classical method for solving a convex inequality. Motivated by works of Polyak and of Crombez, we present and analyze a more general method for finding a fixed point of a cutter, provided that the…

Optimization and Control · Mathematics 2014-08-15 Heinz H. Bauschke , Caifang Wang , Xianfu Wang , Jia Xu

In this paper, a class of optimization problems with nonlinear inequality constraints is discussed. Based on the ideas of sequential quadratic programming algorithm and the method of strongly sub-feasible directions, a new superlinearly…

Optimization and Control · Mathematics 2012-06-28 Jin-Bao Jian , Chuan-Hao Guo , Chun-Ming Tang , Yan-Qin Bai

We study a class of countably-infinite-dimensional linear programs (CILPs) whose feasible sets are bounded subsets of appropriately defined spaces of measures. The optimal value, optimal points, and minimal points of these CILPs can be…

Optimization and Control · Mathematics 2020-12-02 Juan Kuntz , Philipp Thomas , Guy-Bart Stan , Mauricio Barahona

Given two arbitrary closed sets in Euclidean space, a simple transversality condition guarantees that the method of alternating projections converges locally, at linear rate, to a point in the intersection. Exact projection onto nonconvex…

Optimization and Control · Mathematics 2018-11-06 Dmitriy Drusvyatskiy , Adrian S. Lewis

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum

Optimization algorithms such as projected Newton's method, FISTA, mirror descent, and its variants enjoy near-optimal regret bounds and convergence rates, but suffer from a computational bottleneck of computing ``projections'' in…

Machine Learning · Computer Science 2023-03-13 Jai Moondra , Hassan Mortagy , Swati Gupta

We define a new finite element method for a steady state elliptic problem with discontinuous diffusion coefficients where the meshes are not aligned with the interface. We prove optimal error estimates in the $L^2$ norm and $H^1$ weighted…

Numerical Analysis · Mathematics 2016-10-18 Johnny Guzman , Manuel A. Sanchez , Marcus Sarkis

Under conditions that prevent tangential intersection, we prove quadratic convergence of a projection algorithm for the feasibility problem of finding a point in the intersection of a smooth curve and line in $\mathbb{R}^2$. This nonconvex…

Optimization and Control · Mathematics 2025-10-22 Jordan Collard , Scott B. Lindstrom

We propose a new subgradient method for the minimization of nonsmooth convex functions over a convex set. To speed up computations we use adaptive approximate projections only requiring to move within a certain distance of the exact…

Optimization and Control · Mathematics 2015-03-19 Dirk A. Lorenz , Marc E. Pfetsch , Andreas M. Tillmann

We derive a priori error estimates for Nitsche's method applied to elliptic problems on approximate domains. Such approximations arise, for example, in unfitted finite element methods, data-driven simulations, and evolving domain problems,…

Numerical Analysis · Mathematics 2026-04-02 Mats G. Larson , Karl Larsson , Shantiram Mahata

In this paper, we consider the iterative method of subspace corrections with random ordering. We prove identities for the expected convergence rate, which can provide sharp estimates for the error reduction per iteration. We also study the…

Numerical Analysis · Mathematics 2018-10-11 Xiaozhe Hu , Jinchao Xu , Ludmil Zikatanov

This paper considers a networked system with a finite number of users and supposes that each user tries to minimize its own private objective function over its own private constraint set. It is assumed that each user's constraint set can be…

Optimization and Control · Mathematics 2015-10-22 Hideaki Iiduka

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

We prove hp-optimal error estimates for the original DG method when approximating solutions to first-order hyperbolic problems with constant convection fields in the L2 and DG norms. The main theoretical tools used in the analysis are novel…

Numerical Analysis · Mathematics 2024-07-10 Zhaonan Dong , Lorenzo Mascotto

Motivated by optimization with differential equations, we consider optimization problems with Hilbert spaces as decision spaces. As a consequence of their infinite dimensionality, the numerical solution necessitates finite dimensional…

Optimization and Control · Mathematics 2025-07-01 Danlin Li , Johannes Milz

We consider the projected gradient algorithm for the nonconvex best subset selection problem that minimizes a given empirical loss function under an $\ell_0$-norm constraint. Through decomposing the feasible set of the given sparsity…

Optimization and Control · Mathematics 2026-02-13 Jan Harold Alcantara , Ching-pei Lee

In this article we present a modified S-iteration process that we combine with inertial extrapolation to find a common solution to the split monotone inclusion problem and the fixed point problem in real Hilbert space.Our goal is to…

Numerical Analysis · Mathematics 2021-10-11 Shamshad Husain , Uqba Rafat

A simple yet efficient computational algorithm for computing the continuous optimal experimental design for linear models is proposed. An alternative proof the monotonic convergence for $D$-optimal criterion on continuous design spaces are…

Computation · Statistics 2018-04-10 Jiangtao Duan , Wei Gao , Hon Keung Tony Ng

This work constructs Jonson-Lindenstrauss embeddings with best accuracy, as measured by variance, mean-squared error and exponential concentration of the length distortion. Lower bounds for any data and embedding dimensions are determined,…

Machine Learning · Computer Science 2021-01-05 Maciej Skorski