English
Related papers

Related papers: The worst-case root-convergence factor of GMRES(1)

200 papers

In the context of linear regression, we construct a data-driven convex loss function with respect to which empirical risk minimisation yields optimal asymptotic variance in the downstream estimation of the regression coefficients. At the…

Statistics Theory · Mathematics 2025-05-29 Oliver Y. Feng , Yu-Chun Kao , Min Xu , Richard J. Samworth

Extracting a small subset of representative tuples from a large database is an important task in multi-criteria decision making. The regret-minimizing set (RMS) problem is recently proposed for representative discovery from databases.…

Data Structures and Algorithms · Computer Science 2020-07-21 Yanhao Wang , Michael Mathioudakis , Yuchen Li , Kian-Lee Tan

Limit distributions for the greatest convex minorant and its derivative are considered for a general class of stochastic processes including partial sum processes and empirical processes, for independent, weakly dependent and long range…

Statistics Theory · Mathematics 2016-08-16 D. Anevski , O. Hössjer

We analyze the convergence of the Conjugate Gradient (CG) method in exact arithmetic, when the coefficient matrix $A$ is symmetric positive semidefinite and the system is consistent. To do so, we diagonalize $A$ and decompose the algorithm…

Numerical Analysis · Mathematics 2020-05-12 Ken Hayami

Generalized alternating projections is an algorithm that alternates relaxed projections onto a finite number of sets to find a point in their intersection. We consider the special case of two linear subspaces, for which the algorithm…

Optimization and Control · Mathematics 2017-03-31 Mattias Fält , Pontus Giselsson

The affine rank minimization (ARM) problem is well known for both its applications and the fact that it is NP-hard. One of the most successful approaches, yet arguably underrepresented, is iteratively reweighted least squares (IRLS), more…

Optimization and Control · Mathematics 2021-06-29 Sebastian Krämer

The magnetorotational instability (MRI) plays a crucial role in the evolution of many types of accretion disks. It is often studied using ideal-MHD numerical simulations. In principle, such simulations should be numerically converged, i.e.…

High Energy Astrophysical Phenomena · Physics 2025-11-11 Thomas Jannaud , Henrik N. Latter

The scope of this research is a problem of parameters identification of a linear time-invariant (LTI) plant, which 1) input signal is not frequency-rich, 2) is subjected to initial conditions and external disturbances. The memory regressor…

Systems and Control · Electrical Eng. & Systems 2020-10-02 Anton Glushchenko , Vladislav Petrov , Konstantin Lastochkin

In this paper, we study randomized and cyclic coordinate descent for convex unconstrained optimization problems. We improve the known convergence rates in some cases by using the numerical semidefinite programming performance estimation…

Optimization and Control · Mathematics 2022-12-26 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

We propose a new iteratively reweighted least squares (IRLS) algorithm for the recovery of a matrix $X \in \mathbb{C}^{d_1\times d_2}$ of rank $r \ll\min(d_1,d_2)$ from incomplete linear observations, solving a sequence of low complexity…

Numerical Analysis · Mathematics 2018-02-28 Christian Kümmerle , Juliane Sigl

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

Machine Learning · Computer Science 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

In many iterative optimization methods, fixed-point theory enables the analysis of the convergence rate via the contraction factor associated with the linear approximation of the fixed-point operator. While this factor characterizes the…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Trung Vu , Raviv Raich

We study the worst-case convergence rates of the proximal gradient method for minimizing the sum of a smooth strongly convex function and a non-smooth convex function whose proximal operator is available. We establish the exact worst-case…

Optimization and Control · Mathematics 2020-03-03 Adrien B. Taylor , Julien M. Hendrickx , François Glineur

The subject of the article is linear systems of wave equations on cosmological backgrounds with convergent asymptotics. The condition of convergence corresponds to the requirement that the second fundamental form, when suitably normalised,…

General Relativity and Quantum Cosmology · Physics 2021-01-14 Hans Ringström

We extend results of the recursive-least-squares-with-forgetting-factor identifier for single-input-single-output systems to the multiple-output case by, under the assumption of persistence of excitation, deriving the corresponding…

Optimization and Control · Mathematics 2020-03-17 Sven Brüggemann , Robert R. Bitmead

In the present paper we study a non-modular variant of the Short Integer Solution problem over the integers. Given a random matrix $A \in \mathbb{Z}^{n\times m}$ with entries $a_{ij}$ such that $0\le a_{ij}< Q,$ for some $Q>0,$ the goal is…

Cryptography and Security · Computer Science 2026-03-10 Konstantinos A. Draziotis , Myrto Eleftheria Gkogkou

In this work, we aim to establish the exact worst-case convergence rates of Douglas--Rachford splitting (DRS) and Davis--Yin splitting (DYS) when applied to convex optimization problems. Both DRS and DYS have two variants as swapping the…

Optimization and Control · Mathematics 2025-09-15 Edward Duc Hien Nguyen , Jaewook J. Suh , Xin Jiang , Shiqian Ma

In this paper, we study the functional linear multiplicative model based on the least product relative error criterion. Under some regularization conditions, we establish the consistency and asymptotic normality of the estimator. Further,…

Statistics Theory · Mathematics 2023-01-04 Qian Yan , Hanyu Li

Non-stationary approximations of the final value of a converging sequence are discussed, and we show that extremal eigenvalues can be reasonably estimated from the CG iterates without much computation at all. We introduce estimators of…

Numerical Analysis · Mathematics 2013-02-21 Divya Anand Subba , Murugesan Venkatapathi

We consider rather general structural equation models (SEMs) between a target and its covariates in several shifted environments. Given $k\in\mathbb{N}$ shifts we consider the set of shifts that are at most $\gamma$-times as strong as a…

Statistics Theory · Mathematics 2024-07-31 Philip Kennerberg , Ernst C. Wit