English
Related papers

Related papers: A conjugate-gradient-type rational Krylov subspace…

200 papers

We propose a variant of the classical conditional gradient method for sparse inverse problems with differentiable measurement models. Such models arise in many practical problems including superresolution, time-series modeling, and matrix…

Optimization and Control · Mathematics 2015-07-07 Nicholas Boyd , Geoffrey Schiebinger , Benjamin Recht

In this work, we propose a reduced basis method for efficient solution of parametric linear systems. The coefficient matrix is assumed to be a linear matrix-valued function that is symmetric and positive definite for admissible values of…

Numerical Analysis · Mathematics 2021-09-28 Antti Autio , Antti Hannukainen

Structured sparsity is an important modeling tool that expands the applicability of convex formulations for data analysis, however it also creates significant challenges for efficient algorithm design. In this paper we investigate the…

Optimization and Control · Mathematics 2014-10-20 Yaoliang Yu , Xinhua Zhang , Dale Schuurmans

Randomized Krylov subspace methods that employ the sketch-and-solve paradigm to substantially reduce orthogonalization cost have recently shown great promise in speeding up computations for many core linear algebra tasks (e.g., solving…

Numerical Analysis · Mathematics 2026-03-13 Emil Krieger , Marcel Schweitzer

This paper presents a general description of a parameter estimation inverse problem for systems governed by nonlinear differential equations. The inverse problem is presented using optimal control tools with state constraints, where the…

Numerical Analysis · Mathematics 2018-06-28 Mohamed Kamel Riahi , Issam Al Qattan

Thanks to its great potential in reducing both computational cost and memory requirements, combining sketching and Krylov subspace techniques has attracted a lot of attention in the recent literature on projection methods for linear…

Numerical Analysis · Mathematics 2024-06-12 Davide Palitta , Marcel Schweitzer , Valeria Simoncini

This paper describes a method for solving smooth nonconvex minimization problems subject to bound constraints with good worst-case complexity guarantees and practical performance. The method contains elements of two existing methods: the…

Optimization and Control · Mathematics 2023-06-08 Yue Xie , Stephen J. Wright

In this paper, based on the limited memory techniques and subspace minimization conjugate gradient (SMCG) methods, a regularized limited memory subspace minimization conjugate gradient method is proposed, which contains two types of…

Optimization and Control · Mathematics 2023-01-10 Wumei Sun , Hongwei Liu , Zexian Liu

The conjugate gradient method (CG) has long been the workhorse for inner-iterations of second-order algorithms for large-scale nonconvex optimization. Prominent examples include line-search based algorithms, e.g., Newton-CG, and those based…

Optimization and Control · Mathematics 2022-06-14 Yang Liu , Fred Roosta

Gravity inversion is the problem of estimating subsurface density distributions from observed gravitational field data. We consider the two-dimensional (2D) case, in which recovering density models from one-dimensional (1D) measurements…

Recently, inverse problems have attracted more and more attention in computational mathematics and become increasingly important in engineering applications. After the discretization, many of inverse problems are reduced to linear systems.…

Numerical Analysis · Mathematics 2022-04-07 Gong Rongfang , Huang Qin

The linear conjugate gradient method is an efficient iterative method for the convex quadratic minimization problems $ \mathop {\min }\limits_{x \in { \mathbb R^n}} f(x) =\dfrac{1}{2}x^TAx+b^Tx $, where $ A \in R^{n \times n} $ is symmetric…

Optimization and Control · Mathematics 2023-08-02 Zexian Liu , Qiao Li

Projected gradient methods are widely used for constrained optimization. A key application is for partial differential equations (PDEs), where the objective functional represents physical energy and the linear constraints enforce…

Optimization and Control · Mathematics 2025-06-05 Ruchi Guo , Jun Zou

We propose a scalable preconditioned primal-dual hybrid gradient algorithm for solving partial differential equations (PDEs). We multiply the PDE with a dual test function to obtain an inf-sup problem whose loss functional involves…

Numerical Analysis · Mathematics 2026-05-26 Shu Liu , Stanley Osher , Wuchen Li

This work is concerned with linear inverse problems where a distributed parameter is known a priori to only take on values from a given discrete set. This property can be promoted in Tikhonov regularization with the aid of a suitable convex…

Optimization and Control · Mathematics 2018-04-19 Christian Clason , Thi Bich Tram Do

Inverse problems are inherently ill-posed, suffering from non-uniqueness and instability. Classical regularization methods provide mathematically well-founded solutions, ensuring stability and convergence, but often at the cost of reduced…

Numerical Analysis · Mathematics 2026-01-21 Markus Haltmeier , Gyeongha Hwang

We present an active-set method for minimizing an objective that is the sum of a convex quadratic and $\ell_1$ regularization term. Unlike two-phase methods that combine a first-order active set identification step and a subspace phase…

Optimization and Control · Mathematics 2014-12-08 Stefan Solntsev , Jorge Nocedal , Richard Byrd

Mixed-effects models are widely used to model data with hierarchical grouping structures and high-cardinality categorical predictor variables. However, for high-dimensional crossed random effects, current standard computations relying on…

Methodology · Statistics 2026-05-15 Pascal Kündig , Fabio Sigrist

We study regularity and numerical methods for two-sided fractional diffusion equations with a lower-order term. We show that the regularity of the solution in weighted Sobolev spaces can be greatly improved compared to that in standard…

Numerical Analysis · Mathematics 2017-05-23 Zhaopeng Hao , Guang Lin , Zhongqiang Zhang

This monograph is centred at the intersection of three mathematical topics, that are theoretical in nature, yet with motivations and relevance deep rooted in applications: the linear inverse problems on abstract, in general…

Functional Analysis · Mathematics 2022-02-25 Noe Angelo Caruso , Alessandro Michelangeli