English
Related papers

Related papers: A unifying framework for ADI-like methods for line…

200 papers

The alternating direction method of multipliers (ADM or ADMM) breaks a complex optimization problem into much simpler subproblems. The ADM algorithms are typically short and easy to implement yet exhibit (nearly) state-of-the-art…

Optimization and Control · Mathematics 2021-02-02 Ming Yan , Wotao Yin

We present a sparse grid high-order alternating direction implicit (ADI) scheme for option pricing in stochastic volatility models. The scheme is second-order in time and fourth-order in space. Numerical experiments confirm the…

Computational Finance · Quantitative Finance 2016-11-07 Bertram Düring , Christian Hendricks , James Miles

We consider the sequence acceleration problem for the alternating direction method-of-multipliers (ADMM) applied to a class of equality-constrained problems with strongly convex quadratic objectives, which frequently arise as the Newton…

Optimization and Control · Mathematics 2020-04-28 Richard Y. Zhang , Jacob K. White

Differential algebraic Riccati equations are at the heart of many applications in control theory. They are time-depent, matrix-valued, and in particular nonlinear equations that require special methods for their solution. Low-rank methods…

Numerical Analysis · Mathematics 2019-12-17 Tobias Breiten , Sergey Dolgov , Martin Stoll

This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex,…

Optimization and Control · Mathematics 2026-05-04 Leandro Farias Maia , David H. Gutman , Renato D. C. Monteiro , Gilson N. Silva

Iterative procedures for parameter estimation based on stochastic gradient descent allow the estimation to scale to massive data sets. However, in both theory and practice, they suffer from numerical instability. Moreover, they are…

Methodology · Statistics 2016-06-08 Panos Toulis , Dustin Tran , Edoardo M. Airoldi

We consider the solution of the Sylvester equation $AX+XB=C$ in mixed precision. We derive a new iterative refinement scheme to solve perturbed quasi-triangular Sylvester equations; our rounding error analysis provides sufficient conditions…

Numerical Analysis · Mathematics 2026-03-27 Andrii Dmytryshyn , Massimiliano Fasi , Nicholas J. Higham , Xiaobo Liu

We provide new insights into the a priori theory for a time-stepping scheme based on least-squares finite element methods for parabolic first-order systems. The elliptic part of the problem is of general reaction-convection-diffusion type.…

Numerical Analysis · Mathematics 2018-05-14 Thomas Führer , Michael Karkulik

Krylov subspace methods, such as the Conjugate Gradient (CG) and BiCGSTAB methods, are widely used in scientific computing for solving linear systems. In this study, we propose a new framework for solving large Sylvester equations in a…

Numerical Analysis · Mathematics 2026-05-28 Yuki Satake , Takeshi Fukaya , Tomohiro Sogabe , Shao-Liang Zhang

We develop two new variants of alternating direction methods of multipliers (ADMM) and two parallel primal-dual decomposition algorithms to solve a wide range class of constrained convex optimization problems. Our approach relies on a novel…

Optimization and Control · Mathematics 2018-06-15 Quoc Tran-Dinh , Yuzixuan Zhu

The family of temporal difference (TD) methods span a spectrum from computationally frugal linear methods like TD({\lambda}) to data efficient least squares methods. Least square methods make the best use of available data directly…

Artificial Intelligence · Computer Science 2017-03-13 Yangchen Pan , Adam White , Martha White

We present a novel two-level sketching extension of the Alternating Anderson-Picard (AAP) method for accelerating fixed-point iterations in challenging single- and multi-physics simulations governed by discretized partial differential…

Numerical Analysis · Mathematics 2026-05-20 Nicolás A. Barnafi , Massimiliano Lupo Pasini

Recently Ahmadi et al. (2021) and Tagliaferro (2022) proposed some iterative methods for the numerical solution of linear systems which, under the classical hypothesis of strict diagonal dominance, typically converge faster than the Jacobi…

Numerical Analysis · Mathematics 2024-04-11 Paolo Novati , Fulvio Tagliaferro , Marino Zennaro

An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a…

Optimization and Control · Mathematics 2020-10-27 Jianchao Bai , William W. Hager , Hongchao Zhang

The alternating gradient descent (AGD) is a simple but popular algorithm which has been applied to problems in optimization, machine learning, data ming, and signal processing, etc. The algorithm updates two blocks of variables in an…

Optimization and Control · Mathematics 2018-03-01 Songtao Lu , Mingyi Hong , Zhengdao Wang

A nonlinear optimization method is proposed for the solution of inverse medium problems with spatially varying properties. To avoid the prohibitively large number of unknown control variables resulting from standard grid-based…

Numerical Analysis · Mathematics 2023-07-28 Yannik G. Gleichmann , Marcus J. Grote

In this work, we study time-splitting strategies for the numerical approximation of evolutionary reaction-diffusion problems. In particular, we formulate a family of domain decomposition splitting methods that overcomes some typical…

Numerical Analysis · Mathematics 2016-09-01 Andrés Arrarás , Laura Portero

A single-step high-order implicit time integration scheme for the solution of transient and wave propagation problems is presented. It is constructed from the Pad\'e expansions of the matrix exponential solution of a system of first-order…

Numerical Analysis · Mathematics 2022-06-10 Chongmin Song , Sascha Eisenträger

In the context of autonomous driving, the iterative linear quadratic regulator (iLQR) is known to be an efficient approach to deal with the nonlinear vehicle model in motion planning problems. Particularly, the constrained iLQR algorithm…

Robotics · Computer Science 2022-07-28 Jun Ma , Zilong Cheng , Xiaoxue Zhang , Masayoshi Tomizuka , Tong Heng Lee

Markov decision processes (MDPs) are used to model stochastic systems in many applications. Several efficient algorithms to compute optimal policies have been studied in the literature, including value iteration (VI) and policy iteration.…

Optimization and Control · Mathematics 2021-08-30 Vineet Goyal , Julien Grand-Clement