English
Related papers

Related papers: Blocked Cholesky factorization updates of the Ricc…

200 papers

The dominant cost in solving least-square problems using Newton's method is often that of factorizing the Hessian matrix over multiple values of the regularization parameter ($\lambda$). We propose an efficient way to interpolate the…

Machine Learning · Computer Science 2015-06-11 Da Kuang , Alex Gittens , Raffay Hamid

Recent strides in nonlinear model predictive control (NMPC) underscore a dependence on numerical advancements to efficiently and accurately solve large-scale problems. Given the substantial number of variables characterizing typical…

Robotics · Computer Science 2024-06-04 Wilson Jallet , Ewen Dantec , Etienne Arlaud , Justin Carpentier , Nicolas Mansard

We propose a new policy, called the LP-update policy, to solve finite horizon weakly-coupled Markov decision processes. The latter can be seen as multi-constraint multi-action bandits, and generalize the classical restless bandit problems.…

Optimization and Control · Mathematics 2024-05-08 Nicolas Gast , Bruno Gaujal , Chen Yan

In model predictive control (MPC), the choice of cost-weighting matrices and designing the Hessian matrix directly affects the trade-off between rapid state regulation and minimizing the control effort. However, traditional MPC in quadratic…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Komeil Nosrati , Juri Belikov , Aleksei Tepljakov , Eduard Petlenkov

In this work we introduce and study novel Quasi Newton minimization methods based on a Hessian approximation Broyden Class-\textit{type} updating scheme, where a suitable matrix $\tilde{B}_k$ is updated instead of the current Hessian…

Numerical Analysis · Mathematics 2020-01-22 S. Cipolla , C. Di Fiore , P. Zellini

A method is presented for parallelizing the computation of solutions to discrete-time, linear-quadratic, finite-horizon optimal control problems, which we will refer to as LQR problems. This class of problem arises frequently in robotic…

Optimization and Control · Mathematics 2018-09-18 Forrest Laine , Claire Tomlin

We analyze Newton's method with lazy Hessian updates for solving general possibly non-convex optimization problems. We propose to reuse a previously seen Hessian for several iterations while computing new gradients at each step of the…

Optimization and Control · Mathematics 2023-06-16 Nikita Doikov , El Mahdi Chayti , Martin Jaggi

The emergence of low precision floating-point arithmetic in computer hardware has led to a resurgence of interest in the use of mixed precision numerical linear algebra. For linear systems of equations, there has been renewed enthusiasm for…

Numerical Analysis · Mathematics 2024-02-22 Jennifer Scott , Miroslav Tůma

We develop a decomposition method based on the augmented Lagrangian framework to solve a broad family of semidefinite programming problems, possibly with nonlinear objective functions, nonsmooth regularization, and general linear…

Optimization and Control · Mathematics 2023-03-08 Yifei Wang , Kangkang Deng , Haoyang Liu , Zaiwen Wen

In this work, we consider two types of large-scale quadratic matrix equations: Continuous-time algebraic Riccati equations, which play a central role in optimal and robust control, and unilateral quadratic matrix equations, which arise from…

Numerical Analysis · Mathematics 2019-03-07 Daniel Kressner , Patrick Kürschner , Stefano Massei

The low-rank alternating direction implicit (ADI) method is an efficient and effective solver for large-scale standard continuous-time algebraic Riccati equations that admit low-rank solutions. However, the existing low-rank ADI algorithm…

Numerical Analysis · Mathematics 2026-04-16 Umair Zulfiqar

Null space Newton algorithms are efficient in solving the nonlinear equations arising in hydraulic analysis of water distribution networks. In this article, we propose and evaluate an inexact Newton method that relies on partial updates of…

Systems and Control · Computer Science 2016-02-09 Edo Abraham , Ivan Stoianov

In almost all algorithms for Model Predictive Control (MPC), the most time-consuming step is to solve some form of Linear Quadratic (LQ) Optimal Control Problem (OCP) repeatedly. The commonly recognized best option for this is a Riccati…

Optimization and Control · Mathematics 2025-12-08 Shaohui Yang , Toshiyuki Ohtsuka , Colin N. Jones

The Sequential Linear Quadratic (SLQ) algorithm is a continuous-time variant of the well-known Differential Dynamic Programming (DDP) technique with a Gauss-Newton Hessian approximation. This family of methods has gained popularity in the…

Robotics · Computer Science 2021-03-29 Jean-Pierre Sleiman , Farbod Farshidian , Marco Hutter

This paper consists of a tutorial on the Augmented Lagrangian based Alternating Direction Inexact Newton method (ALADIN) and its application to distributed model predictive control (MPC). The focus is - for simplicity of presentation - on…

Optimization and Control · Mathematics 2022-04-05 Boris Houska , Jiahe Shi

This paper studies quasi-Newton methods for solving strongly-convex-strongly-concave saddle point problems (SPP). We propose greedy and random Broyden family updates for SPP, which have explicit local superlinear convergence rate of…

Optimization and Control · Mathematics 2022-04-12 Chengchang Liu , Luo Luo

We present a method for updating certain hierarchical factorizations for solving linear integral equations with elliptic kernels. In particular, given a factorization corresponding to some initial geometry or material parameters, we can…

Numerical Analysis · Mathematics 2017-02-15 Victor Minden , Anil Damle , Kenneth L. Ho , Lexing Ying

This paper proposes an effective low-rank alternating direction doubling algorithm (R-ADDA) for computing numerical low-rank solutions to large-scale sparse continuous-time algebraic Riccati matrix equations. The method is based on the…

Numerical Analysis · Mathematics 2024-04-23 Juan Zhang , Wenlu Xun

We present an accelerated, or 'look-ahead' version of the Newton-Dinkelbach method, a well-known technique for solving fractional and parametric optimization problems. This acceleration halves the Bregman divergence between the current…

Data Structures and Algorithms · Computer Science 2021-05-24 Daniel Dadush , Zhuan Khye Koh , Bento Natura , László A. Végh

In this work, a new algorithm for solving symmetric indefinite systems of linear equations is presented. It factorizes the matrix into the form LDLt using Jacobi rotations in order to increase the pivot's absolute value. Furthermore, Rook's…

Numerical Analysis · Mathematics 2025-01-30 Ibai Coria , Gorka Urkullu , Haritz Uriarte , Igor Fernández de Bustos