Higher-Order Derivatives Do Not Accelerate the Computation of Fixed Points
Optimization and Control
2026-07-07 v1
Abstract
The Picard iteration converges to the unique fixed point of a -contractive operator at a linear rate , and a lower bound with an affine construction shows that no deterministic method querying only operator values can do better. But what about higher-order methods that query derivatives? A single Jacobian evaluation reveals an affine map entirely, so the affine construction says nothing about higher-order methods. In this work, we show that finite-order derivative information still does not accelerate the worst-case complexity for smooth contractive fixed-point computation. This contrasts with higher-order smooth minimization, where higher-order derivatives do improve worst-case rates for convex and non-convex minimization.
Cite
@article{arxiv.2607.05947,
title = {Higher-Order Derivatives Do Not Accelerate the Computation of Fixed Points},
author = {Uijeong Jang and Ernest K. Ryu},
journal= {arXiv preprint arXiv:2607.05947},
year = {2026}
}
Comments
22 pages