English

A General and Streamlined Differentiable Optimization Framework

Machine Learning 2025-10-31 v1 Optimization and Control

Abstract

Differentiating through constrained optimization problems is increasingly central to learning, control, and large-scale decision-making systems, yet practical integration remains challenging due to solver specialization and interface mismatches. This paper presents a general and streamlined framework-an updated DiffOpt.jl-that unifies modeling and differentiation within the Julia optimization stack. The framework computes forward - and reverse-mode solution and objective sensitivities for smooth, potentially nonconvex programs by differentiating the KKT system under standard regularity assumptions. A first-class, JuMP-native parameter-centric API allows users to declare named parameters and obtain derivatives directly with respect to them - even when a parameter appears in multiple constraints and objectives - eliminating brittle bookkeeping from coefficient-level interfaces. We illustrate these capabilities on convex and nonconvex models, including economic dispatch, mean-variance portfolio selection with conic risk constraints, and nonlinear robot inverse kinematics. Two companion studies further demonstrate impact at scale: gradient-based iterative methods for strategic bidding in energy markets and Sobolev-style training of end-to-end optimization proxies using solver-accurate sensitivities. Together, these results demonstrate that differentiable optimization can be deployed as a routine tool for experimentation, learning, calibration, and design-without deviating from standard JuMP modeling practices and while retaining access to a broad ecosystem of solvers.

Keywords

Cite

@article{arxiv.2510.25986,
  title  = {A General and Streamlined Differentiable Optimization Framework},
  author = {Andrew W. Rosemberg and Joaquim Dias Garcia and François Pacaud and Robert B. Parker and Benoît Legat and Kaarthik Sundar and Russell Bent and Pascal Van Hentenryck},
  journal= {arXiv preprint arXiv:2510.25986},
  year   = {2025}
}

Comments

17 pages, 4 figures