English
Related papers

Related papers: Automatic Differentiation for the Direct Minimizat…

200 papers

Autonomous optimization refers to the design of feedback controllers that steer a physical system to a steady state that solves a predefined, possibly constrained, optimization problem. As such, no exogenous control inputs such as setpoints…

Optimization and Control · Mathematics 2020-10-08 Adrian Hauswirth , Saverio Bolognani , Gabriela Hug , Florian Dörfler

This paper concerns a first-order algorithmic technique for a class of optimal control problems defined on switched-mode hybrid systems. The salient feature of the algorithm is that it avoids the computation of Fr\'echet or G\^ateaux…

Optimization and Control · Mathematics 2016-09-13 Yorai Wardi , Magnus Egerstedt , Muhammad Umer Qureshi

We study a generalized defocusing Hartree equation with nonlocal exchange potential and repulsive Hartree--Fock interaction. Using an inverse optimal problem (IOP) approach, we prove the existence and uniqueness of ground state solutions.…

Analysis of PDEs · Mathematics 2026-01-22 Yavdat Il'yasov , Juntao Sun , Nur Valeev , Shuai Yao

Discrete gradient methods are a class of numerical integrators producing solutions with exact preservation of first integrals of ordinary differential equations. In this paper, we apply order theory combined with the symmetrized Itoh--Abe…

Numerical Analysis · Mathematics 2026-01-13 Håkon Noren Myhr , Sølve Eidnes

In this paper, we propose objective-function-free (OFF) variants of the proximal Newton method for nonconvex composite optimization problems and the regularized Newton method for unconstrained optimization problems, respectively, using…

Optimization and Control · Mathematics 2026-05-19 Hong Zhu

Motivated by industrial computed tomography, we propose a memory efficient strategy to estimate the regularization hyperparameter of a non-smooth variational model. The approach is based on a combination of FISTA and Condat-Vu algorithms…

Numerical Analysis · Mathematics 2024-12-16 Patricio Guerrero , Simon Bellens , Wim Dewulf

This paper introduces a novel methodology leveraging differentiable programming to design efficient, constrained adaptive non-uniform Linear Differential Microphone Arrays (LDMAs) with reduced implementation costs. Utilizing an automatic…

Sound · Computer Science 2024-12-09 Siminfar Samakoush Galougah , Ramani Duraiswami

We demonstrate a practical differentiable programming approach for acoustic inverse problems through two applications: admittance estimation and shape optimization for resonance damping. First, we show that JAX-FEM's automatic…

Machine Learning · Computer Science 2025-11-17 Nikolas Borrel-Jensen , Josiah Bjorgaard

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

Optimization and Control · Mathematics 2025-11-03 Damilola Fasiku , Wentao Tang

We propose a new method, that we coined the ``morphism-trick'', to integrate custom implementations of vector-Jacobian products in automatic differentiation softwares, applicable to a wide range of semiring-based computations. Our approach…

Formal Languages and Automata Theory · Computer Science 2026-02-16 Lucas Ondel Yang , Tina Raissi , Martin Kocour , Pablo Riera , Caio Corro

We propose a forward-mode automatic differentiation (AD) framework for tensor renormalization group (TRG) methods. In this approach, evaluating the derivatives of the partition function up to order $k$ increases the matrix-multiplication…

High Energy Physics - Lattice · Physics 2026-02-12 Yuto Sugimoto

This article aims to demonstrate and discuss the applications of automatic differentiation (AD) for finding derivatives in PDE-constrained optimization problems and Jacobians in non-linear finite element analysis. The main idea is to…

Numerical Analysis · Mathematics 2025-06-03 Julian Andrej , Tzanio Kolev , Boyan Lazarov

The evaluation of exact (Hartree--Fock, HF) exchange operator is a crucial ingredient for the accurate description of electronic structure in periodic systems through ab initio and hybrid density functional approaches. An efficient…

Chemical Physics · Physics 2020-10-28 Xiao Wang , Cannada A. Lewis , Edward F. Valeev

Building on the observation that reverse-mode automatic differentiation (AD) -- a generalisation of backpropagation -- can naturally be expressed as pullbacks of differential 1-forms, we design a simple higher-order programming language…

Programming Languages · Computer Science 2020-02-20 Carol Mak , Luke Ong

Encoding frequency stability constraints in the operation problem is challenging due to its complex dynamics. Recently, data-driven approaches have been proposed to learn the stability criteria offline with the trained model embedded as a…

Systems and Control · Electrical Eng. & Systems 2024-07-23 Wangkun Xu , Qian Chen , Pudong Ge , Zhongda Chu , Fei Teng

Sparse decision trees are one of the most common forms of interpretable models. While recent advances have produced algorithms that fully optimize sparse decision trees for prediction, that work does not address policy design, because the…

Machine Learning · Computer Science 2022-10-27 Ali Behrouz , Mathias Lecuyer , Cynthia Rudin , Margo Seltzer

In many applications, it is desired to obtain extreme eigenvalues and eigenvectors of large Hermitian matrices by efficient and compact algorithms. In particular, orthogonalization-free methods are preferred for large-scale problems for…

Numerical Analysis · Mathematics 2023-12-05 Shixin Zheng , Haizhao Yang , Xiangxiong Zhang

This paper develops a first-order optimization method for coupled structured matrix factorization (CoSMF) problems that arise in the context of hyperspectral super-resolution (HSR) in remote sensing. To best leverage the problem structures…

Signal Processing · Electrical Eng. & Systems 2020-04-22 Ruiyuan Wu , Hoi-To Wai , Wing-Kin Ma

Thermodynamic and flash equilibrium calculations are the cornerstones of simulation process calculations. The iterative approach, a widely used nonlinear problem-solving technique, relies on derivative calculations throughout the procedure…

Computational Engineering, Finance, and Science · Computer Science 2023-11-21 Shaoyi Yang

The multiconfiguration time-dependent Hartree-Fock (MCTDHF) method is formulated for treating the coupled electronic and nuclear dynamics of diatomic molecules without the Born- Oppenheimer approximation. The method treats the full…

Computational Physics · Physics 2015-05-27 Daniel J. Haxton , Keith V. Lawler , C. William McCurdy