English
Related papers

Related papers: A General and Streamlined Differentiable Optimizat…

200 papers

This paper presents Diff-Explainer, the first hybrid framework for explainable multi-hop inference that integrates explicit constraints with neural architectures through differentiable convex optimization. Specifically, Diff-Explainer…

Computation and Language · Computer Science 2022-06-23 Mokanarangan Thayaparan , Marco Valentino , Deborah Ferreira , Julia Rozanova , André Freitas

An interior-point algorithm framework is proposed, analyzed, and tested for solving nonlinearly constrained continuous optimization problems. The main setting of interest is when the objective and constraint functions may be nonlinear…

Optimization and Control · Mathematics 2024-08-30 Frank E. Curtis , Xin Jiang , Qi Wang

Ensuring solution feasibility is a key challenge in developing Deep Neural Network (DNN) schemes for solving constrained optimization problems, due to inherent DNN prediction errors. In this paper, we propose a ``preventive learning''…

Machine Learning · Computer Science 2023-05-18 Tianyu Zhao , Xiang Pan , Minghua Chen , Steven H. Low

Dynamic programming (DP) solves a variety of structured combinatorial problems by iteratively breaking them down into smaller subproblems. In spite of their versatility, DP algorithms are usually non-differentiable, which hampers their use…

Machine Learning · Statistics 2018-02-21 Arthur Mensch , Mathieu Blondel

We propose a method that enables practitioners to conveniently incorporate custom non-decomposable performance metrics into differentiable learning pipelines, notably those based upon neural network architectures. Our approach is based on…

Machine Learning · Computer Science 2020-03-04 Rizal Fathony , J. Zico Kolter

Fast, gradient-based structural optimization has long been limited to a highly restricted subset of problems -- namely, density-based compliance minimization -- for which gradients can be analytically derived. For other objective functions,…

Computational Engineering, Finance, and Science · Computer Science 2024-09-17 Keith J. Lee , Yijiang Huang , Caitlin T. Mueller

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

Optimization and Control · Mathematics 2025-11-03 Damilola Fasiku , Wentao Tang

Data-driven inverse optimization for mixed-integer linear programs (MILPs), which seeks to learn an objective function and constraints consistent with observed decisions, is important for building accurate mathematical models in a variety…

Optimization and Control · Mathematics 2026-02-17 Akira Kitaoka

The ability to differentiate through optimization problems has unlocked numerous applications, from optimization-based layers in machine learning models to complex design problems formulated as bilevel programs. It has been shown that…

Optimization and Control · Mathematics 2024-03-05 Lucas Fuentes Valenzuela , Robin Brown , Marco Pavone

Differentiating through the solution of a quadratic program (QP) is a central problem in differentiable optimization. Most existing approaches differentiate through the Karush--Kuhn--Tucker (KKT) system, but their computational cost and…

Machine Learning · Computer Science 2026-03-04 Yuxuan Linghu , Zhiyuan Liu , Qi Deng

We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic…

Optimization and Control · Mathematics 2021-08-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

This paper introduces a novel Differential Dynamic Programming (DDP) algorithm for solving discrete-time finite-horizon optimal control problems with inequality constraints. Two variants, namely Feasible- and Infeasible-IPDDP algorithms,…

Systems and Control · Electrical Eng. & Systems 2020-10-21 Andrei Pavlov , Iman Shames , Chris Manzie

Predicting the future states of surrounding traffic participants and planning a safe, smooth, and socially compliant trajectory accordingly is crucial for autonomous vehicles. There are two major issues with the current autonomous driving…

Robotics · Computer Science 2023-02-21 Zhiyu Huang , Haochen Liu , Jingda Wu , Chen Lv

Prompt optimization has become crucial for enhancing the performance of large language models (LLMs) across a broad range of tasks. Although many research papers demonstrate its effectiveness, practical adoption is hindered because existing…

Computation and Language · Computer Science 2026-02-24 Tom Zehle , Timo Heiß , Moritz Schlager , Matthias Aßenmacher , Matthias Feurer

In this paper we present an extremely general method for approximately solving a large family of convex programs where the solution can be divided between different agents, subject to joint differential privacy. This class includes…

Data Structures and Algorithms · Computer Science 2018-03-16 Justin Hsu , Zhiyi Huang , Aaron Roth , Zhiwei Steven Wu

Proprietary closed-source software is still the norm in advanced process control. Transparency and reproducibility are key aspects of scientific research. Free and open-source toolkit can contribute to the development, sharing and…

Systems and Control · Electrical Eng. & Systems 2026-05-07 Francis Gagnon , Alex Thivierge , André Desbiens , Fredrik Bagge Carlson

We develop an open-source, end-to-end software (named QHDOPT), which can solve nonlinear optimization problems using the quantum Hamiltonian descent (QHD) algorithm. QHDOPT offers an accessible interface and automatically maps tasks to…

Quantum Physics · Physics 2024-09-06 Samuel Kushnir , Jiaqi Leng , Yuxiang Peng , Lei Fan , Xiaodi Wu

We propose a novel analysis framework for non-descent-type optimization methodologies in nonconvex scenarios based on the Kurdyka-Lojasiewicz property. Our framework allows covering a broad class of algorithms, including those commonly…

Optimization and Control · Mathematics 2024-06-05 Junwen Qiu , Bohao Ma , Xiao Li , Andre Milzarek

We propose a new primal-dual algorithmic framework for a prototypical constrained convex optimization template. The algorithmic instances of our framework are universal since they can automatically adapt to the unknown Holder continuity…

Optimization and Control · Mathematics 2015-11-09 Alp Yurtsever , Quoc Tran-Dinh , Volkan Cevher

Learning-based optimal control algorithms control unknown systems using past trajectory data and a learned model of the system dynamics. These controllers use either a linear approximation of the learned dynamics, trading performance for…

Systems and Control · Electrical Eng. & Systems 2023-07-21 Adam W. Hall , Melissa Greeff , Angela P. Schoellig