English
Related papers

Related papers: Flexible Differentiable Optimization via Model Tra…

200 papers

End-to-end optimization, which simultaneously optimizes optics and algorithms, has emerged as a powerful data-driven method for computational imaging system design. This method achieves joint optimization through backpropagation by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Chi-Jui Ho , Yash Belhe , Steve Rotenberg , Ravi Ramamoorthi , Tzu-Mao Li , Nicholas Antipa

Optimization of Mixed-Integer Non-Linear Programming (MINLP) supports important decisions in applications such as Chemical Process Engineering. But current solvers have limited ability for deductive reasoning or the use of domain-specific…

Artificial Intelligence · Computer Science 2017-02-07 Andrea Callia D'Iddio , Michael Huth

Many real-world engineering problems rely on human preferences to guide their design and optimization. We present PrefOpt, an open source package to simplify sequential optimization tasks that incorporate human preference feedback. Our…

Machine Learning · Computer Science 2018-01-10 Ian Dewancker , Jakob Bauer , Michael McCourt

Recent work has shown how to embed differentiable optimization problems (that is, problems whose solutions can be backpropagated through) as layers within deep learning architectures. This method provides a useful inductive bias for certain…

Machine Learning · Computer Science 2019-10-29 Akshay Agrawal , Brandon Amos , Shane Barratt , Stephen Boyd , Steven Diamond , Zico Kolter

Dynamic languages have become popular for scientific computing. They are generally considered highly productive, but lacking in performance. This paper presents Julia, a new dynamic language for technical computing, designed for performance…

Programming Languages · Computer Science 2012-09-25 Jeff Bezanson , Stefan Karpinski , Viral B. Shah , Alan Edelman

Differentiating through the solution of a quadratic program (QP) is a central problem in differentiable optimization. Most existing approaches differentiate through the Karush--Kuhn--Tucker (KKT) system, but their computational cost and…

Machine Learning · Computer Science 2026-03-04 Yuxuan Linghu , Zhiyuan Liu , Qi Deng

In this work, we develop an adaptive, multivariate partitioning algorithm for solving mixed-integer nonlinear programs (MINLP) with multi-linear terms to global optimality. This iterative algorithm primarily exploits the advantages of…

Optimization and Control · Mathematics 2019-02-05 Harsha Nagarajan , Mowen Lu , Site Wang , Russell Bent , Kaarthik Sundar

The differentiable programming paradigm is a cornerstone of modern scientific computing. It refers to numerical methods for computing the gradient of a numerical model's output. Many scientific models are based on differential equations,…

For combinatorial optimization problems, model-based paradigms such as mixed-integer programming (MIP) and constraint programming (CP) aim to decouple modeling and solving a problem: the `holy grail' of declarative problem solving. We…

Artificial Intelligence · Computer Science 2026-03-13 Ryo Kuroiwa , J. Christopher Beck

We consider a class of optimization problems that involve determining the maximum value that a function in a particular class can attain subject to a collection of difference constraints. We show that a particular linear programming…

Data Structures and Algorithms · Computer Science 2022-11-16 Sungjin Im , Benjamin Moseley , Hung Q. Ngo , Kirk Pruhs , Alireza Samadian

The Predict-Then-Optimize framework uses machine learning models to predict unknown parameters of an optimization problem from exogenous features before solving. This setting is common to many real-world decision processes, and recently it…

Machine Learning · Computer Science 2024-09-10 James Kotary , Vincenzo Di Vito , Jacob Cristopher , Pascal Van Hentenryck , Ferdinando Fioretto

We present the preliminary high-level design and features of DynamicPPL.jl, a modular library providing a lightning-fast infrastructure for probabilistic programming. Besides a computational performance that is often close to or better than…

Machine Learning · Computer Science 2020-02-10 Mohamed Tarek , Kai Xu , Martin Trapp , Hong Ge , Zoubin Ghahramani

The paradigm of differentiable programming has significantly enhanced the scope of machine learning via the judicious use of gradient-based optimization. However, standard differentiable programming methods (such as autodiff) typically…

Recently, the joint design of optical systems and downstream algorithms is showing significant potential. However, existing rays-described methods are limited to optimizing geometric degradation, making it difficult to fully represent the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Zheng Ren , Jingwen Zhou , Wenguan Zhang , Jiapu Yan , Bingkun Chen , Huajun Feng , Shiqi Chen

Transforming constraint models is an important task in re- cent constraint programming systems. User-understandable models are defined during the modeling phase but rewriting or tuning them is manda- tory to get solving-efficient models. We…

Artificial Intelligence · Computer Science 2010-02-17 Raphael Chenouard , Laurent Granvilliers , Ricardo Soto

We present a Julia-based interface to the precompiled HALLaR and cuHALLaR binaries for large-scale semidefinite programs (SDPs). Both solvers are established as fast and numerically stable, and accept problem data in formats compatible with…

Optimization and Control · Mathematics 2025-08-25 Jacob Aguirre , Diego Cifuentes , Vincent Guigues , Renato D. C. Monteiro , Victor Hugo Nascimento , Arnesh Sujanani

We extend Robust Optimization to fractional programming, where both the objective and the constraints contain uncertain parameters. Earlier work did not consider uncertainty in both the objective and the constraints, or did not use Robust…

Optimization and Control · Mathematics 2015-08-21 Bram L. Gorissen

Differentiable optimization has received a significant amount of attention due to its foundational role in the domain of machine learning based on neural networks. This paper proposes a differentiable layer, named Differentiable Frank-Wolfe…

Machine Learning · Computer Science 2024-04-01 Zixuan Liu , Liu Liu , Xueqian Wang , Peilin Zhao

Optimization on manifolds is a class of methods for optimization of an objective function, subject to constraints which are smooth, in the sense that the set of points which satisfy the constraints admits the structure of a differentiable…

Mathematical Software · Computer Science 2020-09-03 James Townsend , Niklas Koep , Sebastian Weichwald

Dynamic programming (DP) is a fundamental method in operations research, but formulating DP models has traditionally required expert knowledge of both the problem context and DP techniques. Large Language Models (LLMs) offer the potential…

Artificial Intelligence · Computer Science 2026-04-02 Chenyu Zhou , Jingyuan Yang , Linwei Xin , Yitian Chen , Ziyan He , Dongdong Ge