English
Related papers

Related papers: A Penalty Approach for Differentiation Through Bla…

200 papers

In this paper, we consider the problem of minimizing a smooth function, given as finite sum of black-box functions, over a convex set. In order to advantageously exploit the structure of the problem, for instance when the terms of the…

Optimization and Control · Mathematics 2026-03-13 Francesco Cecere , Matteo Lapucci , Davide Pucci , Marco Sciandrone

Quality-Diversity (QD) algorithms constitute a branch of optimization that is concerned with discovering a diverse and high-quality set of solutions to an optimization problem. Current QD methods commonly maintain diversity by dividing the…

Machine Learning · Computer Science 2026-03-05 Saeed Hedayatian , Stefanos Nikolaidis

We introduce a variational quantum algorithm to solve unconstrained black box binary optimization problems, i.e., problems in which the objective function is given as black box. This is in contrast to the typical setting of quantum…

This paper investigates the performance of Newton's method, iterative Linear Quadratic Regulator (iLQR), and Differential Dynamic Programming (DDP) in solving discrete-time optimal control problems. We offer a unified perspective on these…

Optimization and Control · Mathematics 2026-05-26 Abhijeet , Suman Chakravorty

We introduce BayeSQP, a novel algorithm for general black-box optimization that merges the structure of sequential quadratic programming with concepts from Bayesian optimization. BayeSQP employs second-order Gaussian process surrogates for…

Machine Learning · Computer Science 2026-02-04 Paul Brunzema , Sebastian Trimpe

We propose a deep learning algorithm for high dimensional optimal stopping problems. Our method is inspired by the penalty method for solving free boundary PDEs. Within our approach, the penalized PDE is approximated using the Deep BSDE…

Mathematical Finance · Quantitative Finance 2026-04-07 Yunfei Peng , Pengyu Wei , Wei Wei

Determinantal point processes (DPPs) offer an elegant tool for encoding probabilities over subsets of a ground set. Discrete DPPs are parametrized by a positive semidefinite matrix (called the DPP kernel), and estimating this kernel is key…

Machine Learning · Computer Science 2015-10-12 Zelda Mariet , Suvrit Sra

Quantum optimization holds promise for addressing classically intractable combinatorial problems, yet a standardized framework for benchmarking its performance, particularly in terms of solution quality, computational speed, and scalability…

Quantum Physics · Physics 2025-03-20 Monit Sharma , Hoong Chuin Lau

We consider a parametric convex quadratic programming, CQP, relaxation for the quadratic knapsack problem, QKP. This relaxation maintains partial quadratic information from the original QKP by perturbing the objective function to obtain a…

Optimization and Control · Mathematics 2019-06-11 Marcia Fampa , Daniela Cristina Lubke , Fei Wang , Henry Wolkowicz

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

In real-world optimisation, it is common to face several sub-problems interacting and forming the main problem. There is an inter-dependency between the sub-problems, making it impossible to solve such a problem by focusing on only one…

Neural and Evolutionary Computing · Computer Science 2023-01-05 Adel Nikfarjam , Aneta Neumann , Frank Neumann

We study the problem of Query Performance Prediction (QPP) for open-domain multi-hop Question Answering (QA), where the task is to estimate the difficulty of evaluating a multi-hop question over a corpus. Despite the extensive research on…

Computation and Language · Computer Science 2023-08-15 Mohammadreza Samadi , Davood Rafiei

We propose a quantum-assisted framework for solving constrained finite-horizon nonlinear optimal control problems using a barrier Sequential Quadratic Programming (SQP) approach. Within this framework, a quantum subroutine is incorporated…

Quantum Physics · Physics 2025-10-22 Nahid Binandeh Dehaghani , Rafal Wisniewski , A. Pedro Aguiar

The exponential run time of quantum simulators on classical machines and long queue times and high costs of real quantum devices present significant challenges in the efficient optimization of Variational Quantum Algorithms (VQAs) like…

Quantum Physics · Physics 2024-02-21 Satwik Kundu , Debarshi Kundu , Swaroop Ghosh

Solving linear systems and quadratic programming (QP) problems are both ubiquitous tasks in the engineering and computing fields. Direct methods for solving systems, such as Cholesky, LU, and QR factorizations, exhibit data-independent time…

Optimization and Control · Mathematics 2025-07-08 Liang Wu , Richard D. Braatz

Quantum computing offers significant potential for solving NP-hard combinatorial (optimization) problems that are beyond the reach of classical computers. One way to tap into this potential is by reformulating combinatorial problems as a…

The classical method to solve a quadratic optimization problem with nonlinear equality constraints is to solve the Karush-Kuhn-Tucker (KKT) optimality conditions using Newton's method. This approach however is usually computationally…

Optimization and Control · Mathematics 2016-03-17 Tuan T. Nguyen , Mircea Lazar , Hans Butler

In this paper we consider the discounted 0-1 knapsack problem (DKP), which is an extension of the classical knapsack problem where a set of items is decomposed into groups of three items. At most one item can be chosen from each group and…

Optimization and Control · Mathematics 2022-01-05 C. Wilbaut , R. Todosijevic , S. Hanafi , A. Fréville

This paper explores two condensed-space interior-point methods to efficiently solve large-scale nonlinear programs on graphics processing units (GPUs). The interior-point method solves a sequence of symmetric indefinite linear systems, or…

Optimization and Control · Mathematics 2025-08-15 François Pacaud , Sungho Shin , Alexis Montoison , Michel Schanen , Mihai Anitescu

This paper presents an efficient parallel Cholesky factorization and triangular solve algorithm for the Karush-Kuhn-Tucker (KKT) systems arising in multistage optimization problems, with a focus on model predictive control and trajectory…

Optimization and Control · Mathematics 2025-11-04 Fenglong Song , Roland Schwan , Yuwen Chen , Colin N. Jones