English
Related papers

Related papers: On Lagrange multipliers of constrained optimizatio…

200 papers

Constrained optimization offers a powerful framework to prescribe desired behaviors in neural network models. Typically, constrained problems are solved via their min-max Lagrangian formulations, which exhibit unstable oscillatory dynamics…

Machine Learning · Computer Science 2024-06-10 Motahareh Sohrabi , Juan Ramirez , Tianyue H. Zhang , Simon Lacoste-Julien , Jose Gallego-Posada

The present article is primarily a review of the projection-operator approach to quantize systems with constraints. We study the quantization of systems with general first- and second-class constraints from the point of view of…

High Energy Physics - Theory · Physics 2007-05-23 John R. Klauder

Constraint handling remains a key bottleneck in quantum combinatorial optimization. While slack-variable-based encodings are straightforward, they significantly increase qubit counts and circuit depth, challenging the scalability of quantum…

Quantum Physics · Physics 2025-08-12 Monit Sharma , Hoong Chuin Lau

The main contribution of this thesis is the development of a new algorithm for solving convex quadratic programs. It consists in combining the method of multipliers with an infeasible active-set method. Our approach is iterative. In each…

Optimization and Control · Mathematics 2014-09-19 Philipp Hungerländer

Problems involving rolling without slipping or no sideways skidding, to name a few, introduce velocity-dependent constraints that can be efficiently treated by the method of Lagrange multipliers in the Lagrangian formulation of the…

Classical Physics · Physics 2021-08-11 Nivaldo A. Lemos , Marco Moriconi

In this work, we focus on separable convex optimization problems with box constraints and a set of triangular linear constraints. The solution is given in closed-form as a function of some Lagrange multipliers that can be computed through…

Information Theory · Computer Science 2015-06-22 Antonio A. D'Amico , Luca Sanguinetti , Daniel P. Palomar

Constrained blackbox optimization is a difficult problem, with most approaches coming from the mathematical programming literature. The statistical literature is sparse, especially in addressing problems with nontrivial constraints. This…

Reasoning about the physical world requires models that are endowed with the right inductive biases to learn the underlying dynamics. Recent works improve generalization for predicting trajectories by learning the Hamiltonian or Lagrangian…

Machine Learning · Computer Science 2020-10-27 Marc Finzi , Ke Alexander Wang , Andrew Gordon Wilson

In this work, we develop a control-theoretic framework for constrained optimization problems with composite objective functions including non-differentiable terms. Building on the proximal augmented Lagrangian formulation, we construct a…

Optimization and Control · Mathematics 2026-05-05 V. Cerone , S. M. Fosson , S. Pirrera , A. Re , D. Regruto

In this note, three Lagrange multiplier rules introduced in the literature for set valued optimization problems are compared. A generalization of all three results is given which proves that under rather mild assumptions, $x$ is a weak…

Optimization and Control · Mathematics 2016-12-02 Carola Schrage

The Dirac-Bergmann algorithm is a recipe for converting a theory with a singular Lagrangian into a constrained Hamiltonian system. Constrained Hamiltonian systems include gauge theories -- general relativity, electromagnetism, Yang Mills,…

General Relativity and Quantum Cosmology · Physics 2022-03-10 J. David Brown

In this paper, we consider numerical approximations for the optimal partition problem using Lagrange multipliers. By rewriting it into constrained gradient flows, three and four steps numerical schemes based on the Lagrange multiplier…

Optimization and Control · Mathematics 2024-08-29 Qing Cheng , Jing Guo , Dong Wang

Stochastic sequential quadratic optimization (SQP) methods for solving continuous optimization problems with nonlinear equality constraints have attracted attention recently, such as for solving large-scale data-fitting problems subject to…

Optimization and Control · Mathematics 2023-08-08 Frank E. Curtis , Xin Jiang , Qi Wang

In the past years, augmented Lagrangian methods have been successfully applied to several classes of non-convex optimization problems, inspiring new developments in both theory and practice. In this paper we bring most of these recent…

Optimization and Control · Mathematics 2023-06-27 Roberto Andreani , Kelvin Rodrigues Couto , Orizon Pereira Ferreira , Gabriel Haeser

Augmented Lagrangian Methods (ALMs) are widely employed in solving constrained optimizations, and some efficient solvers are developed based on this framework. Under the quadratic growth assumption, it is known that the dual iterates and…

Optimization and Control · Mathematics 2024-10-31 Feng-Yi Liao , Lijun Ding , Yang Zheng

Necessary optimality conditions in Lagrangian form and the sequential minimization framework are extended to mixed-integer nonlinear optimization, without any convexity assumptions. Building upon a recently developed notion of local…

Optimization and Control · Mathematics 2026-04-10 Alberto De Marchi

We consider infinite programming problems with constraint sets defined by systems of infinite number of inequalities and equations given by continuously differentiable functions defined on Banach spaces. In the approach proposed here we…

Algebraic Topology · Mathematics 2022-12-14 Ewa M. Bednarczuk , Krzysztof W. Leśniewski , Krzysztof E. Rutkowski

The well-known Cahn-Hilliard equation entails mass conservation if a suitable boundary condition is prescribed. In the case when the equation is also coupled with a dynamic boundary condition, including the Laplace-Beltrami operator on the…

Analysis of PDEs · Mathematics 2014-12-08 Pierluigi Colli , Takeshi Fukao

In this paper, we study linearly constrained optimization problems (LCP). After applying Hadamard parametrization, the feasible set of the parametrized problem (LCPH) becomes an algebraic variety, with conducive geometric properties which…

Optimization and Control · Mathematics 2024-11-01 Tianyun Tang , Kim-Chuan Toh

Central issues of the Dirac constraint formalism are discussed in relation to the algorithmic methods of commutative algebra based on the Groebner basis techniques. For a wide class of finite dimensional polynomial degenerate Lagrangian…

Mathematical Physics · Physics 2007-05-23 V. Gerdt , A. Khvedelidze , Yu. Palii