English
Related papers

Related papers: Pseudo basic steps: Bound improvement guarantees f…

200 papers

We consider the general polynomial optimization problem $P: f^*=\min \{f(x)\,:\,x\in K\}$ where $K$ is a compact basic semi-algebraic set. We first show that the standard Lagrangian relaxation yields a lower bound as close as desired to the…

Optimization and Control · Mathematics 2012-10-18 Jean Lasserre

This paper is concerned with a novel deep learning method for variational problems with essential boundary conditions. To this end, we first reformulate the original problem into a minimax problem corresponding to a feasible augmented…

Numerical Analysis · Mathematics 2022-05-10 Jianguo Huang , Haoqin Wang , Tao Zhou

In this paper, we suggest a new framework for analyzing primal subgradient methods for nonsmooth convex optimization problems. We show that the classical step-size rules, based on normalization of subgradient, or on the knowledge of optimal…

Optimization and Control · Mathematics 2023-11-27 Yurii Nesterov

Lagrangian Relaxation (LR) is a powerful technique for solving large-scale Mixed Integer Linear Programming (MILP), particularly those with decomposable structures, such as vehicle routing or unit commitment problems. By relaxing the…

Machine Learning · Statistics 2026-05-27 Tung Quoc Le , Anh Tuan Nguyen , Viet Anh Nguyen

This paper studies disjunctive cutting planes in Mixed-Integer Conic Programming. Building on conic duality, we formulate a cut-generating conic program for separating disjunctive cuts, and investigate the impact of the normalization…

Optimization and Control · Mathematics 2020-09-08 Andrea Lodi , Mathieu Tanneau , Juan Pablo Vielma

In this paper we propose a splitting scheme which hybridizes generalized conditional gradient with a proximal step which we call CGALP algorithm, for minimizing the sum of three proper convex and lower-semicontinuous functions in real…

Optimization and Control · Mathematics 2022-10-20 Antonio Silveti-Falls , Cesare Molinari , Jalal Fadili

Lagrangian relaxation stands among the most efficient approaches for solving a Mixed Integer Linear Programs (MILP) with difficult constraints. Given any duals for these constraints, called Lagrangian Multipliers (LMs), it returns a bound…

Machine Learning · Computer Science 2024-10-21 Francesco Demelas , Joseph Le Roux , Mathieu Lacroix , Axel Parmentier

We study the iteration complexity of Lipschitz convex optimization problems satisfying a general error bound. We show that for this class of problems, subgradient descent with either Polyak stepsizes or decaying stepsizes achieves minimax…

Optimization and Control · Mathematics 2025-12-17 Alex L. Wang

We propose a mini-batching scheme for improving the theoretical complexity and practical performance of semi-stochastic gradient descent applied to the problem of minimizing a strongly convex composite function represented as the sum of an…

Machine Learning · Computer Science 2014-10-20 Jakub Konečný , Jie Liu , Peter Richtárik , Martin Takáč

We consider the convex minimization model with both linear equality and inequality constraints, and reshape the classic augmented Lagrangian method (ALM) by balancing its subproblems. As a result, one of its subproblems decouples the…

Optimization and Control · Mathematics 2021-08-20 Bingsheng He , Xiaoming Yuan

A subgradient method is presented for solving general convex optimization problems, the main requirement being that a strictly-feasible point is known. A feasible sequence of iterates is generated, which converges to within user-specified…

Optimization and Control · Mathematics 2016-05-30 James Renegar

This paper proposes a novel approach to solving nonlinear programming problems using a sharp augmented Lagrangian method with a smoothing technique. Traditional sharp augmented Lagrangian methods are known for their effectiveness but are…

Optimization and Control · Mathematics 2024-10-07 José Luis Romero , Damián Fernandez , Germán Ariel Torres

This paper shows that error bounds can be used as effective tools for deriving complexity results for first-order descent methods in convex minimization. In a first stage, this objective led us to revisit the interplay between error bounds…

Optimization and Control · Mathematics 2016-07-21 Jérôme Bolte , Trong Phong Nguyen , Juan Peypouquet , Bruce Suter

The simplex algorithm is one of the most popular algorithms to solve linear programs (LPs). Starting at an extreme point solution of an LP, it performs a sequence of basis exchanges (called pivots) that allows one to move to a better…

Optimization and Control · Mathematics 2026-03-26 Kirill Kukharenko , Laura Sanità

We contribute improvements to a Lagrangian dual solution approach applied to large-scale optimization problems whose objective functions are convex, continuously differentiable and possibly nonlinear, while the non-relaxed constraint set is…

Optimization and Control · Mathematics 2019-08-09 Brian Dandurand , Natashia Boland , Jeffrey Christiansen , Andrew Eberhard , Fabricio Oliveira

Pivoting methods are of vital importance for linear programming, the simplex method being the by far most well-known. In this paper, a primal-dual pair of linear programs in canonical form is considered. We show that there exists a sequence…

Optimization and Control · Mathematics 2019-08-29 Anders Forsgren , Fei Wang

We consider structured optimisation problems defined in terms of the sum of a smooth and convex function, and a proper, l.s.c., convex (typically non-smooth) one in reflexive variable exponent Lebesgue spaces $L_{p(\cdot)}(\Omega)$. Due to…

Optimization and Control · Mathematics 2022-11-10 Marta Lazzaretti , Luca Calatroni , Claudio Estatico

We propose the novel p-branch-and-bound method for solving two-stage stochastic programming problems whose deterministic equivalents are represented by non-convex mixed-integer quadratically constrained quadratic programming (MIQCQP)…

Optimization and Control · Mathematics 2025-02-20 Nikita Belyak , Fabricio Oliveira

A sparse linear programming (SLP) problem is a linear programming problem equipped with a sparsity (or cardinality) constraint, which is nonconvex and discontinuous theoretically and generally NP-hard computationally due to the…

Optimization and Control · Mathematics 2018-06-05 Chen Zhao , Ziyan Luo , Weiyue Li , Houduo Qi , Naihua Xiu

We present a Julia package, DisjunctiveProgramming.jl, that extends the functionality in JuMP.jl to allow modeling problems via logical propositions and disjunctive constraints. Such models can then be reformulated into Mixed-Integer…

Logic in Computer Science · Computer Science 2023-04-21 Hector D. Perez , Shivank Joshi , Ignacio E. Grossmann