English
Related papers

Related papers: A Relaxation Method for Nonsmooth Nonlinear Optimi…

200 papers

We propose a solution approach for the problem (P) of minimizing an unconstrained binary polynomial optimization problem. We call this method PQCR (Polynomial Quadratic Convex Reformulation). The resolution is based on a 3-phase method. The…

Data Structures and Algorithms · Computer Science 2019-01-24 Sourour Elloumi , Amélie Lambert , Arnaud Lazare

We consider the problem of minimization of a convex function on a simple set with convex non-smooth inequality constraint and describe first-order methods to solve such problems in different situations: smooth or non-smooth objective…

Optimization and Control · Mathematics 2018-01-30 Anastasia Bayandina , Pavel Dvurechensky , Alexander Gasnikov , Fedor Stonyakin , Alexander Titov

This article presents a new method for computing guaranteed convex and concave relaxations of nonlinear stochastic optimal control problems with final-time expected-value cost functions. This method is motivated by similar methods for…

Optimization and Control · Mathematics 2017-11-27 Yuanxun Shao , Dillard Robertson , Joseph Kirk Scott

Low-rank matrix completion consists of computing a matrix of minimal complexity that recovers a given set of observations as accurately as possible. Unfortunately, existing methods for matrix completion are heuristics that, while highly…

Machine Learning · Computer Science 2026-03-12 Dimitris Bertsimas , Ryan Cory-Wright , Sean Lo , Jean Pauphilet

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

We investigate the continuous non-monotone DR-submodular maximization problem subject to a down-closed convex solvable constraint. Our first contribution is to construct an example to demonstrate that (first-order) stationary points can…

Data Structures and Algorithms · Computer Science 2024-03-27 Shengminjie Chen , Donglei Du , Wenguo Yang , Dachuan Xu , Suixiang Gao

This work focuses on addressing two major challenges in the context of large-scale nonconvex Bi-Level Optimization (BLO) problems, which are increasingly applied in machine learning due to their ability to model nested structures. These…

Optimization and Control · Mathematics 2024-05-17 Risheng Liu , Zhu Liu , Wei Yao , Shangzhi Zeng , Jin Zhang

In this paper, we concentrate on a particular category of quadratically constrained quadratic programming (QCQP): nonconvex QCQP with one equality constraint. This type of QCQP problem optimizes a quadratic objective under a fixed…

Optimization and Control · Mathematics 2025-06-05 Licheng Zhao , Rui Zhou , Wenqiang Pu

We study unconstrained optimization problems with nonsmooth and convex objective function in the form of a mathematical expectation. The proposed method approximates the expected objective function with a sample average function using…

Optimization and Control · Mathematics 2022-11-03 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

Nonconvexities in markets with discrete decisions and nonlinear constraints make efficient pricing challenging, often necessitating subsidies. A prime example is the unit commitment (UC) problem in electricity markets, where costly…

Optimization and Control · Mathematics 2026-02-18 Cheng Guo , Lauren Henderson , Ryan Cory-Wright , Boshi Yang

The problem of constrained Markov decision process (CMDP) is investigated, where an agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its utilities/costs. A new primal-dual approach is…

Optimization and Control · Mathematics 2021-10-22 Tianjiao Li , Ziwei Guan , Shaofeng Zou , Tengyu Xu , Yingbin Liang , Guanghui Lan

This paper proposes a multiblock alternating direction method of multipliers for solving a class of multiblock nonsmooth nonconvex optimization problem with nonlinear coupling constraints. We employ a majorization minimization procedure in…

Optimization and Control · Mathematics 2023-12-05 Le Thi Khanh Hien , Dimitri Papadimitriou

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function. These upper bounds are tight at the current estimate, and each iteration monotonically drives the objective…

Optimization and Control · Mathematics 2015-02-03 Julien Mairal

This paper presents a convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems that are non-convex in the input norm, which is a…

Optimization and Control · Mathematics 2019-11-20 Danylo Malyuta , Michael Szmuk , Behcet Acikmese

We study the problem of differentially-private (DP) stochastic (convex-concave) saddle-points in the $\ell_1$ setting. We propose $(\varepsilon, \delta)$-DP algorithms based on stochastic mirror descent that attain nearly…

Optimization and Control · Mathematics 2025-11-17 Tomás González , Cristóbal Guzmán , Courtney Paquette

We study the minimax problem $\min_{x\in M} \max_y f_r(x,y):=f(x,y)-h(y)$, where $M$ is a compact submanifold, $f$ is continuously differentiable in $(x, y)$, $h$ is a closed, weakly-convex (possibly non-smooth) function and we assume that…

Optimization and Control · Mathematics 2025-12-09 Necdet Serhat Aybat , Jiang Hu , Zhanwang Deng

This two-part paper is concerned with the problem of minimizing a linear objective function subject to a bilinear matrix inequality (BMI) constraint. In this part, we first consider a family of convex relaxations which transform BMI…

Optimization and Control · Mathematics 2018-09-27 Mohsen Kheirandishfard , Fariba Zohrizadeh , Ramtin Madani

We study graph clustering in the Stochastic Block Model (SBM) in the presence of both large clusters and small, unrecoverable clusters. Previous convex relaxation approaches achieving exact recovery do not allow any small clusters of size…

Machine Learning · Computer Science 2025-02-25 Matthew Zurek , Yudong Chen

We develop two penalty based difference of convex (DC) algorithms for solving chance constrained programs. First, leveraging a rank-based DC decomposition of the chance constraint, we propose a proximal penalty based DC algorithm in the…

Optimization and Control · Mathematics 2026-03-16 Zhiping Li , Nan Jiang , Rujun Jiang

In Part I of this paper, we proposed and analyzed a novel algorithmic framework for the minimization of a nonconvex (smooth) objective function, subject to nonconvex constraints, based on inner convex approximations. This Part II is devoted…

Information Theory · Computer Science 2017-04-05 Gesualdo Scutari , Francisco Facchinei , Lorenzo Lampariello , Peiran Song , Stefania Sardellitti