English
Related papers

Related papers: A new version of the convexification method for a …

200 papers

We develop a rigorous framework for global non-convex optimization by reformulating the minimization problem as a discounted infinite-horizon optimal control problem. For non-convex, continuous, and possibly non-smooth objective functions…

Optimization and Control · Mathematics 2026-03-31 Yuyang Huang , Dante Kalise , Hicham Kouhkouh

We investigate a class of composite nonconvex functions, where the outer function is the sum of univariate extended-real-valued convex functions and the inner function is the limit of difference-of-convex functions. A notable feature of…

Optimization and Control · Mathematics 2024-11-21 Hanyang Li , Ying Cui

We propose a new, nonparametric method for multivariate regression subject to convexity or concavity constraints on the response function. Convexity constraints are common in economics, statistics, operations research, financial engineering…

Methodology · Statistics 2011-11-15 Lauren A. Hannah , David B. Dunson

Vector optimization problems are a generalization of multiobjective optimization in which the preference order is related to an arbitrary closed and convex cone, rather than the nonnegative octant. Due to its real life applications, it is…

Optimization and Control · Mathematics 2013-12-03 J. Y. Bello Cruz , G. C. Bento , G. Bouza Allende , R. F. B. Costa

We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient…

Optimization and Control · Mathematics 2021-05-26 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

Prediction-correction algorithms are a highly effective class of methods for solving pseudo-convex optimization problems. The descent direction of these algorithms can be viewed as an adjustment to the gradient direction based on the…

Optimization and Control · Mathematics 2025-12-05 Ting Li , Deren Han , Tanxing Wang , Xingju Cai

In this paper, we develop convergence analysis of a modified line search method for objective functions whose value is computed with noise and whose gradient estimates are inexact and possibly random. The noise is assumed to be bounded in…

Optimization and Control · Mathematics 2021-03-05 Albert S. Berahas , Liyuan Cao , Katya Scheinberg

We propose a method for designing policies for convex stochastic control problems characterized by random linear dynamics and convex stage cost. We consider policies that employ quadratic approximate value functions as a substitute for the…

Optimization and Control · Mathematics 2023-11-10 Alan Yang , Stephen Boyd

We study robustness properties of some iterative gradient-based methods for strongly convex functions, as well as for the larger class of functions with sector-bounded gradients, under a relative error model. Proofs of the corresponding…

Optimization and Control · Mathematics 2021-05-11 Oran Gannot

In this paper, we present a dimension reduction method to reduce the dimension of parameter space and state space and efficiently solve inverse problems. To this end, proper orthogonal decomposition (POD) and radial basis function (RBF) are…

Numerical Analysis · Mathematics 2016-10-18 Fuchen Chen , Lijian Jiang , Guanghui Zheng

This paper discusses basic results and recent developments on variational regularization methods, as developed for inverse problems. In a typical setup we review basic properties needed to obtain a convergent regularization scheme and…

Machine Learning · Computer Science 2021-12-10 Martin Burger

This paper presents a piecewise convexification method for solving non-convex multi-objective optimization problems with box constraints. Based on the ideas of the $\alpha$-based Branch and Bound (${\rm \alpha BB}$) method of global…

Optimization and Control · Mathematics 2022-06-28 Q. Zhu , L. P. Tang , X. M. Yang

We focus on nonconvex and nonsmooth minimization problems with a composite objective, where the differentiable part of the objective is freed from the usual and restrictive global Lipschitz gradient continuity assumption. This longstanding…

Optimization and Control · Mathematics 2017-06-21 Jérôme Bolte , Shoham Sabach , Marc Teboulle , Yakov Vaisbourd

This paper studies the application of the blended dynamics approach towards distributed optimization problem where the global cost function is given by a sum of local cost functions. The benefits include (i) individual cost function need…

Optimization and Control · Mathematics 2021-02-26 Seungjoon Lee , Hyungbo Shim

The computational cost of solving an inverse problem governed by PDEs, using multiple experiments, increases linearly with the number of experiments. A recently proposed method to decrease this cost uses only a small number of random linear…

Optimization and Control · Mathematics 2017-08-02 Benjamin Crestel , Alen Alexanderian , Georg Stadler , Omar Ghattas

In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since…

Optimization and Control · Mathematics 2020-07-21 Ilan Adler , Zhiyue Tom Hu , Tianyi Lin

The task of approximating an arbitrary convex function arises in several learning problems such as convex regression, learning with a difference of convex (DC) functions, and learning Bregman or $f$-divergences. In this paper, we develop…

The article is devoted to the development of algorithmic methods ensuring efficient complexity bounds for strongly convex-concave saddle point problems in the case when one of the groups of variables is high-dimensional, and the other is…

Optimization and Control · Mathematics 2022-10-26 Egor Gladin , Ilya Kuruzov , Fedor Stonyakin , Dmitry Pasechnyuk , Mohammad Alkousa , Alexander Gasnikov

The sum of ratios problem has a variety of important applications in economics and management science, but it is difficult to globally solve this problem. In this paper, we consider the minimization problem of a sum of a number of…

Optimization and Control · Mathematics 2019-10-25 Yaohua Hu , Carisa Kwok Wai Yu , Xiaoqi Yang

We consider the problem of approximating the solution of variational problems subject to the constraint that the admissible functions must be convex. This problem is at the interface between convex analysis, convex optimization, variational…

Numerical Analysis · Mathematics 2015-03-19 Adam M. Oberman