English
Related papers

Related papers: A Continuation Method for Discrete Optimization an…

200 papers

We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates…

Optimization and Control · Mathematics 2024-04-18 Yunier Bello-Cruz , J. G. Melo , L. F. Prudente , R. V. G. Serra

In this paper, we propose new accelerated methods for smooth convex optimization, called contracting proximal methods. At every step of these methods, we need to minimize a contracted version of the objective function augmented by a…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov

Bilevel optimization is an important class of optimization problems where one optimization problem is nested within another. While various methods have emerged to address unconstrained general bilevel optimization problems, there has been a…

Optimization and Control · Mathematics 2024-03-15 Nazanin Abolfazli , Ruichen Jiang , Aryan Mokhtari , Erfan Yazdandoost Hamedani

In regularized risk minimization, the associated optimization problem becomes particularly difficult when both the loss and regularizer are nonsmooth. Existing approaches either have slow or unclear convergence properties, are restricted to…

Machine Learning · Computer Science 2016-10-14 Shuai Zheng , Ruiliang Zhang , James T. Kwok

The recently developed Distributed Block Proximal Method, for solving stochastic big-data convex optimization problems, is studied in this paper under the assumption of constant stepsizes and strongly convex (possibly non-smooth) local…

Optimization and Control · Mathematics 2020-03-06 Francesco Farina , Giuseppe Notarstefano

The breakthrough ideas in the modern proximal splitting methodologies allow us to express the set of all minimizers of a superposition of multiple nonsmooth convex functions as the fixed point set of computable nonexpansive operators. In…

Optimization and Control · Mathematics 2022-07-01 Isao Yamada , Masao Yamagishi

This work proposes an implementable proximal-type method for a broad class of optimization problems involving nonsmooth and nonconvex objective and constraint functions. In contrast to existing methods that rely on an ad hoc model…

Optimization and Control · Mathematics 2024-09-26 Gregorio M. Sempere , Welington de Oliveira , Johannes O. Royset

We propose, analyze, and test a proximal-gradient method for solving regularized optimization problems with general constraints. The method employs a decomposition strategy to compute trial steps and uses a merit function to determine step…

Optimization and Control · Mathematics 2026-01-16 Frank E. Curtis , Xiaoyi Qu , Daniel P. Robinson

The global minimum point of an optimization problem is of interest in engineering fields and it is difficult to be found, especially for a nonconvex large-scale optimization problem. In this article, we consider a new memetic algorithm for…

Neural and Evolutionary Computing · Computer Science 2023-12-14 Xin-long Luo , Hang Xiao , Sen Zhang

The problem of minimizing the sum of nonsmooth, convex objective functions defined on a real Hilbert space over the intersection of fixed point sets of nonexpansive mappings, onto which the projections cannot be efficiently computed, is…

Optimization and Control · Mathematics 2016-02-08 Hideaki Iiduka

Non-convex optimization is ubiquitous in modern machine learning. Researchers devise non-convex objective functions and optimize them using off-the-shelf optimizers such as stochastic gradient descent and its variants, which leverage the…

Machine Learning · Computer Science 2021-03-26 Tengyu Ma

In this paper we consider large-scale composite optimization problems having the objective function formed as a sum of two terms (possibly nonconvex), one has (block) coordinate-wise Lipschitz continuous gradient and the other is…

Optimization and Control · Mathematics 2024-01-10 Flavia Chorobura , Ion Necoara

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

We consider solving nonconvex composite optimization problems in which the sum of a smooth function and a nonsmooth function is minimized. Many of convergence analyses of proximal gradient-type methods rely on global descent property…

Optimization and Control · Mathematics 2026-04-09 Shotaro Yagishita , Masaru Ito

Many applications using large datasets require efficient methods for minimizing a proximable convex function subject to satisfying a set of linear constraints within a specified tolerance. For this task, we present a proximal projection…

Optimization and Control · Mathematics 2024-12-10 Howard Heaton

In this paper, an inexact proximal-point penalty method is studied for constrained optimization problems, where the objective function is non-convex, and the constraint functions can also be non-convex. The proposed method approximately…

Optimization and Control · Mathematics 2020-12-02 Qihang Lin , Runchao Ma , Yangyang Xu

In this paper, further extensions of the result of the paper "A successive approximation method in functional spaces for hierarchical optimal control problems and its application to learning, arXiv:2410.20617 [math.OC], 2024" concerning a…

Optimization and Control · Mathematics 2024-11-26 Getachew K. Befekadu

The distributed optimization problem is set up in a collection of nodes interconnected via a communication network. The goal is to find the minimizer of a global objective function formed by the addition of partial functions locally known…

Optimization and Control · Mathematics 2022-06-07 Damián Marelli , Yong Xu , Minyue Fu , Zenghong Huang

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

Machine Learning · Computer Science 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

Composite minimization involves a collection of smooth functions which are aggregated in a nonsmooth manner. In the convex setting, we design an algorithm by linearizing each smooth component in accordance with its main curvature. The…

Optimization and Control · Mathematics 2019-03-26 Jérôme Bolte , Zheng Chen , Edouard Pauwels