English
Related papers

Related papers: Non-Smooth Multi-objective Controller Synthesis fo…

200 papers

An adaptive regularization algorithm using inexact function and derivatives evaluations is proposed for the solution of composite nonsmooth nonconvex optimization. It is shown that this algorithm needs at most…

Optimization and Control · Mathematics 2019-02-28 S. Gratton , E. Simon , Ph. L. Toint

We consider smooth stochastic convex optimization problems in the context of algorithms which are based on directional derivatives of the objective function. This context can be considered as an intermediate one between derivative-free…

Optimization and Control · Mathematics 2020-09-22 Pavel Dvurechensky , Eduard Gorbunov , Alexander Gasnikov

We consider a class of structured, nonconvex, nonsmooth optimization problems under orthogonality constraints, where the objectives combine a smooth function, a nonsmooth concave function, and a nonsmooth weakly convex function. This class…

Optimization and Control · Mathematics 2025-01-14 Ganzhao Yuan

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and…

Optimization and Control · Mathematics 2018-03-12 Andre Milzarek , Xiantao Xiao , Shicong Cen , Zaiwen Wen , Michael Ulbrich

Mixed H2/H-infinity control balances performance and robustness by minimizing an H2 cost bound subject to an H-infinity constraint. However, classical Riccati/LMI solutions offer limited insight into the nonconvex optimization landscape and…

Optimization and Control · Mathematics 2026-03-06 Chih-Fan Pai , Yuto Watanabe , Yujie Tang , Yang Zheng

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…

Optimization and Control · Mathematics 2012-04-10 John C. Duchi , Peter L. Bartlett , Martin J. Wainwright

A fully stochastic second-order adaptive-regularization method for unconstrained nonconvex optimization is presented which never computes the objective-function value, but yet achieves the optimal $\mathcal{O}(\epsilon^{-3/2})$ complexity…

Optimization and Control · Mathematics 2025-01-22 Serge Gratton , Sadok Jerad , Philippe L. Toint

In this paper, we study a family of non-convex and possibly non-smooth inf-projection minimization problems, where the target objective function is equal to minimization of a joint function over another variable. This problem include…

Machine Learning · Computer Science 2020-07-15 Yan Yan , Yi Xu , Lijun Zhang , Xiaoyu Wang , Tianbao Yang

This paper considers constrained stochastic nonsmooth minimax optimization problem of the form…

Optimization and Control · Mathematics 2026-04-24 Jinyang Shi , Luo Luo

We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a $(\delta,\epsilon)$-stationary point from…

Machine Learning · Computer Science 2025-08-08 Ashok Cutkosky , Harsh Mehta , Francesco Orabona

We introduce an efficient first-order primal-dual method for the solution of nonsmooth PDE-constrained optimization problems. We achieve this efficiency through not solving the PDE or its linearisation on each iteration of the optimization…

Optimization and Control · Mathematics 2024-06-11 Bjørn Jensen , Tuomo Valkonen

This paper investigates the distributed optimal output consensus problem of second-order uncertain nonlinear multi-agent systems over weight-unbalanced directed networks. Under the standard assumption that local cost functions are strongly…

Optimization and Control · Mathematics 2022-02-11 Jin Zhang , Lu Liu , Haibo Ji

This work deals with the solution of a non-convex optimization problem to enhance the performance of an energy harvesting device, which involves a nonlinear objective function and a discontinuous constraint. This optimization problem, which…

Computational Engineering, Finance, and Science · Computer Science 2021-05-31 Americo Cunha

Nonsmoothness is often a curse for optimization; but it is sometimes a blessing, in particular for applications in machine learning. In this paper, we present the specific structure of nonsmooth optimization problems appearing in machine…

Optimization and Control · Mathematics 2020-11-11 Franck Iutzeler , Jérôme Malick

This technical note studies the distributed optimization problem of a sum of nonsmooth convex cost functions with local constraints. At first, we propose a novel distributed continuous-time projected algorithm, in which each agent knows its…

Optimization and Control · Mathematics 2016-11-29 Xianlin Zeng , Peng Yi , Yiguang Hong

This paper investigates new families of compositional optimization problems, called $\underline{\bf n}$on-$\underline{\bf s}$mooth $\underline{\bf w}$eakly-$\underline{\bf c}$onvex $\underline{\bf f}$inite-sum $\underline{\bf c}$oupled…

Optimization and Control · Mathematics 2024-09-26 Quanqi Hu , Dixian Zhu , Tianbao Yang

This paper considers a networked system with a finite number of users and supposes that each user tries to minimize its own private objective function over its own private constraint set. It is assumed that each user's constraint set can be…

Optimization and Control · Mathematics 2015-10-22 Hideaki Iiduka

The goal of the paper is development of an optimization method with the superlinear convergence rate for a nonsmooth convex function. For optimization an approximation is used that is similar to the Steklov integral averaging. The…

Optimization and Control · Mathematics 2023-08-03 I. M. Prudnikov

In this paper, we investigate the non-asymptotic stationary convergence behavior of Stochastic Mirror Descent (SMD) for nonconvex optimization. We focus on a general class of nonconvex nonsmooth stochastic optimization problems, in which…

Optimization and Control · Mathematics 2018-06-14 Siqi Zhang , Niao He

This paper focuses on finding approximate solutions to stochastic optimal control problems with control domains being not necessarily convex, where the state trajectory is subject to controlled stochastic differential equations. The…

Optimization and Control · Mathematics 2025-07-15 Shaolin Ji , Rundong Xu