English
Related papers

Related papers: Duality and optimality conditions in stochastic op…

200 papers

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

Second-order dynamical systems are important tools for solving optimization problems, and most of existing works in this field have focused on unconstrained optimization problems. In this paper, we propose an inertial primal-dual dynamical…

Optimization and Control · Mathematics 2022-05-23 Xin He , Rong Hu , Ya-Ping Fang

We study a class of two-stage stochastic programs, namely, those with fixed recourse matrix and fixed costs, and linear second stage. We show that, under mild assumptions, the problem can be solved with just one scenario, which we call an…

Optimization and Control · Mathematics 2025-10-29 Tito Homem-de-Mello , Juan Valencia , Felipe Lagos , Guido Lagos

Relative to the large literature on upper bounds on complexity of convex optimization, lesser attention has been paid to the fundamental hardness of these problems. Given the extensive use of convex optimization in machine learning and…

Machine Learning · Statistics 2011-11-22 Alekh Agarwal , Peter L. Bartlett , Pradeep Ravikumar , Martin J. Wainwright

Deploying mathematical optimization in autonomous production systems requires precise contracts for objects returned by an optimization solver. Unfortunately, conventions on dual solution and infeasibility certificates (rays) vary widely…

Optimization and Control · Mathematics 2026-02-05 Juan Pablo Vielma , Ross Anderson , Joey Huchette

We present a general technique for the analysis of first-order methods. The technique relies on the construction of a duality gap for an appropriate approximation of the objective function, where the function approximation improves as the…

Optimization and Control · Mathematics 2019-12-12 Jelena Diakonikolas , Lorenzo Orecchia

Necessary conditions for high-order optimality in smooth nonlinear constrained optimization are explored and their inherent intricacy discussed. A two-phase minimization algorithm is proposed which can achieve approximate first-, second-…

Optimization and Control · Mathematics 2021-05-31 C. Cartis , N. I. M. Gould , Ph. L. Toint

In this paper, we study the conditional stochastic optimization (CSO) problem which covers a variety of applications including portfolio selection, reinforcement learning, robust learning, causal inference, etc. The sample-averaged gradient…

Machine Learning · Computer Science 2023-12-05 Lie He , Shiva Prasad Kasiviswanathan

This work studies nonconvex distributed constrained optimization over stochastic communication networks. We revisit the distributed dual averaging algorithm, which is known to converge for convex problems. We start from the centralized…

Optimization and Control · Mathematics 2022-11-15 Changxin Liu , Xuyang Wu , Xinlei Yi , Yang Shi , Karl H. Johansson

We study martingale inequalities from an analytic point of view and show that a general martingale inequality can be reduced to a pair of deterministic inequalities in a small number of variables. More precisely, the optimal bound in the…

Probability · Mathematics 2014-10-21 Mathias Beiglböck , Marcel Nutz

(Renegar, 2016) introduced a novel approach to transforming generic conic optimization problems into unconstrained, uniformly Lipschitz continuous minimization. We introduce {\it radial transformations} generalizing these ideas, equipped…

Optimization and Control · Mathematics 2023-07-11 Benjamin Grimmer

We study a class of infinite-dimensional singular stochastic control problems with applications in economic theory and finance. The control process linearly affects an abstract evolution equation on a suitable partially-ordered…

Optimization and Control · Mathematics 2019-04-26 Salvatore Federico , Giorgio Ferrari , Frank Riedel , Michael Röckner

In this paper, we study expected utility maximization under ratchet and drawdown constraints on consumption in a general incomplete semimartingale market using duality methods. The optimization is considered with respect to two parameters:…

Optimization and Control · Mathematics 2022-07-19 Anastasiya Tanana

In this paper, we study two kinds of singular optimal controls (SOCs for short) problems where the systems governed by forward-backward stochastic differential equations (FBSDEs for short), in which the control has two components: the…

Optimization and Control · Mathematics 2020-12-22 Liangquan Zhang

The canonical duality theory has provided with a unified analytic solution to a range of discrete and continuous problems in global optimization, which can transform a nonconvex primal problem to a concave maximization dual problem over a…

Optimization and Control · Mathematics 2012-10-04 Xiaojun Zhou

We investigate Lagrangian duality for nonconvex optimization problems. To this aim we use the $\Phi$-convexity theory and minimax theorem for $\Phi$-convex functions. We provide conditions for zero duality gap and strong duality. Among the…

Optimization and Control · Mathematics 2020-11-19 Ewa M. Bednarczuk , Monika Syga

Variational analysis provides the theoretical foundations and practical tools for constructing optimization algorithms without being restricted to smooth or convex problems. We survey the central concepts in the context of a concrete but…

Optimization and Control · Mathematics 2025-04-08 Johannes O. Royset

We study convex-concave saddle point problems with bilinear coupling, covering linearly constrained convex optimization and more general nonsmooth or constrained models via a proximable term in the dual objective. In linearly convergent…

Optimization and Control · Mathematics 2026-03-02 Meng Li , Paul Grigas

The aim of this manuscript is to approach by means of first order differential equations/inclusions convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the…

Optimization and Control · Mathematics 2020-05-21 Sandy Bitterlich , Ernö Robert Csetnek , Gert Wanka

We develop stochastic first-order primal-dual algorithms to solve a class of convex-concave saddle-point problems. When the saddle function is strongly convex in the primal variable, we develop the first stochastic restart scheme for this…

Optimization and Control · Mathematics 2021-04-13 Renbo Zhao