English
Related papers

Related papers: Max-affine estimators for convex stochastic progra…

200 papers

Functional constrained optimization is becoming more and more important in machine learning and operations research. Such problems have potential applications in risk-averse machine learning, semisupervised learning, and robust optimization…

Optimization and Control · Mathematics 2022-01-28 Digvijay Boob , Qi Deng , Guanghui Lan

In this paper, we show the optimality of a certain class of disturbance-affine control policies in the context of one-dimensional, constrained, multi-stage robust optimization. Our results cover the finite horizon case, with minimax…

Optimization and Control · Mathematics 2010-06-14 Dimitris Bertsimas , Dan A. Iancu , Pablo A. Parrilo

In this paper, we study a family of non-convex and possibly non-smooth inf-projection minimization problems, where the target objective function is equal to minimization of a joint function over another variable. This problem include…

Machine Learning · Computer Science 2020-07-15 Yan Yan , Yi Xu , Lijun Zhang , Xiaoyu Wang , Tianbao Yang

Maximum consensus estimation plays a critically important role in robust fitting problems in computer vision. Currently, the most prevalent algorithms for consensus maximization draw from the class of randomized hypothesize-and-verify…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Huu Le , Tat-Jun Chin , Anders Eriksson , Thanh-Toan Do , David Suter

Convex regression is the problem of fitting a convex function to a data set consisting of input-output pairs. We present a new approach to this problem called spectrahedral regression, in which we fit a spectrahedral function to the data,…

Optimization and Control · Mathematics 2021-11-01 Eliza O'Reilly , Venkat Chandrasekaran

Convex approximation sets for multiobjective optimization problems are a well-studied relaxation of the common notion of approximation sets. Instead of approximating each image of a feasible solution by the image of some solution in the…

Optimization and Control · Mathematics 2023-06-13 Stephan Helfrich , Stefan Ruzika , Clemens Thielen

We develop two adaptive discretization algorithms for convex semi-infinite optimization, which terminate after finitely many iterations at approximate solutions of arbitrary precision. In particular, they terminate at a feasible point of…

Optimization and Control · Mathematics 2022-01-14 Jochen Schmid , Miltiadis Poursanidis

This paper proposes a set of novel optimization algorithms for solving a class of convex optimization problems with time-varying streaming cost function. We develop an approach to track the optimal solution with a bounded error. Unlike the…

Optimization and Control · Mathematics 2023-10-13 M. Rostami , H. Moradian , S. S. Kia

Convex-concave min-max problems are ubiquitous in machine learning, and people usually utilize first-order methods (e.g., gradient descent ascent) to find the optimal solution. One feature which separates convex-concave min-max problems…

Optimization and Control · Mathematics 2022-03-09 Mingrui Liu , Francesco Orabona

We consider the problem of maximizing a convex function over a closed convex set in a real Hilbert space. For linear functions, we show that a single orthogonal projection suffices to obtain an approximate solution. For continuous convex…

Optimization and Control · Mathematics 2026-02-23 Pedro Felzenszwalb , Heon Lee

This work introduces a sequential convex programming framework for non-linear, finite-dimensional stochastic optimal control, where uncertainties are modeled by a multidimensional Wiener process. We prove that any accumulation point of the…

Optimization and Control · Mathematics 2022-09-27 Riccardo Bonalli , Thomas Lew , Marco Pavone

Consider the problem of minimizing the expected value of a (possibly nonconvex) cost function parameterized by a random (vector) variable, when the expectation cannot be computed accurately (e.g., because the statistics of the random…

Multiagent Systems · Computer Science 2017-12-12 Yang Yang , Gesualdo Scutari , Daniel P. Palomar , Marius Pesavento

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

We propose new sequential simulation-optimization algorithms for general convex optimization via simulation problems with high-dimensional discrete decision space. The performance of each choice of discrete decision variables is evaluated…

Optimization and Control · Mathematics 2022-02-15 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

Memory is a key computational bottleneck when solving large-scale convex optimization problems such as semidefinite programs (SDPs). In this paper, we focus on the regime in which storing an $n\times n$ matrix decision variable is…

Optimization and Control · Mathematics 2021-08-25 Nimita Shinde , Vishnu Narayanan , James Saunderson

We consider a multi-objective risk-averse two-stage stochastic programming problem with a multivariate convex risk measure. We suggest a convex vector optimization formulation with set-valued constraints and propose an extended version of…

Optimization and Control · Mathematics 2017-11-20 Çağın Ararat , Özlem Çavuş , Ali İrfan Mahmutoğulları

This paper applies computational techniques of convex stochastic optimization to optimal operation and valuation of electricity storages in the face of uncertain electricity prices. Our approach is applicable to various specifications of…

Optimization and Control · Mathematics 2025-04-22 Jean-Philippe Chancelier , Michel De Lara , François Pacaud , Teemu Pennanen , Ari-Pekka Perkkiö

In this paper, we propose a multilevel stochastic framework for the solution of nonconvex unconstrained optimization problems. The proposed approach uses random regularized first-order models that exploit an available hierarchical…

Optimization and Control · Mathematics 2025-11-27 Filippo Marini , Margherita Porcelli , Elisa Riccietti

In this paper, we introduce various mechanisms to obtain accelerated first-order stochastic optimization algorithms when the objective function is convex or strongly convex. Specifically, we extend the Catalyst approach originally designed…

Optimization and Control · Mathematics 2019-10-10 Andrei Kulunchakov , Julien Mairal

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler