English
Related papers

Related papers: Projections Onto Convex Sets (POCS) Based Optimiza…

200 papers

This paper presents a convex approach to the optimization of a cooperative rendezvous, that is, the problem of two distant spacecraft that simultaneously operate to get closer. Convex programming guarantees convergence towards the optimal…

Optimization and Control · Mathematics 2020-09-02 Boris Benedikter , Alessandro Zavoli , Guido Colasurdo

Finding efficient and provable methods to solve non-convex optimization problems is an outstanding challenge in machine learning and optimization theory. A popular approach used to tackle non-convex problems is to use convex relaxation…

Machine Learning · Statistics 2016-10-31 Mohammad Gheshlaghi Azar , Eva Dyer , Konrad Kording

Non-convex optimization is a critical tool in advancing machine learning, especially for complex models like deep neural networks and support vector machines. Despite challenges such as multiple local minima and saddle points, non-convex…

Machine Learning · Computer Science 2024-10-04 Greg B Fotopoulos , Paul Popovich , Nicholas Hall Papadopoulos

Many problems of substantial current interest in machine learning, statistics, and data science can be formulated as sparse and low-rank optimization problems. In this paper, we present the nonconvex exterior-point optimization solver NExOS…

Optimization and Control · Mathematics 2024-04-30 Shuvomoy Das Gupta , Bartolomeo Stellato , Bart P. G. Van Parys

This paper studies hidden convexity properties associated with constrained optimization problems over the set of rotation matrices $\text{SO}(n)$. Such problems are nonconvex due to the constraint $X \in \text{SO}(n)$. Nonetheless, we show…

Optimization and Control · Mathematics 2024-05-01 Akshay Ramachandran , Kevin Shu , Alex L. Wang

We consider the framework of convex high dimensional stochastic control problems, in which the controls are aggregated in the cost function. As first contribution, we introduce a modified problem, whose optimal control is under some…

Optimization and Control · Mathematics 2023-04-28 Adrien Séguret , Clémence Alasseur , J. Frédéric Bonnans , Antonio De Paola , Nadia Oudjane , Vincenzo Trovato

Crucial information barely visible to the human eye is often embedded in a series of low-resolution images taken of the same scene. Super-resolution enables the extraction of this information by reconstructing a single image, at a high…

Computer Vision and Pattern Recognition · Computer Science 2011-12-08 S. S. Panda , M. S. R. S Prasad , G. Jena

Stochastic convex optimization problems with expectation constraints (SOECs) are encountered in statistics and machine learning, business, and engineering. In data-rich environments, the SOEC objective and constraints contain expectations…

Optimization and Control · Mathematics 2020-01-03 Qihang Lin , Selvaprabu Nadarajah , Negar Soheili , Tianbao Yang

We study some methods of subgradient projections for solving a convex feasibility problem with general (not necessarily hyperplanes or half-spaces) convex sets in the inconsistent case and propose a strategy that controls the relaxation…

Optimization and Control · Mathematics 2010-09-21 Dan Butnariu , Yair Censor , Pini Gurfil , Ethan Hadar

We develop and analyze a set of new sequential simulation-optimization algorithms for large-scale multi-dimensional discrete optimization via simulation problems with a convexity structure. The "large-scale" notion refers to that the…

Optimization and Control · Mathematics 2022-01-20 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

In this paper, we explore a broad class of constrained saddle point problems with a bilevel structure, wherein the upper-level objective function is nonconvex-concave and smooth over compact and convex constraint sets, subject to a strongly…

Optimization and Control · Mathematics 2025-03-31 Mohammad Mahdi Ahmadi , Erfan Yazdandoost Hamedani

Via a family of monotone scalar functions, a preorder on a set is extended to its power set and then used to construct a hull operator and a corresponing complete lattice of sets. A function mappping into the preordered set is extended to a…

Optimization and Control · Mathematics 2018-12-11 Giovanni Crespi , Andreas H Hamel , Matteo Rocca , Carola Schrage

We propose a new framework for black-box convex optimization which is well-suited for situations where gradient computations are expensive. We derive a new method for this framework which leverages several concepts from convex optimization,…

Optimization and Control · Mathematics 2016-02-17 Sébastien Bubeck , Yin-Tat Lee

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

Optimization problems involving sequential decisions in a stochastic environment were studied in Stochastic Programming (SP), Stochastic Optimal Control (SOC) and Markov Decision Processes (MDP). In this paper we mainly concentrate on SP…

Optimization and Control · Mathematics 2023-03-29 Guanghui Lan , Alexander Shapiro

We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…

Optimization and Control · Mathematics 2011-07-07 Eugenio Cinquemani , Mayank Agarwal , Debasish Chatterjee , John Lygeros

We propose an approach to trajectory optimization for piecewise polynomial systems based on the recently proposed graphs of convex sets framework. We instantiate the framework with a convex relaxation of optimal control based on occupation…

Optimization and Control · Mathematics 2025-07-28 Etienne Buehrle , Ömer Şahin Taş , Christoph Stiller

An optimization algorithm for nonsmooth nonconvex constrained optimization problems with upper-C2 objective functions is proposed and analyzed. Upper-C2 is a weakly concave property that exists in difference of convex (DC) functions and…

Optimization and Control · Mathematics 2022-04-21 Jingyi Wang , Cosmin G. Petra

This work proposes an implementable proximal-type method for a broad class of optimization problems involving nonsmooth and nonconvex objective and constraint functions. In contrast to existing methods that rely on an ad hoc model…

Optimization and Control · Mathematics 2024-09-26 Gregorio M. Sempere , Welington de Oliveira , Johannes O. Royset

We consider solving large scale nonconvex optimisation problems with nonnegativity constraints. Such problems arise frequently in machine learning, such as nonnegative least-squares, nonnegative matrix factorisation, as well as problems…

Optimization and Control · Mathematics 2024-05-22 Oscar Smee , Fred Roosta