English
Related papers

Related papers: Convex Optimization on Functionals of Probability …

200 papers

Submodular set-functions have many applications in combinatorial optimization, as they can be minimized and approximately maximized in polynomial time. A key element in many of the algorithms and analyses is the possibility of extending the…

Machine Learning · Computer Science 2016-02-24 Francis Bach

A convex envelope for the problem of finding the best approximation to a given matrix with a prescribed rank is constructed. This convex envelope allows the usage of traditional optimization techniques when additional constraints are added…

Functional Analysis · Mathematics 2016-08-30 Fredrik Andersson , Marcus Carlsson , Carl Olsson

In this paper we consider resource allocation problem stated as a convex minimization problem with linear constraints. To solve this problem, we use gradient and accelerated gradient descent applied to the dual problem and prove the…

Optimization and Control · Mathematics 2019-10-01 Anastasiya Ivanova , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kamzolov

The majorization-minimization (MM) principle is an extremely general framework for deriving optimization algorithms. It includes the expectation-maximization (EM) algorithm, proximal gradient algorithm, concave-convex procedure, quadratic…

Optimization and Control · Mathematics 2021-06-08 Kenneth Lange , Joong-Ho Won , Alfonso Landeros , Hua Zhou

In this paper, a new optimization framework is defined that includes the optimization framework recently proposed in [1]-[2] as a special case. The convex optimization in [1]-[2] includes centralized optimization and distributed…

Systems and Control · Electrical Eng. & Systems 2019-11-26 S. Sh. Alaviani

We show that minimizing a convex function over the integer points of a bounded convex set is polynomial in fixed dimension.

Optimization and Control · Mathematics 2012-03-20 Timm Oertel , Christian Wagner , Robert Weismantel

Potential functionals have been introduced recently as an important tool for the analysis of coupled scalar systems (e.g. density evolution equations). In this contribution, we investigate interesting properties of this potential. Using the…

Information Theory · Computer Science 2017-01-16 Rafah El-Khatib , Nicolas Macris , Tom Richardson , Rüdiger Urbanke

We study a general class of convex submodular optimization problems with indicator variables. Many applications such as the problem of inferring Markov random fields (MRFs) with a sparsity or robustness prior can be naturally modeled in…

Optimization and Control · Mathematics 2025-07-09 Shaoning Han , Andrés Gómez

The push-forward operation enables one to redistribute a probability measure through a deterministic map. It plays a key role in statistics and optimization: many learning problems (notably from optimal transport, generative modeling, and…

Machine Learning · Statistics 2025-05-19 Lucas de Lara , Mathis Deronzier , Alberto González-Sanz , Virgile Foy

This paper is devoted to a new modification of a recently proposed adaptive stochastic mirror descent algorithm for constrained convex optimization problems in the case of several convex functional constraints. Algorithms, standard and its…

Optimization and Control · Mathematics 2020-01-22 Mohammad S. Alkousa

Many imaging problems can be formulated as inverse problems expressed as finite-dimensional optimization problems. These optimization problems generally consist of minimizing the sum of a data fidelity and regularization terms. In [23,26],…

Optimization and Control · Mathematics 2021-04-26 Jérôme Darbon , Gabriel P. Langlois , Tingwei Meng

In this paper, we study the optimal convergence rate for distributed convex optimization problems in networks. We model the communication restrictions imposed by the network as a set of affine constraints and provide optimal complexity…

Optimization and Control · Mathematics 2018-11-16 César A. Uribe , Soomin Lee , Alexander Gasnikov , Angelia Nedić

We study a specific convex maximization problem in n-dimensional space. The conjectured solution is proved to be a vertex of the polyhedral feasible region, but only a partial proof of local maximality is known. Integer sequences with…

Optimization and Control · Mathematics 2007-05-23 Steven Finch

This thesis focuses on the intersection of mathematical and computational optimization and quantum information. Main contributions are open-source software code: A hybrid approach mixing "traditional" nonconvex and convex methods can make…

Quantum Physics · Physics 2025-12-19 Benjamin Desef

We note that known methods achieving the optimal oracle complexity for first order convex optimization require quadratic memory, and ask whether this is necessary, and more broadly seek to characterize the minimax number of first order…

Machine Learning · Computer Science 2019-07-02 Blake Woodworth , Nathan Srebro

We consider the Chance Constrained Model Predictive Control problem for polynomial systems subject to disturbances. In this problem, we aim at finding optimal control input for given disturbed dynamical system to minimize a given cost…

Optimization and Control · Mathematics 2016-05-04 Ashkan Jasour , Constantino Lagoa

In this paper, we investigate the concept of p-convexity for sets and functions in n-dimensional Euclidean space. We establish novel algebraic and topological results within this generalized convexity framework. Furthermore, we analyze…

Optimization and Control · Mathematics 2026-04-14 Cristian Vera

In this paper some adaptive mirror descent algorithms for problems of minimization convex objective functional with several convex Lipschitz (generally, non-smooth) functional constraints are considered. It is shown that the methods are…

Optimization and Control · Mathematics 2018-12-20 F. S. Stonyakin , M . S. Alkousa , A. A. Titov

Model instability and poor prediction of long-term behavior are common problems when modeling dynamical systems using nonlinear "black-box" techniques. Direct optimization of the long-term predictions, often called simulation error…

Systems and Control · Computer Science 2017-01-25 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

Using an optimization algorithm to solve a machine learning problem is one of mainstreams in the field of science. In this work, we demonstrate a comprehensive comparison of some state-of-the-art first-order optimization algorithms for…

Machine Learning · Computer Science 2014-04-29 Yu Wei , Pock Thomas