English
Related papers

Related papers: Conditional Infimum and Hidden Convexity in Optimi…

200 papers

The aim of this paper is to present an original approach that takes advantage from the geometric features of strictly convex functions to tackle the problem of finding the minimum from another perspective. The general idea is that near the…

Optimization and Control · Mathematics 2023-07-21 E. Conti

We develop a rigorous framework for global non-convex optimization by reformulating the minimization problem as a discounted infinite-horizon optimal control problem. For non-convex, continuous, and possibly non-smooth objective functions…

Optimization and Control · Mathematics 2026-03-31 Yuyang Huang , Dante Kalise , Hicham Kouhkouh

Submodular function minimization is well studied, and existing algorithms solve it exactly or up to arbitrary accuracy. However, in many applications, such as structured sparse learning or batch Bayesian optimization, the objective function…

Machine Learning · Computer Science 2022-03-10 Marwa El Halabi , Stefanie Jegelka

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

In information theory, some optimization problems result in convex optimization problems on strictly convex functionals of probability densities. In this note, we study these problems and show conditions of minimizers and the uniqueness of…

Information Theory · Computer Science 2020-03-17 Tomohiro Nishiyama

In this paper, an inexact proximal-point penalty method is studied for constrained optimization problems, where the objective function is non-convex, and the constraint functions can also be non-convex. The proposed method approximately…

Optimization and Control · Mathematics 2020-12-02 Qihang Lin , Runchao Ma , Yangyang Xu

Min-max problems have broad applications in machine learning, including learning with non-decomposable loss and learning with robustness to data distribution. Convex-concave min-max problem is an active topic of research with efficient…

Optimization and Control · Mathematics 2021-05-12 Hassan Rafique , Mingrui Liu , Qihang Lin , Tianbao Yang

We consider joint optimization and learning problems arising in real-time decision systems. While most existing work focuses primarily on convex, revenue-based objectives, we extend this line of research to multi-objective formulations. In…

Optimization and Control · Mathematics 2026-04-14 Zijun Li , Aswin Kannan

We study compressible and incompressible nonlinear elasticity variational problems in a general context. Our main result gives a sufficient condition for an equilibrium to be a global energy minimizer, in terms of convexity properties of…

Analysis of PDEs · Mathematics 2020-11-04 Nassif Ghoussoub , Young-Heon Kim , Hugo Lavenant , Aaron Zeff Palmer

Non-convex optimization problems often arise from probabilistic modeling, such as estimation of posterior distributions. Non-convexity makes the problems intractable, and poses various obstacles for us to design efficient algorithms. In…

Machine Learning · Computer Science 2013-12-18 Khoat Than , Tu Bao Ho

The study of convex functions - in particular, of their optimization (really minimization) is one of the most important fields of applied mathematics. Convexity seems to be one of those incredibly well-chosen hypotheses which is just…

Optimization and Control · Mathematics 2026-03-11 Eigil Fjeldgren Rischel

A multi-convex optimization problem is one in which the variables can be partitioned into sets over which the problem is convex when the other variables are fixed. Multi-convex problems are generally solved approximately using variations on…

Optimization and Control · Mathematics 2016-10-11 Xinyue Shen , Steven Diamond , Madeleine Udell , Yuantao Gu , Stephen Boyd

This paper presents a Successive Convexification ($ \texttt{SCvx} $) algorithm to solve a class of non-convex optimal control problems with certain types of state constraints. Sources of non-convexity may include nonlinear dynamics and…

Optimization and Control · Mathematics 2017-10-23 Yuanqi Mao , Daniel Dueri , Michael Szmuk , Behçet Açıkmeşe

The problem of finding the sparsest vector (direction) in a low dimensional subspace can be considered as a homogeneous variant of the sparse recovery problem, which finds applications in robust subspace recovery, dictionary learning,…

Machine Learning · Computer Science 2020-01-22 Qing Qu , Zhihui Zhu , Xiao Li , Manolis C. Tsakiris , John Wright , René Vidal

Quadratic systems with lossless quadratic terms arise in many applications, including models of atmosphere and incompressible fluid flows. Such systems have a trapping region if all trajectories eventually converge to and stay within a…

Optimization and Control · Mathematics 2024-01-11 Shih-Chi Liao , A. Leonid Heide , Maziar S. Hemati , Peter J. Seiler

Efficient methods to provide sub-optimal solutions to non-convex optimization problems with knowledge of the solution's sub-optimality would facilitate the widespread application of nonlinear optimal control algorithms. To that end,…

Optimization and Control · Mathematics 2023-04-10 Prithvi Akella , Aaron D. Ames

Submodularity is one of the most well-studied properties of problem classes in combinatorial optimization and many applications of machine learning and data mining, with strong implications for guaranteed optimization. In this thesis, we…

Machine Learning · Computer Science 2019-12-19 Yatao An Bian

Purpose: This is an attempt to better bridge the gap between the mathematical and the engineering/physical aspects of the topic. We trace the different sources of non-convexification in the context of topology optimization problems starting…

Optimization and Control · Mathematics 2022-06-08 Mohamed Abdelhamid , Aleksander Czekanski

Many scientific and engineering applications feature nonsmooth convex minimization problems over convex sets. In this paper, we address an important instance of this broad class where we assume that the nonsmooth objective is equipped with…

Optimization and Control · Mathematics 2014-06-23 Quoc Tran Dinh , Anastasios Kyrillidis , Volkan Cevher

The divergence minimization problem plays an important role in various fields. In this note, we focus on differentiable and strictly convex divergences. For some minimization problems, we show the minimizer conditions and the uniqueness of…

Information Theory · Computer Science 2020-01-30 Tomohiro Nishiyama