English
Related papers

Related papers: Scaling, Proximity, and Optimization of Integrally…

200 papers

We survey incremental methods for minimizing a sum $\sum_{i=1}^mf_i(x)$ consisting of a large number of convex component functions $f_i$. Our methods consist of iterations applied to single components, and have proved very effective in…

Systems and Control · Computer Science 2017-12-21 Dimitri P. Bertsekas

The best techniques for the constrained maximum-entropy sampling problem, a discrete-optimization problem arising in the design of experiments, are via a variety of concave continuous relaxations of the objective function. A standard…

Optimization and Control · Mathematics 2023-02-13 Zhongzhu Chen , Marcia Fampa , Jon Lee

Detecting hidden convexity is one of the tools to address nonconvex minimization problems. After giving a formal definition of hidden convexity, we introduce the notion of conditional infimum, as it will prove instrumental in detecting…

Optimization and Control · Mathematics 2021-04-13 Jean-Philippe Chancelier , Michel de Lara

Locating proximal points is a component of numerous minimization algorithms. This work focuses on developing a method to find the proximal point of a convex function at a point, given an inexact oracle. Our method assumes that exact…

Optimization and Control · Mathematics 2016-11-03 Warren Hare , Chayne Planiden

In this paper, we study the problem of maximizing continuous submodular functions that naturally arise in many learning applications such as those involving utility functions in active learning and sensing, matrix approximations and network…

Machine Learning · Computer Science 2017-08-16 Hamed Hassani , Mahdi Soltanolkotabi , Amin Karbasi

This paper presents an algorithm for approximately minimizing a convex function in simple, not necessarily bounded convex domains, assuming only that function values and subgradients are available. No global information about the objective…

Optimization and Control · Mathematics 2014-02-06 Arnold Neumaier

We investigate the convergence properties of exact and inexact forward-backward algorithms to minimise the sum of two weakly convex functions defined on a Hilbert space, where one has a Lipschitz-continuous gradient. We show that the exact…

Optimization and Control · Mathematics 2024-06-24 Ewa Bednarczuk , Giovanni Bruccola , Gabriele Scrivanti , The Hung Tran

A parametrized convex function depends on a variable and a parameter, and is convex in the variable for any valid value of the parameter. Such functions can be used to specify parametrized convex optimization problems, i.e., a convex…

Optimization and Control · Mathematics 2025-06-05 Maximilian Schaller , Alberto Bemporad , Stephen Boyd

In monotone submodular function maximization, approximation guarantees based on the curvature of the objective function have been extensively studied in the literature. However, the notion of curvature is often pessimistic, and we rarely…

Data Structures and Algorithms · Computer Science 2017-09-12 Tasuku Soma , Yuichi Yoshida

In this paper we introduce two conceptual algorithms for minimising abstract convex functions. Both algorithms rely on solving a proximal-type subproblem with an abstract Bregman distance based proximal term. We prove their convergence when…

Optimization and Control · Mathematics 2026-01-09 Reinier Díaz Millán , Julien Ugon

The continuation method is a popular approach in non-convex optimization and computer vision. The main idea is to start from a simple function that can be minimized efficiently, and gradually transform it to the more complicated original…

Machine Learning · Computer Science 2018-02-13 Ali Shameli , Yasin Abbasi-Yadkori

We calculate universal finite-size scaling functions for systems with an n-component order parameter and algebraically decaying interactions. Just as previously has been found for short-range interactions, this leads to a singular…

Statistical Mechanics · Physics 2009-10-31 Erik Luijten

This article addresses structure-preserving smooth approximation of semiconcave functions. semiconcave functions are of particular interest because they naturally arise in a variety of variational problems, including {optimal feedback…

Optimization and Control · Mathematics 2026-02-10 Karl Kunisch , Donato Vásquez-Varas

The usual approach to developing and analyzing first-order methods for smooth convex optimization assumes that the gradient of the objective function is uniformly smooth with some Lipschitz constant $L$. However, in many settings the…

Optimization and Control · Mathematics 2017-10-11 Haihao Lu , Robert M. Freund , Yurii Nesterov

We consider scalar equilibrium problems governed by a bifunction in a finite-dimensional framework. By using classical arguments in Convex Analysis, we show that under suitable generalized convexity assumptions imposed on the bifunction,…

Optimization and Control · Mathematics 2024-01-02 Valerian-Alin Fodor , Nicolae Popovici

Many classical geometric inequalities on functionals of convex bodies depend on the dimension of the ambient space. We show that this dimension dependence may often be replaced (totally or partially) by different symmetry measures of the…

Metric Geometry · Mathematics 2014-12-11 René Brandenberg , Stefan König

Convex regression is a method for estimating the convex function from a data set. This method has played an important role in operations research, economics, machine learning, and many other areas. However, it has been empirically observed…

Methodology · Statistics 2024-10-17 Zhiqiang Liao , Sheng Dai , Eunji Lim , Timo Kuosmanen

The use of separable approximations is proposed to mitigate the curse of dimensionality related to the approximation of high-dimensional value functions in optimal control. The separable approximation exploits intrinsic decaying sensitivity…

Optimization and Control · Mathematics 2025-08-26 Mario Sperl , Luca Saluzzi , Dante Kalise , Lars Grüne

The convex hull property is the natural generalization of maximum principles from scalar to vector valued functions. Maximum principles for finite element approximations are often crucial for the preservation of qualitative properties of…

Numerical Analysis · Mathematics 2019-05-22 Lars Diening , Christian Kreuzer , Sebastian Schwarzacher

We consider structured optimisation problems defined in terms of the sum of a smooth and convex function, and a proper, l.s.c., convex (typically non-smooth) one in reflexive variable exponent Lebesgue spaces $L_{p(\cdot)}(\Omega)$. Due to…

Optimization and Control · Mathematics 2022-11-10 Marta Lazzaretti , Luca Calatroni , Claudio Estatico