English
Related papers

Related papers: Remarks on the $\Gamma $-regularization of Non-con…

200 papers

Optimizing non-convex functions is a fundamental challenge across machine learning and combinatorial optimization. We introduce and study $\gamma$-weakly $\theta$-up-concavity, a novel first-order condition that characterizes a broad class…

Machine Learning · Computer Science 2026-05-11 Mohammad Pedramfar , Vaneet Aggarwal

In this paper, we provide near-optimal accelerated first-order methods for minimizing a broad class of smooth nonconvex functions that are strictly unimodal on all lines through a minimizer. This function class, which we call the class of…

Optimization and Control · Mathematics 2023-02-27 Oliver Hinder , Aaron Sidford , Nimit S. Sohoni

We use the framework of a type of abstract convexity ($\Phi_{lsc}$-convexity) to investigate properties of lower semicontinuous quadratically minorized functions in Hilbert spaces. A new result, which states that, for every local…

Optimization and Control · Mathematics 2020-04-13 Monika Syga

We provide some necessary and sufficient conditions for a proper lower semicontinuous convex function, defined on a real Banach space, to be locally or globally Lipschitz continuous. Our criteria rely on the existence of a bounded selection…

Functional Analysis · Mathematics 2019-11-13 Bao Tran Nguyen , Pham Duy Khanh

Regularisation theory in Banach spaces, and non--norm-squared regularisation even in finite dimensions, generally relies upon Bregman divergences to replace norm convergence. This is comparable to the extension of first-order optimisation…

Optimization and Control · Mathematics 2021-03-19 Tuomo Valkonen

Given a nonconvex function that is an average of $n$ smooth functions, we design stochastic first-order methods to find its approximate stationary points. The convergence of our new methods depends on the smallest (negative) eigenvalue…

Optimization and Control · Mathematics 2018-09-28 Zeyuan Allen-Zhu

To minimize or upper-bound the value of a function "robustly", we might instead minimize or upper-bound the "epsilon-robust regularization", defined as the map from a point to the maximum value of the function within an epsilon-radius. This…

Optimization and Control · Mathematics 2010-06-10 Adrian S. Lewis , C. H. Jeffrey Pang

We investigate a class of composite nonconvex functions, where the outer function is the sum of univariate extended-real-valued convex functions and the inner function is the limit of difference-of-convex functions. A notable feature of…

Optimization and Control · Mathematics 2024-11-21 Hanyang Li , Ying Cui

Submodular continuous functions are a category of (generally) non-convex/non-concave functions with a wide spectrum of applications. We characterize these functions and demonstrate that they can be maximized efficiently with approximation…

Machine Learning · Computer Science 2019-05-07 Andrew An Bian , Baharan Mirzasoleiman , Joachim M. Buhmann , Andreas Krause

We study dentable maps from a closed convex subset of a Banach space into a metric space as an attempt of generalize the Radon-Nikod\'ym property to a "less linear" frame. We note that a certain part of the theory can be developed in rather…

Functional Analysis · Mathematics 2017-06-01 Luis García-Lirola , Matías Raja

In a series of previous papers, we initiated a systematic study of semihypergroups and had a thorough discussion on certain analytic and algebraic aspects associated to this class of objects. In particular, we introduced the notion of…

Functional Analysis · Mathematics 2024-04-30 Choiti Bandyopadhyay

We analyse the $\Gamma$-convergence of general non-local convolution type functionals with varying densities depending on the space variable and on the symmetrized gradient. The limit is a local free-discontinuity functional, where the bulk…

Analysis of PDEs · Mathematics 2024-11-20 Roberta Marziani , Francesco Solombrino

Proximal gradient methods are a popular tool for the solution of structured, nonsmooth minimization problems. In this work, we investigate an extension of the former to general Banach spaces and provide worst-case convergence rates for,…

Optimization and Control · Mathematics 2025-09-30 Gerd Wachsmuth , Daniel Walter

We establish a general principle which states that regularizing an inverse problem with a convex function yields solutions which are convex combinations of a small number of atoms. These atoms are identified with the extreme points and…

Optimization and Control · Mathematics 2018-11-27 Claire Boyer , Antonin Chambolle , Yohann De Castro , Vincent Duval , Frédéric De Gournay , Pierre Weiss

The classical theory of regularity of embeddings of compact convex sets was developed in the 1970s, exclusively in the real case, and even there it does not appear to have been stated in its simplest form. We begin by revisiting this…

Operator Algebras · Mathematics 2026-02-04 David P. Blecher

This paper deals with the regularization of the sum of functions defined on a locally convex spaces through their closed-convex hulls in the bidual space. Different conditions guaranteeing that the closed-convex hull of the sum is the sum…

Optimization and Control · Mathematics 2024-10-11 Rafael Correa , Abderrahim Hantoute , Marco A. López

We prove that certain Bellman functions of several variables are the minimal locally concave functions. This generalizes earlier results about Bellman functions of two variables.

Classical Analysis and ODEs · Mathematics 2022-04-28 Dmitriy Stolyarov , Pavel Zatitskiy

Optimization models with non-convex constraints arise in many tasks in machine learning, e.g., learning with fairness constraints or Neyman-Pearson classification with non-convex loss. Although many efficient methods have been developed…

Optimization and Control · Mathematics 2023-03-24 Runchao Ma , Qihang Lin , Tianbao Yang

Non-convex functions that yet satisfy a condition of uniform convexity for non-close points can arise in discrete constructions. We prove that this sort of discrete uniform convexity is inherited by the convex envelope, which is the key to…

Functional Analysis · Mathematics 2021-05-12 Guillaume Grelier , Matías Raja

In part II we constructed the lower bound, in the spirit of $\Gamma$- $\liminf$ for some general classes of singular perturbation problems, with or without the prescribed differential constraint, taking the form E_\e(v):=\int_\Omega…

Analysis of PDEs · Mathematics 2013-09-26 Arkady Poliakovsky