English
Related papers

Related papers: The condition number of a function relative to a s…

200 papers

In the article the necessary and sufficient conditions for a representation of Lipschitz function of two variables as a difference of two convex functions are formulated. An algorithm of this representation is given. The outcome of this…

Optimization and Control · Mathematics 2025-02-07 Igor Proudnikov

In this paper we consider a composite optimization problem that minimizes the sum of a weakly smooth function and a convex function with either a bounded domain or a uniformly convex structure. In particular, we first present a…

Optimization and Control · Mathematics 2023-05-30 Masaru Ito , Zhaosong Lu , Chuan He

A generalized conditional gradient method for minimizing the sum of two convex functions, one of them differentiable, is presented. This iterative method relies on two main ingredients: First, the minimization of a partially linearized…

Optimization and Control · Mathematics 2021-10-01 Karl Kunisch , Daniel Walter

Fractional derivatives are a well-studied generalization of integer order derivatives. Naturally, for optimization, it is of interest to understand the convergence properties of gradient descent using fractional derivatives. Convergence…

Optimization and Control · Mathematics 2024-06-05 Ashwani Aggarwal

Submodular Functions are a special class of set functions, which generalize several information-theoretic quantities such as entropy and mutual information [1]. Submodular functions have subgradients and subdifferentials [2] and admit…

Discrete Mathematics · Computer Science 2020-07-01 Rishabh Iyer , Jeff Bilmes

We show a Condition Number Theorem for the condition number of zero counting for real polynomial systems. That is, we show that this condition number equals the inverse of the normalized distance to the set of ill-posed systems (i.e., those…

Numerical Analysis · Computer Science 2010-07-12 Felipe Cucker , Teresa Krick , Gregorio Malajovich , Mario Wschebor

Motivated by some applications in signal processing and machine learning, we consider two convex optimization problems where, given a cone $K$, a norm $\|\cdot\|$ and a smooth convex function $f$, we want either 1) to minimize the norm over…

Optimization and Control · Mathematics 2013-03-29 Zaid Harchaoui , Anatoli Juditsky , Arkadi Nemirovski

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

Optimization and Control · Mathematics 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

We obtain operator concavity (convexity) of some functions of two or three variables by using perspectives of regular operator mappings of one or several variables. As an application, we obtain, for $ 0<p < 1,$ concavity, respectively…

Functional Analysis · Mathematics 2014-06-09 Zhihua Zhang

The condition number of a linear function of the indefinite least squares solution is called the partial condition number for the indefinite least squares problem. In this paper, based on a new and very general condition number which can be…

Numerical Analysis · Mathematics 2016-09-05 Hanyu Li , Shaoxin Wang

Abstract convexity generalises classical convexity by considering the suprema of functions taken from an arbitrarily defined set of functions. These are called the abstract linear (abstract affine) functions. The purpose of this paper is to…

Optimization and Control · Mathematics 2025-01-30 Reinier Diàz Millàn , Nadezda Sukhorukova , Julien Ugon

The convergence behavior of gradient methods for minimizing convex differentiable functions is one of the core questions in convex optimization. This paper shows that their well-known complexities can be achieved under conditions weaker…

Optimization and Control · Mathematics 2013-09-10 Hui Zhang , Wotao Yin

The stochastic gradient descent has been widely used for solving composite optimization problems in big data analyses. Many algorithms and convergence properties have been developed. The composite functions were convex primarily and…

Machine Learning · Statistics 2020-03-03 Takayuki Kawashima , Hironori Fujisawa

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

A function of a matrix is polyconvex when it can be expressed as a convex function of the matrix minors. Polyconvexity is a regularity condition ensuring existence of minimizers in nonlinear elasticity and, more broadly, in vectorial…

Optimization and Control · Mathematics 2026-04-14 Giovanni Fantuzzi , Didier Henrion , Martin Kru{ž}ík , Ajay Murali , Stephan Weis

We consider a random process as a solution of stochastic differential equations with dependence of the coefficients on small parameter $\varepsilon$ and we suppose that the drift coefficients of these equations are unbounded on the…

Probability · Mathematics 2023-12-15 Ivan H. Krykun

In the high-dimensional data setting, the sample covariance matrix is singular. In order to get a numerically stable and positive definite modification of the sample covariance matrix in the high-dimensional data setting, in this paper we…

Numerical Analysis · Mathematics 2021-01-20 Shaoxin Wang

In decision-making problems under uncertainty, probabilistic constraints are a valuable tool to express safety of decisions. They result from taking the probability measure of a given set of random inequalities depending on the decision…

Optimization and Control · Mathematics 2021-02-09 Yassine Laguel , Wim van Ackooij , Jérôme Malick , Guilherme Ramalho

We establish a necessary and sufficient condition for the differentiability of the distance function generated by a nonempty closed set K in a real normed linear space X under a proximinality condition on K. We do not assume the uniform…

Functional Analysis · Mathematics 2020-07-14 Triloki Nath

A real valued function $f$ defined on a convex $K$ is anemconvex function iff it satisfies $$ f((x+y)/2) \le (f(x)+f(y))/2 + 1. $$ A thorough study of approximately convex functions is made. The principal results are a sharp universal upper…

Metric Geometry · Mathematics 2007-05-23 S. J. Dilworth , Ralph Howard , James W. Roberts