Related papers: More Virtuous Smoothing
This paper investigates a specific class of nonsmooth nonconvex optimization problems in the face of data uncertainty, namely, robust optimization problems, where the given objective function can be expressed as a difference of two…
This paper studies smooth nonconvex-concave minimax optimization and two acceleration mechanisms for single-loop first-order methods: dual perturbation and smoothing. Although both techniques improve convergence guarantees, their relative…
This paper proposes a universal algorithm for convex minimization problems of the composite form $g_0(x)+h(g_1(x),\dots, g_m(x)) + u(x)$. We allow each $g_j$ to independently range from being nonsmooth Lipschitz to smooth, from convex to…
In this note we prove the following good-$\lambda$ inequality, for $r>2$, all $\lambda > 0$, $\delta \in \big(0, \frac{1}{2} \big)$ \[ \nu\big\{ V_r(f) > 3 \lambda ; \mathcal{M}(f) \leq \delta \lambda\big\} \leq 4 \nu\{s(f) > \delta…
Solving evolutionary equations in a parallel-in-time manner is an attractive topic and many algorithms are proposed in recent two decades. The algorithm based on the block $\alpha$-circulant preconditioning technique has shown promising…
In many practical decision-making problems it happens that functions involved in optimization process are black-box with unknown analytical representations and hard to evaluate. In this paper, a global optimization problem is considered…
Given a smooth, symmetric, homogeneous of degree one function $f=f\left(\lambda_{1},\cdots,\,\lambda_{n}\right)$ satisfying $\partial_{i}f>0$ for all $i=1,\cdots,\, n$, and an oriented, properly embedded smooth cone $\mathcal{C}^n$ in…
In some applications, one is interested in reconstructing a function $f$ from its Fourier series coefficients. The problem is that the Fourier series is slowly convergent if the function is non-periodic, or is non-smooth. In this paper, we…
In this short note, we establish the following result: Let $f:[0,+\infty[\to [0,+\infty[$, $\alpha:[0,1]\to ]0,+\infty[$ be two continuous functions, with $f(0)=0$. Assume that, for some $a>0$, the function $\xi\to…
We investigate polyconvexity of the double well function $f(X)\,:= |X-X\_1|^2|X-X\_2|^2$ for given matrices $X\_1, X\_2 \in \R^{n \times n}$. Such functions are fundamental in the modeling of phase transitions in materials, but their…
Let $\|\cdot\|_{\mathbf A}$ be a norm on $\mathbb C^m$ given by the formula $\|(z_1,\ldots,z_m)\|_{\mathbf A}=\|z_1A_1+\cdots+z_mA_m\|_{\rm op}$ for some choice of an $m$-tuple of $n\times n$ linearly independent matrices $\mathbf A=(A_1,…
We give a series of very general sufficient conditions in order to ensure the uniqueness of large solutions for --$\Delta$u + f (x, u) = 0 in a bounded domain $\Omega$ where f : $\Omega$ x R $\rightarrow$ R + is a continuous function, such…
Let $A$ be a positive definite operator on a Hilbert space $H$, and $|||.|||$ be a unitarily invariant norm on $B(H)$. We show that if $f$ is an operator monotone function on $(0,\infty)$ and $n\in \mathbb{N}$, then $|||D^n…
For strongly convex objectives that are smooth, the classical theory of gradient descent ensures linear convergence relative to the number of gradient evaluations. An analogous nonsmooth theory is challenging. Even when the objective is…
Fix integers a_1,...,a_d satisfying a_1 + ... + a_d = 0. Suppose that f : Z_N -> [0,1], where N is prime. We show that if f is ``smooth enough'' then we can bound from below the sum of f(x_1)...f(x_d) over all solutions (x_1,...,x_d) in Z_N…
This paper studies the convexity properties of nonsmooth extended-real-valued weakly convex functions, a class of functions that is central to modern optimization and its applications. We establish new characterizations of convexity using…
In this paper, we introduce a novel indefinite summation $\sum_{t} f(t)$ (or antidifference $\Delta ^{-1}f(t) $ ) formula for any given function $f$. We apply the indefinite summation formula to calculate a particular solution to a…
In this paper we consider stochastic composite convex optimization problems with the objective function satisfying a stochastic bounded gradient condition, with or without a quadratic functional growth property. These models include the…
This note studies numerical methods for solving compositional optimization problems, where the inner function is smooth, and the outer function is Lipschitz continuous, non-smooth, and non-convex but exhibits one of two special structures…
We revisit the geometrically decaying step size given a positive inverse condition number, under which a locally Lipschitz function shows linear convergence. The positivity does not require the function to satisfy convexity, weak convexity,…