Related papers: Second-order edge-penalization in the Ambrosio-Tor…
This paper studies formulations of second-order elliptic partial differential equations in nondivergence form on convex domains as equivalent variational problems. The first formulation is that of Smears \& S\"uli [SIAM J.\ Numer.\ Anal.\…
We extend the standard notion of self-concordance to non-convex optimization and develop a family of second-order algorithms with global convergence guarantees. In particular, two function classes -- \textit{weakly self-concordant}…
We consider a modification of the OMM energy functional which contains an $\ell^1$ penalty term in order to find a sparse representation of the low-lying eigenspace of self-adjoint operators. We analyze the local minima of the modified…
We study the problem of minimizing the second Dirichlet eigenvalue for the Laplacian operator among sets of given perimeter. In two dimensions, we prove that the optimum exists, is convex, regular, and its boundary contains exactly two…
The unconstrained minimization of a sufficiently smooth objective function $f(x)$ is considered, for which derivatives up to order $p$, $p\geq 2$, are assumed to be available. An adaptive regularization algorithm is proposed that uses…
We present a general technique for the analysis of first-order methods. The technique relies on the construction of a duality gap for an appropriate approximation of the objective function, where the function approximation improves as the…
This paper proves comparison principles for elliptic PDE involving the Finsler infinity Laplacian, a second-order differential operator with discontinuities in the gradient variable arising in $L^{\infty}$-variational problems and…
We extend the generalized flux formulation of Double Field Theory to include all the first order bosonic contributions to the $\alpha '$ expansion of the heterotic string low energy effective theory. The generalized tangent space and…
In this paper, a simplified second-order Gaussian Poincar\'e inequality for normal approximation of functionals over infinitely many Rademacher random variables is derived. It is based on a new bound for the Kolmogorov distance between a…
In this paper, we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints are locally smooth. For solving this problem, we propose a…
A new necessary minimality condition for the Mumford-Shah functional is derived by means of second order variations. It is expressed in terms of a sign condition for a nonlocal quadratic form on $H^1_0(\Gamma)$, $\Gamma$ being a submanifold…
In this paper we initiate the study of $2$nd order variational problems in $L^\infty$, seeking to minimise the $L^\infty$ norm of a function of the hessian. We also derive and study the respective PDE arising as the analogue of the…
In this paper, we consider the problem of minimizing the sum of two convex functions subject to linear linking constraints. The classical alternating direction type methods usually assume that the two convex functions have relatively easy…
We consider shape functionals obtained as minima on Sobolev spaces of classical integrals having smooth and convex densities, under mixed Dirichlet-Neumann boundary conditions. We propose a new approach for the computation of the second…
Recently a majorization method for optimizing partition functions of log-linear models was proposed alongside a novel quadratic variational upper-bound. In the batch setting, it outperformed state-of-the-art first- and second-order…
We develop a discrete counterpart of the De Giorgi-Nash-Moser theory, which provides uniform H\"older-norm bounds on continuous piecewise affine finite element approximations of second-order linear elliptic problems of the form $-\nabla…
Optimization with nonnegative orthogonality constraints has wide applications in machine learning and data sciences. It is NP-hard due to some combinatorial properties of the constraints. We first propose an equivalent optimization…
We propose a second-order (Hessian or Hessian-free) based optimization method for variational inference inspired by Gaussian backpropagation, and argue that quasi-Newton optimization can be developed as well. This is accomplished by…
The present paper is a sequel to our work on hybrid geometry of curves and their moduli spaces. We introduce a notion of hybrid Laplacian, formulate a hybrid Poisson equation, and give a mathematical meaning to the convergence both of the…
This work presents a new algorithm for empirical risk minimization. The algorithm bridges the gap between first- and second-order methods by computing a search direction that uses a second-order-type update in one subspace, coupled with a…