English
Related papers

Related papers: Hessian Operators on Constraint Manifolds

200 papers

We consider the problem of minimizing a function over the manifold of orthogonal matrices. The majority of algorithms for this problem compute a direction in the tangent space, and then use a retraction to move in that direction while…

Machine Learning · Statistics 2022-02-01 Pierre Ablin , Gabriel Peyré

Second order information is useful in many ways in smooth optimization problems, including for the design of step size rules and descent directions, or the analysis of the local properties of the objective functional. However, the…

Optimization and Control · Mathematics 2025-02-06 Marcus Carlsson , Viktor Nikitin , Erik Troedsson , Herwig Wendt

A matrix-compression algorithm is derived from a novel isogenic block decomposition for square matrices. The resulting compression and inflation operations possess strong functorial and spectral-permanence properties. The basic observation…

Rings and Algebras · Mathematics 2022-11-01 Alexander Belton , Dominique Guillot , Apoorva Khare , Mihai Putinar

In this paper, we study the problem of escaping from saddle points in smooth nonconvex optimization problems subject to a convex set $\mathcal{C}$. We propose a generic framework that yields convergence to a second-order stationary point of…

Machine Learning · Computer Science 2018-10-10 Aryan Mokhtari , Asuman Ozdaglar , Ali Jadbabaie

In this paper, we study global regularity for oblique boundary value problems of augmented Hessian equations for a class of general operators. By assuming a natural convexity condition of the domain together with appropriate convexity…

Analysis of PDEs · Mathematics 2017-12-13 Feida Jiang , Neil S. Trudinger

The aim of this paper is to design an efficient multigrid method for constrained convex optimization problems arising from discretization of some underlying infinite dimensional problems. Due to problem dependency of this approach, we only…

Optimization and Control · Mathematics 2016-02-12 Michal Kocvara , Sudaba Mohammed

There are several different notions of "low rank" for tensors, associated to different formats. Among them, the Tensor Train (TT) format is particularly well suited for tensors of high order, as it circumvents the curse of dimensionality:…

Optimization and Control · Mathematics 2020-11-30 Michael Psenka , Nicolas Boumal

In analogy with the Thurston norm, we define for an orientable 3-manifold $M$ a numerical function on $H_2(M;Q/Z)$. This function measures the minimal complexity of folded surfaces representing a given homology class. A similar function is…

Geometric Topology · Mathematics 2014-10-01 Vladimir Turaev

We provide an iterative solution approach for the indefinite Helmholtz equation discretised using finite elements, based upon a Hermitian Skew-Hermitian Splitting (HSS) iteration applied to the shifted operator, and prove that the iteration…

Numerical Analysis · Mathematics 2026-03-20 Colin J Cotter , Kars Knook , Joshua Hope-Collins

Based on an assumption on the Hessian of the Green function, we derive some monotonicity formulas on nonparabolic manifolds. This assumption is satisfied on manifolds that meet certain conditions including bounds on the sectional curvature…

Differential Geometry · Mathematics 2024-10-03 Jiewon Park

This memoir deals with the hypoelliptic calculus on Heisenberg manifolds, or Heisenberg calculus. The Heisenberg manifolds generalize CR and contact manifolds and in this context the main differential operators at stake include the…

Analysis of PDEs · Mathematics 2017-09-26 Raphael Ponge

We derive one-point functions of the loop operators of Hermitian matrix-chain models at finite $N$ in terms of differential operators acting on the partition functions. The differential operators are completely determined by recursion…

High Energy Physics - Theory · Physics 2009-10-22 Changrim Ahn , Kazuyasu Shigemoto

A new method to represent and approximate rotation matrices is introduced. The method represents approximations of a rotation matrix $Q$ with linearithmic complexity, i.e. with $\frac{1}{2}n\lg(n)$ rotations over pairs of coordinates,…

Machine Learning · Computer Science 2014-04-30 Michael Mathieu , Yann LeCun

Considering orthogonal Stiefel manifolds as constraint manifolds, we give an explicit description of a set of local coordinates that also generate a basis for the tangent space in any point of the orthogonal Stiefel manifolds. We show how…

Optimization and Control · Mathematics 2018-08-28 Petre Birtea , Ioan Casu , Dan Comanescu

Hessian operators arising in inverse problems governed by partial differential equations (PDEs) play a critical role in delivering efficient, dimension-independent convergence for both Newton solution of deterministic inverse problems, as…

We introduce a class of stochastic algorithms for minimizing weakly convex functions over proximally smooth sets. As their main building blocks, the algorithms use simplified models of the objective function and the constraint set, along…

Optimization and Control · Mathematics 2025-01-22 Damek Davis , Dmitriy Drusvyatskiy , Zhan Shi

We propose a method for solving constrained fixed point problems involving compositions of Lipschitz pseudo contractive and firmly nonexpansive operators in Hilbert spaces. Each iteration of the method uses separate evaluations of these…

Optimization and Control · Mathematics 2011-01-10 Luis M. Briceño-Arias

We compare two established and a new method for the calculation of spectral bounds for Hessian matrices on hyperrectangles by applying them to a large collection of 1522 objective and constraint functions extracted from benchmark global…

Optimization and Control · Mathematics 2013-09-06 Moritz Schulze Darup , Martin Kastsian , Stefan Mross , Martin Mönnigmann

In this paper, we address an extension of the theory of self-concordant functions for a manifold. We formulate the self-concordance of a geodesically convex function by a condition of the covariant derivative of its Hessian, and verify that…

Optimization and Control · Mathematics 2023-04-18 Hiroshi Hirai

We consider a purely algebraic result. Then given a circle or cyclic group of prime order action on a manifold, we will use it to estimate the lower bound of the number of fixed points. We also give an obstruction to the existence of…

Algebraic Topology · Mathematics 2018-10-18 Ping Li , Kefeng Liu