English
Related papers

Related papers: Hybrid Riemannian Conjugate Gradient Methods with …

200 papers

We develop subgradient- and gradient-based methods for minimizing strongly convex functions under a notion which generalizes the standard Euclidean strong convexity. We propose a unifying framework for subgradient methods which yields two…

Optimization and Control · Mathematics 2016-08-19 Masaru Ito

In 1963, Polyak proposed a simple condition that is sufficient to show a global linear convergence rate for gradient descent. This condition is a special case of the \L{}ojasiewicz inequality proposed in the same year, and it does not…

Machine Learning · Computer Science 2020-09-15 Hamed Karimi , Julie Nutini , Mark Schmidt

In this paper we combine concepts from Riemannian Optimization and the theory of Sobolev gradients to derive a new conjugate gradient method for direct minimization of the Gross-Pitaevskii energy functional with rotation. The conservation…

Optimization and Control · Mathematics 2018-01-17 Ionut Danaila , Bartosz Protas

This paper proposes a generalized framework with joint normalization which learns lower-dimensional subspaces with maximum discriminative power by making use of the Riemannian geometry. In particular, we model the similarity/dissimilarity…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Tianci Liu , Zelin Shi , Yunpeng Liu

In this work, we analyze two of the most fundamental algorithms in geodesically convex optimization: Riemannian gradient descent and (possibly inexact) Riemannian proximal point. We quantify their rates of convergence and produce different…

Optimization and Control · Mathematics 2024-03-18 David Martínez-Rubio , Christophe Roux , Sebastian Pokutta

The conjugate function method is an algorithm for numerical computation of conformal mappings for simply and multiply connected domains on surfaces. In this paper the conjugate function method, earlier used for simply connected domains, is…

Numerical Analysis · Mathematics 2026-05-26 H. Hakula , A. Rasila , Y. Zheng

Dueling optimization considers optimizing an objective with access to only a comparison oracle of the objective function. It finds important applications in emerging fields such as recommendation systems and robotics. Existing works on…

Optimization and Control · Mathematics 2026-03-03 Yuxuan Ren , Abhishek Roy , Shiqian Ma

Gradient schemes is a framework which enables the unified convergence analysis of many different methods -- such as finite elements (conforming, non-conforming and mixed) and finite volumes methods -- for $2^{\rm nd}$ order diffusion…

Numerical Analysis · Mathematics 2018-10-09 Yahya Alnashri , Jerome Droniou

The ADM approach to canonical general relativity combined with Dirac's method of quantizing constrained systems leads to the Wheeler-DeWitt equation. A number of mathematical as well as physical difficulties that arise in connection with…

General Relativity and Quantum Cosmology · Physics 2009-10-28 N. P. Landsman

A variational formulation for accelerated optimization on normed vector spaces was recently introduced in Wibisono et al., and later generalized to the Riemannian manifold setting in Duruisseaux and Leok. This variational framework was…

Numerical Analysis · Mathematics 2022-05-18 Valentin Duruisseaux , Melvin Leok

We discuss first-order and second-order regularization effects for solutions to the classical heat equation. In particular we propose a global approach to study smoothing effects of Hamilton-Li-Yau type: such approach is nonlinear in spirit…

Analysis of PDEs · Mathematics 2024-09-25 Alessandro Goffi , Giulio Tralli

This article presents new local and global gradient estimates of Li-Yau type for positive solutions to a class of nonlinear elliptic equations on smooth metric measure spaces involving the Witten Laplacian. The estimates are derived under…

Analysis of PDEs · Mathematics 2023-03-03 Ali Taheri , Vahideh Vahidifar

In this paper, we define the geometric median of a probability measure on a Riemannian manifold, give its characterization and a natural condition to ensure its uniqueness. In order to calculate the median in practical cases, we also…

Differential Geometry · Mathematics 2019-02-20 Le Yang

Effective Hamiltonians arise in several problems, including homogenization of Hamilton--Jacobi equations, nonlinear control systems, Hamiltonian dynamics, and Aubry--Mather theory. In Aubry--Mather theory, related objects, Mather measures,…

Numerical Analysis · Mathematics 2020-04-20 Diogo A. Gomes , Xianjin Yang

In this paper, we propose a new global analysis framework for a class of low-rank matrix recovery problems on the Riemannian manifold. We analyze the global behavior for the Riemannian optimization with random initialization. We use the…

Machine Learning · Statistics 2021-04-20 Thomas Y. Hou , Zhenzhen Li , Ziyun Zhang

In this paper, we introduce the notion of generalized $\epsilon$-stationarity for a class of nonconvex and nonsmooth composite minimization problems on compact Riemannian submanifold embedded in Euclidean space. To find a generalized…

Optimization and Control · Mathematics 2023-10-31 Zheng Peng , Weihe Wu , Jiang Hu , Kangkang Deng

This paper introduces a new notion of a Fenchel conjugate, which generalizes the classical Fenchel conjugation to functions defined on Riemannian manifolds. We investigate its properties, e.g.,~the Fenchel--Young inequality and the…

Numerical Analysis · Mathematics 2024-02-23 Ronny Bergmann , Roland Herzog , Maurício Silva Louzeiro , Daniel Tenbrinck , José Vidal-Núñez

Comparison of numerical performances of two methods for coefficient inverse problems is described. The first one is the classical Gel'fand-Levitan-Krein equation method, and the second one is the recently developed approximately globally…

Mathematical Physics · Physics 2013-03-19 Andrey L. Karchevsky , Michael V. Klibanov , Lam Nguyen , Natee Pantong , Anders Sullivan

The scarcity of labeled data is a long-standing challenge for many machine learning tasks. We propose our gradient flow method to leverage the existing dataset (i.e., source) to generate new samples that are close to the dataset of interest…

Machine Learning · Computer Science 2023-11-06 Xinru Hua , Truyen Nguyen , Tam Le , Jose Blanchet , Viet Anh Nguyen

Optimization with constraints is a typical problem in quantum physics and quantum information science that becomes especially challenging for high-dimensional systems and complex architectures like tensor networks. Here we use ideas of…

Quantum Physics · Physics 2021-11-18 Ilia A. Luchnikov , Mikhail E. Krechetov , Sergey N. Filippov