English
Related papers

Related papers: Tight Error Bounds for the Sign-Constrained Stiefe…

200 papers

We study the boundary rigidity problem with partial data consisting of determining locally the Riemannian metric of a Riemannian manifold with boundary from the distance function measured at pairs of points near a fixed point on the…

Differential Geometry · Mathematics 2015-10-09 Plamen Stefanov , Gunther Uhlmann , Andras Vasy

In the first part of this study, a convex-constrained penalized formulation was studied for a class of constant modulus (CM) problems. In particular, the error bound techniques were shown to play a vital role in providing exact penalization…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Junbin Liu , Ya Liu , Wing-Kin Ma , Mingjie Shao , Anthony Man-Cho So

We propose a class of multipliers correction methods to minimize a differentiable function over the Stiefel manifold. The proposed methods combine a function value reduction step with a proximal correction step. The former one searches…

Optimization and Control · Mathematics 2021-09-30 Lei Wang , Bin Gao , Xin Liu

The proximal gradient algorithm for minimizing the sum of a smooth and a nonsmooth convex function often converges linearly even without strong convexity. One common reason is that a multiple of the step length at each iteration may…

Optimization and Control · Mathematics 2016-06-29 Dmitriy Drusvyatskiy , Adrian S. Lewis

In this paper, we provide novel tail bounds on the optimization error of Stochastic Mirror Descent for convex and Lipschitz objectives. Our analysis extends the existing tail bounds from the classical light-tailed Sub-Gaussian noise case to…

Machine Learning · Computer Science 2023-12-13 Khaled Eldowa , Andrea Paudice

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

It has long been known how to construct radiation boundary conditions for the time dependent wave equation. Although arguments suggesting that they are accurate have been given, it is only recently that rigorous error bounds have been…

Numerical Analysis · Mathematics 2008-11-06 Charles Siegel , Avy Soffer , Chris Stucchio

The main tool to study a second order optimality problem is the Hessian operator associated to the cost function that defines the optimization problem. By regarding an orthogonal Stiefel manifold as a constraint manifold embedded in an…

Numerical Analysis · Mathematics 2020-07-03 Petre Birtea , Ioan Casu , Dan Comanescu

We introduce an estimator for distances in a compact Riemannian manifold based on graph Laplacian estimates of the Laplace-Beltrami operator. We upper bound the error in the estimate of manifold distances, or more precisely an estimate of a…

Statistics Theory · Mathematics 2023-05-17 Dena Marie Asta

The theory of mixed finite element methods for solving different types of elliptic partial differential equations in saddle point formulation is well established since many decades. This topic was mostly studied for variational formulations…

Numerical Analysis · Mathematics 2024-03-04 Vitoriano Ruas

In this paper, we study closed four-dimensional manifolds. In particular, we show that under various new pinching curvature conditions (for example, the sectional curvature is no more than 5/6 of the smallest Ricci eigenvalue) then the…

Differential Geometry · Mathematics 2022-08-31 Xiaodong Cao , Hung Tran

In this paper, we establish sufficient conditions for the existence of error bounds at infinity for lower semicontinuous inequality systems. We also show that the existence of an error bound at infinity of constraint systems plays an…

Optimization and Control · Mathematics 2023-11-06 Nguyen Van Tuyen

We consider a class of nonsmooth optimization problems over the Stiefel manifold, in which the objective function is weakly convex in the ambient Euclidean space. Such problems are ubiquitous in engineering applications but still largely…

Optimization and Control · Mathematics 2021-03-26 Xiao Li , Shixiang Chen , Zengde Deng , Qing Qu , Zhihui Zhu , Anthony Man Cho So

A compact Riemannian manifold is associated with geometric data given by the eigenvalues of various Laplacian operators on the manifold and the triple overlap integrals of the corresponding eigenmodes. This geometric data must satisfy…

High Energy Physics - Theory · Physics 2021-07-19 James Bonifacio , Kurt Hinterbichler

In semidefinite programming a proposed optimal solution may be quite poor in spite of having sufficiently small residual in the optimality conditions. This issue may be framed in terms of the discrepancy between forward error (the…

Optimization and Control · Mathematics 2019-08-14 Stefan Sremac , Hugo J. Woerdeman , Henry Wolkowicz

The QCD at finite density is not well understood yet, where standard Monte Carlo simulation suffers from the sign problem. In order to overcome the sign problem, the method of Lefschetz thimble has been explored. Basically, the original…

High Energy Physics - Lattice · Physics 2018-04-18 Shoichiro Tsutsui , Takahiro M. Doi

Using the Moore--Penrose pseudoinverse, this work generalizes the gradient approximation technique called centred simplex gradient to allow sample sets containing any number of points. This approximation technique is called the…

Numerical Analysis · Mathematics 2020-06-02 Warren Hare , Gabriel Jarry--Bolduc , Chayne Planiden

Stochastic Gradient Descent (SGD) plays a central role in modern machine learning. While there is extensive work on providing error upper bound for SGD, not much is known about SGD error lower bound. In this paper, we study the convergence…

Optimization and Control · Mathematics 2019-10-21 Zhiyan Ding , Yiding Chen , Qin Li , Xiaojin Zhu

In this article we extend and strengthen the seminal work by Niyogi, Smale, and Weinberger on the learning of the homotopy type from a sample of an underlying space. In their work, Niyogi, Smale, and Weinberger studied samples of $C^2$…

The Lipschitz constant is an important quantity that arises in analysing the convergence of gradient-based optimization methods. It is generally unclear how to estimate the Lipschitz constant of a complex model. Thus, this paper studies an…

Machine Learning · Statistics 2023-02-10 Calypso Herrera , Florian Krach , Josef Teichmann