English
Related papers

Related papers: Fast and accurate optimization on the orthogonal m…

200 papers

In this paper, we propose and analyze a fast two-point gradient algorithm for solving nonlinear ill-posed problems, which is based on the sequential subspace optimization method. A complete convergence analysis is provided under the…

Analysis of PDEs · Mathematics 2019-11-06 Guangyu Gao , Bo Han , Shanshan Tong

In the event of a total loss of thrust, a pilot must identify a reachable landing site and subsequently execute a forced landing. To do so, they must estimate which region on the ground can be reached safely in gliding flight. We call this…

Optimization and Control · Mathematics 2024-07-30 Giovanni Piccioli

In this paper, we present a novel penalty model called ExPen for optimization over the Stiefel manifold. Different from existing penalty functions for orthogonality constraints, ExPen adopts a smooth penalty function without using any…

Optimization and Control · Mathematics 2022-12-20 Nachuan Xiao , Xin Liu

This paper addresses the problem of low-rank distance matrix completion. This problem amounts to recover the missing entries of a distance matrix when the dimension of the data embedding space is possibly unknown but small compared to the…

Optimization and Control · Mathematics 2013-04-26 B. Mishra , G. Meyer , R. Sepulchre

In this paper, we propose a Riemannian steepest descent method for solving a blind deconvolution problem. We prove that the proposed algorithm with an appropriate initialization will recover the exact solution with high probability when the…

Information Theory · Computer Science 2018-04-17 Wen Huang , Paul Hand

An algorithm is devised for solving minimization problems with equality constraints. The algorithm uses first-order derivatives of both the objective function and the constraints. The step is computed as a sum between a steepest-descent…

Numerical Analysis · Mathematics 2017-11-15 Cristian Barbarosie , Sérgio Lopes , Anca-Maria Toader

The backpropagation algorithm, which had been originally introduced in the 1970s, is the workhorse of learning in neural networks. This backpropagation algorithm makes use of the famous machine learning algorithm known as Gradient Descent,…

Machine Learning · Computer Science 2018-02-02 Varun Ranganathan , S. Natarajan

We investigate the problem of efficiently computing optimal transport (OT) distances, which is equivalent to the node-capacitated minimum cost maximum flow problem in a bipartite graph. We compare runtimes in computing OT distances on data…

Data Structures and Algorithms · Computer Science 2020-07-07 Yihe Dong , Yu Gao , Richard Peng , Ilya Razenshteyn , Saurabh Sawlani

The objective function used in trajectory optimization is often non-convex and can have an infinite set of local optima. In such cases, there are diverse solutions to perform a given task. Although there are a few methods to find multiple…

Robotics · Computer Science 2021-07-14 Takayuki Osa

The FIND algorithm is a fast algorithm designed to calculate certain entries of the inverse of a sparse matrix. Such calculation is critical in many applications, e.g., quantum transport in nano-devices. We extended the algorithm to other…

Numerical Analysis · Mathematics 2015-05-27 Song Li , Eric Darve

Low rank matrix approximation is a popular topic in machine learning. In this paper, we propose a new algorithm for this topic by minimizing the least-squares estimation over the Riemannian manifold of fixed-rank matrices. The algorithm is…

Machine Learning · Computer Science 2022-02-15 Qianqian Song

We present a novel algorithm which can overcome the drawbacks of the conventional linear scaling method with minimal computational overhead. This is achieved by introducing additional constraints, thus eliminating the redundancy of the…

Materials Science · Physics 2015-06-25 Eiji Tsuchida

We study the existing algorithms that solve the multidimensional martingale optimal transport. Then we provide a new algorithm based on entropic regularization and Newton's method. Then we provide theoretical convergence rate results and we…

Probability · Mathematics 2018-12-31 Hadrien De March

Terrain geometry is, in general, non-smooth, non-linear, non-convex, and, if perceived through a robot-centric visual unit, appears partially occluded and noisy. This work presents the complete control pipeline capable of handling the…

Robotics · Computer Science 2022-07-06 Fabian Jenelten , Ruben Grandia , Farbod Farshidian , Marco Hutter

This paper focuses on minimizing a smooth function combined with a nonsmooth regularization term on a compact Riemannian submanifold embedded in the Euclidean space under a decentralized setting. Typically, there are two types of approaches…

Optimization and Control · Mathematics 2025-07-16 Lei Wang , Le Bao , Xin Liu

In [Q. Liao et al., Commun. Math. Sci., 20(2022)], a linear-time Sinkhorn algorithm is developed based on dynamic programming, which significantly reduces the computational complexity involved in solving optimal transport problems. However,…

Optimization and Control · Mathematics 2025-03-25 Ziyuan Lyu , Zihao Wang , Hao Wu , Shuai Yang

The effectiveness of dimensionality reduction with quadratic manifolds hinges on the choice of a reduced basis and the associated quadratic correction terms. Existing approaches typically rely on subspaces spanned by the leading principal…

Numerical Analysis · Mathematics 2026-05-27 Gavin Paxton , Seunghee Cheon , Rudy Geelen , Shane A. McQuarrie

In this paper, we propose an improved numerical algorithm for solving minimax problems based on nonsmooth optimization, quadratic programming and iterative process. We also provide a rigorous proof of convergence for our algorithm under…

Artificial Intelligence · Computer Science 2025-07-02 Qing Xu , Xiaohua Xuan

In this paper, we propose a low-rank coordinate descent approach to structured semidefinite programming with diagonal constraints. The approach, which we call the Mixing method, is extremely simple to implement, has no free parameters, and…

Optimization and Control · Mathematics 2026-05-12 Po-Wei Wang , Wei-Cheng Chang , J. Zico Kolter

A key problem in multiobjective linear programming is to find the set of all efficient extreme points in objective space. In this paper we introduce oriented projective geometry as an efficient and effective framework for solving this…

Optimization and Control · Mathematics 2010-06-17 Benjamin A. Burton , Melih Ozlen