English
Related papers

Related papers: Manifold Proximal Point Algorithms for Dual Princi…

200 papers

Riemannian optimization is a principled framework for solving optimization problems where the desired optimum is constrained to a smooth manifold $\mathcal{M}$. Algorithms designed in this framework usually require some geometrical…

Optimization and Control · Mathematics 2022-09-08 Boris Shustin , Haim Avron , Barak Sober

We consider the classic Set Cover problem in the data stream model. For $n$ elements and $m$ sets ($m\geq n$) we give a $O(1/\delta)$-pass algorithm with a strongly sub-linear $\tilde{O}(mn^{\delta})$ space and logarithmic approximation…

Data Structures and Algorithms · Computer Science 2016-05-03 Sariel Har-Peled , Piotr Indyk , Sepideh Mahabadi , Ali Vakilian

The proximal point algorithm (PPA) is the most widely recognized method for solving inclusion problems and serves as the foundation for many numerical algorithms. Despite this popularity, its convergence results have been largely limited to…

Optimization and Control · Mathematics 2024-05-07 Brecht Evens , Pieter Pas , Puya Latafat , Panagiotis Patrinos

We present a framework for efficiently approximating differential-geometric primitives on arbitrary manifolds via construction of an atlas graph representation, which leverages the canonical characterization of a manifold as a finite…

Machine Learning · Computer Science 2025-01-23 Ryan A. Robinett , Lorenzo Orecchia , Samantha J. Riesenfeld

Many classical and modern machine learning algorithms require solving optimization tasks under orthogonality constraints. Solving these tasks with feasible methods requires a gradient descent update followed by a retraction operation on the…

Optimization and Control · Mathematics 2024-12-10 Youbang Sun , Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

We propose a primal-dual smoothing framework for finding a near-stationary point of a class of non-smooth non-convex optimization problems with max-structure. We analyze the primal and dual gradient complexities of the framework via two…

Optimization and Control · Mathematics 2023-07-19 Renbo Zhao

In this paper, we present two novel manifold inexact augmented Lagrangian methods, \textbf{ManIAL} for deterministic settings and \textbf{StoManIAL} for stochastic settings, solving nonsmooth manifold optimization problems. By using the…

Optimization and Control · Mathematics 2024-04-30 Kangkang Deng , Jiang Hu , Jiayuan Wu , Zaiwen Wen

Coordinating multiple agents to collaboratively maximize submodular functions in unpredictable environments is a critical task with numerous applications in machine learning, robot planning and control. The existing approaches, such as the…

Multiagent Systems · Computer Science 2025-02-10 Qixin Zhang , Zongqi Wan , Yu Yang , Li Shen , Dacheng Tao

In this paper, we present a novel method for solving multiobjective linear programming problems (MOLPP) that overcomes the need to calculate the optimal value of each objective function. This method is a follow-up to our previous work on…

Optimization and Control · Mathematics 2024-07-02 Mustapha Kaci , Sonia Radjef

We consider the problem of minimizing a non-convex function over a smooth manifold $\mathcal{M}$. We propose a novel algorithm, the Orthogonal Directions Constrained Gradient Method (ODCGM) which only requires computing a projection onto a…

Optimization and Control · Mathematics 2023-03-17 Sholom Schechtman , Daniil Tiapkin , Michael Muehlebach , Eric Moulines

Riemannian optimization has drawn a lot of attention due to its wide applications in practice. Riemannian stochastic first-order algorithms have been studied in the literature to solve large-scale machine learning problems over Riemannian…

Optimization and Control · Mathematics 2022-03-22 Bokun Wang , Shiqian Ma , Lingzhou Xue

Manifold learning approaches seek the intrinsic, low-dimensional data structure within a high-dimensional space. Mainstream manifold learning algorithms, such as Isomap, UMAP, $t$-SNE, Diffusion Map, and Laplacian Eigenmaps do not use data…

Machine Learning · Statistics 2023-07-04 Jake S. Rhodes

This paper addresses a class of nonsmooth and nonconvex optimization problems defined on complete Riemannian manifolds. The objective function has a composite structure, combining convex, differentiable, and lower semicontinuous terms,…

Optimization and Control · Mathematics 2025-11-19 Vitaliano S. Amaral , Marcio Antônio de A. Bortoloti , Jurandir O. Lopes , Gilson N. Silva

In this paper, we present a method for denoising and reconstruction of low-dimensional manifold in high-dimensional space. We suggest a multidimensional extension of the Locally Optimal Projection algorithm which was introduced by Lipman et…

Numerical Analysis · Mathematics 2022-11-17 Shira Faigenbaum-Golovin , David Levin

The Shapley value, and its broader family of semi-values, has received much attention in various attribution problems. A fundamental and long-standing challenge is their efficient approximation, since exact computation generally requires an…

Machine Learning · Computer Science 2026-04-10 Weida Li , Yaoliang Yu , Bryan Kian Hsiang Low

Modern sample points in many applications no longer comprise real vectors in a real vector space but sample points of much more complex structures, which may be represented as points in a space with a certain underlying geometric structure,…

Machine Learning · Statistics 2022-02-07 Zhigang Yao , Bingjie Li , Wee Chin Tan

Grover's algorithm is a fundamental quantum algorithm that offers a quadratic speedup for the unstructured search problem by alternately applying physically implementable oracle and diffusion operators. In this paper, we reformulate the…

Quantum Physics · Physics 2025-12-15 Zhijian Lai , Dong An , Jiang Hu , Zaiwen Wen

Recently, there has been much interest in spectral approaches to learning manifolds---so-called kernel eigenmap methods. These methods have had some successes, but their applicability is limited because they are not robust to noise. To…

Machine Learning · Computer Science 2012-06-22 Byron Boots , Geoff Gordon

We consider Riemannian optimization problems with inequality and equality constraints and analyze a class of Riemannian interior point methods for solving them. The algorithm of interest consists of outer and inner iterations. We show that,…

Optimization and Control · Mathematics 2026-05-12 Mitsuaki Obara , Takayuki Okuno , Akiko Takeda

We consider the problem of recovering a $d-$dimensional manifold $\mathcal{M} \subset \mathbb{R}^n$ when provided with noiseless samples from $\mathcal{M}$. There are many algorithms (e.g., Isomap) that are used in practice to fit manifolds…

Statistics Theory · Mathematics 2017-09-13 Kitty Mohammed , Hariharan Narayanan