English
Related papers

Related papers: Manifold learning and optimization using tangent s…

200 papers

Recent methods in geometric deep learning have introduced various neural networks to operate over data that lie on Riemannian manifolds. Such networks are often necessary to learn well over graphs with a hierarchical structure or to learn…

Machine Learning · Statistics 2023-10-17 Isay Katsman , Eric Ming Chen , Sidhanth Holalkere , Anna Asch , Aaron Lou , Ser-Nam Lim , Christopher De Sa

One of the ultimate goals of Manifold Learning (ML) is to reconstruct an unknown nonlinear low-dimensional manifold embedded in a high-dimensional observation space by a given set of data points from the manifold. We derive a local lower…

Machine Learning · Computer Science 2012-12-27 Alexander V. Bernstein , Alexander P. Kuleshov

One of the main challenges in modern deep learning is to understand why such over-parameterized models perform so well when trained on finite data. A way to analyze this generalization concept is through the properties of the associated…

Machine Learning · Computer Science 2023-07-11 Alison Pouplin , Hrittik Roy , Sidak Pal Singh , Georgios Arvanitidis

Graph Neural Networks usually rely on the assumption that the graph topology is available to the network as well as optimal for the downstream task. Latent graph inference allows models to dynamically learn the intrinsic graph structure of…

Machine Learning · Computer Science 2023-06-28 Haitz Sáez de Ocáriz Borde , Anees Kazi , Federico Barbero , Pietro Liò

Deep neural networks have reshaped modern machine learning by learning powerful latent representations that often align with the manifold hypothesis: high-dimensional data lie on lower-dimensional manifolds. In this paper, we establish a…

Machine Learning · Computer Science 2025-06-09 Nico Pelleriti , Max Zimmer , Elias Wirth , Sebastian Pokutta

In this paper, we propose an efficient method to estimate the Weingarten map for point cloud data sampled from manifold embedded in Euclidean space. A statistical model is established to analyze the asymptotic property of the estimator. In…

Machine Learning · Statistics 2021-05-17 Yueqi Cao , Didong Li , Huafei Sun , Amir H Assadi , Shiqiang Zhang

This paper addresses a class of nonsmooth and nonconvex optimization problems defined on complete Riemannian manifolds. The objective function has a composite structure, combining convex, differentiable, and lower semicontinuous terms,…

Optimization and Control · Mathematics 2025-11-19 Vitaliano S. Amaral , Marcio Antônio de A. Bortoloti , Jurandir O. Lopes , Gilson N. Silva

The techniques and analysis presented in this thesis provide new methods to solve optimization problems posed on Riemannian manifolds. These methods are applied to the subspace tracking problem found in adaptive signal processing and…

Optimization and Control · Mathematics 2013-05-09 Steven Thomas Smith

This paper proposes a general framework of Riemannian adaptive optimization methods. The framework encapsulates several stochastic optimization algorithms on Riemannian manifolds and incorporates the mini-batch strategy that is often used…

Optimization and Control · Mathematics 2025-02-14 Hiroyuki Sakai , Hideaki Iiduka

We introduce a method for learning to generate the surface of 3D shapes. Our approach represents a 3D shape as a collection of parametric surface elements and, in contrast to methods generating voxel grids or point clouds, naturally infers…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Thibault Groueix , Matthew Fisher , Vladimir G. Kim , Bryan C. Russell , Mathieu Aubry

Representing images and videos with Symmetric Positive Definite (SPD) matrices and considering the Riemannian geometry of the resulting space has proven beneficial for many recognition tasks. Unfortunately, computation on the Riemannian…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Mehrtash T. Harandi , Mathieu Salzmann , Richard Hartley

Latent space geometry provides a rigorous and empirically valuable framework for interacting with the latent variables of deep generative models. This approach reinterprets Euclidean latent spaces as Riemannian through a pull-back metric,…

Machine Learning · Statistics 2024-08-15 Stas Syrota , Pablo Moreno-Muñoz , Søren Hauberg

To identify and fit geometric primitives (e.g., planes, spheres, cylinders, cones) in a noisy point cloud is a challenging yet beneficial task for fields such as robotics and reverse engineering. As a multi-model multi-instance fitting…

Computer Vision and Pattern Recognition · Computer Science 2018-10-04 Duanshun Li , Chen Feng

Dirichlet-to-Neumann maps enable the coupling of multiphysics simulations across computational subdomains by ensuring continuity of state variables and fluxes at artificial interfaces. We present a novel method for learning…

Machine Learning · Computer Science 2026-01-27 Adrienne M. Propp , Jonas A. Actor , Elise Walker , Houman Owhadi , Nathaniel Trask , Daniel M. Tartakovsky

The problem of learning a manifold structure on a dataset is framed in terms of a generative model, to which we use ideas behind autoencoders (namely adversarial/Wasserstein autoencoders) to fit deep neural networks. From a machine learning…

Machine Learning · Statistics 2018-03-02 Eric O. Korman

Manifold learning approaches seek the intrinsic, low-dimensional data structure within a high-dimensional space. Mainstream manifold learning algorithms, such as Isomap, UMAP, $t$-SNE, Diffusion Map, and Laplacian Eigenmaps do not use data…

Machine Learning · Statistics 2023-07-04 Jake S. Rhodes

Many machine learning problems involve regressing variables on a non-Euclidean manifold -- e.g. a discrete probability distribution, or the 6D pose of an object. One way to tackle these problems through gradient-based learning is to use a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Romain Brégier

In this paper, we study alternating projections on nontangential manifolds based on the tangent spaces. The main motivation is that the projection of a point onto a manifold can be computational expensive. We propose to use the tangent…

Numerical Analysis · Mathematics 2020-03-24 Guangjing Song , Michael K. Ng

Reformulating computer vision problems over Riemannian manifolds has demonstrated superior performance in various computer vision applications. This is because visual data often forms a special structure lying on a lower dimensional space…

Computer Vision and Pattern Recognition · Computer Science 2015-09-21 Kun Zhao , Azadeh Alavi , Arnold Wiliem , Brian C. Lovell

Symmetric Positive Definite (SPD) matrices have been widely used for data representation in many visual recognition tasks. The success mainly attributes to learning discriminative SPD matrices with encoding the Riemannian geometry of the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-18 Zhiwu Huang , Ruiping Wang , Xianqiu Li , Wenxian Liu , Shiguang Shan , Luc Van Gool , Xilin Chen