English
Related papers

Related papers: Learning Invariant Riemannian Geometric Representa…

200 papers

Reformulating computer vision problems over Riemannian manifolds has demonstrated superior performance in various computer vision applications. This is because visual data often forms a special structure lying on a lower dimensional space…

Computer Vision and Pattern Recognition · Computer Science 2015-09-21 Kun Zhao , Azadeh Alavi , Arnold Wiliem , Brian C. Lovell

By incorporating physical consistency as inductive bias, deep neural networks display increased generalization capabilities and data efficiency in learning nonlinear dynamic models. However, the complexity of these models generally…

Machine Learning · Computer Science 2025-03-03 Katharina Friedl , Noémie Jaquier , Jens Lundell , Tamim Asfour , Danica Kragic

Representing images and videos with Symmetric Positive Definite (SPD) matrices and considering the Riemannian geometry of the resulting space has proven beneficial for many recognition tasks. Unfortunately, computation on the Riemannian…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Mehrtash T. Harandi , Mathieu Salzmann , Richard Hartley

The problem of determining the configuration of points from partial distance information, known as the Euclidean Distance Geometry (EDG) problem, is fundamental to many tasks in the applied sciences. In this paper, we propose two algorithms…

Optimization and Control · Mathematics 2024-10-10 Chandler Smith , HanQin Cai , Abiy Tasissa

Recurrent neural networks are powerful models for sequential data, able to represent complex dependencies in the sequence that simpler models such as hidden Markov models cannot handle. Yet they are notoriously hard to train. Here we…

Neural and Evolutionary Computing · Computer Science 2015-02-04 Yann Ollivier

The last decade has witnessed an experimental revolution in data science and machine learning, epitomised by deep learning methods. Indeed, many high-dimensional learning tasks previously thought to be beyond reach -- such as computer…

Machine Learning · Computer Science 2021-05-04 Michael M. Bronstein , Joan Bruna , Taco Cohen , Petar Veličković

The paper addresses the problem of learning a regression model parameterized by a fixed-rank positive semidefinite matrix. The focus is on the nonlinear nature of the search space and on scalability to high-dimensional problems. The…

Machine Learning · Computer Science 2011-02-01 Gilles Meyer , Silvere Bonnabel , Rodolphe Sepulchre

This paper advocates Riemannian multi-manifold modeling in the context of network-wide non-stationary time-series analysis. Time-series data, collected sequentially over time and across a network, yield features which are viewed as points…

In this paper, we develop a new classification method for manifold-valued data in the framework of probabilistic learning vector quantization. In many classification scenarios, the data can be naturally represented by symmetric positive…

Machine Learning · Computer Science 2021-02-02 Fengzhen Tang , Haifeng Feng , Peter Tino , Bailu Si , Daxiong Ji

Neural network representation learning for spatial data is a common need for geographic artificial intelligence (GeoAI) problems. In recent years, many advancements have been made in representation learning for points, polylines, and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Gengchen Mai , Chiyu Jiang , Weiwei Sun , Rui Zhu , Yao Xuan , Ling Cai , Krzysztof Janowicz , Stefano Ermon , Ni Lao

This work proposes a geometric insight into equivariant message passing on Riemannian manifolds. As previously proposed, numerical features on Riemannian manifolds are represented as coordinate-independent feature fields on the manifold. To…

Machine Learning · Statistics 2023-10-17 Ilyes Batatia

When training overparameterized deep networks for classification tasks, it has been widely observed that the learned features exhibit a so-called "neural collapse" phenomenon. More specifically, for the output features of the penultimate…

Machine Learning · Computer Science 2023-03-09 Can Yaras , Peng Wang , Zhihui Zhu , Laura Balzano , Qing Qu

Deep neural networks can approximate functions on different types of data, from images to graphs, with varied underlying structure. This underlying structure can be viewed as the geometry of the data manifold. By extending recent advances…

Machine Learning · Computer Science 2023-01-03 Saket Tiwari , George Konidaris

Reliable training of generative adversarial networks (GANs) typically require massive datasets in order to model complicated distributions. However, in several applications, training samples obey invariances that are \textit{a priori}…

This article presents an overview of robot learning and adaptive control applications that can benefit from a joint use of Riemannian geometry and probabilistic representations. The roles of Riemannian manifolds, geodesics and parallel…

Robotics · Computer Science 2020-03-31 Sylvain Calinon

A complete understanding of the widely used over-parameterized deep networks is a key step for AI. In this work we try to give a geometric picture of over-parameterized deep networks using our geometrization scheme. We show that the…

Machine Learning · Computer Science 2019-02-12 Xiao Dong , Ling Zhou

The problem of extending a function $f$ defined on a training data $\mathcal{C}$ on an unknown manifold $\mathbb{X}$ to the entire manifold and a tubular neighborhood of this manifold is considered in this paper. For $\mathbb{X}$ embedded…

Machine Learning · Computer Science 2016-07-26 Charles K. Chui , H. N. Mhaskar

In this paper, we dive into the reliability concerns of Integrated Gradients (IG), a prevalent feature attribution method for black-box deep learning models. We particularly address two predominant challenges associated with IG: the…

Machine Learning · Computer Science 2024-05-17 Eslam Zaher , Maciej Trzaskowski , Quan Nguyen , Fred Roosta

We test the efficiency of applying Geometric Deep Learning to the problems in low-dimensional topology in a certain simple setting. Specifically, we consider the class of 3-manifolds described by plumbing graphs and use Graph Neural…

Geometric Topology · Mathematics 2023-07-31 Pavel Putrov , Song Jin Ri

For a large class of feature maps we provide a tight asymptotic characterisation of the test error associated with learning the readout layer, in the high-dimensional limit where the input dimension, hidden layer widths, and number of…

Machine Learning · Statistics 2024-06-11 Dominik Schröder , Daniil Dmitriev , Hugo Cui , Bruno Loureiro