English
Related papers

Related papers: Bayesian Inference on Matrix Manifolds for Linear …

200 papers

Directional data emerges in a wide array of applications, ranging from atmospheric sciences to medical imaging. Modeling such data, however, poses unique challenges by virtue of their being constrained to non-Euclidean spaces like…

Statistics Theory · Mathematics 2019-07-10 Subhadip Pal , Subhajit Sengupta , Riten Mitra , Arunava Banerjee

In image set classification, a considerable progress has been made by representing original image sets on Grassmann manifolds. In order to extend the advantages of the Euclidean based dimensionality reduction methods to the Grassmann…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Rui Wang , Xiao-Jun Wu , Kai-Xuan Chen , Josef Kittler

We introduce an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens…

Machine Learning · Statistics 2019-11-05 Arya A Pourzanjani , Richard M Jiang , Brian Mitchell , Paul J Atzberger , Linda R Petzold

Despite the recent success of Bayesian optimization (BO) in a variety of applications where sample efficiency is imperative, its performance may be seriously compromised in settings characterized by high-dimensional parameter spaces. A…

Machine Learning · Computer Science 2020-11-26 Noémie Jaquier , Leonel Rozo

Many machine learning applications are naturally formulated as optimization problems on Riemannian manifolds. The main idea behind Riemannian optimization is to maintain the feasibility of the variables while moving along a descent…

Optimization and Control · Mathematics 2024-06-05 Andi Han , Pratik Jawanpuria , Bamdev Mishra

Sparsity-based representations have recently led to notable results in various visual recognition tasks. In a separate line of research, Riemannian manifolds have been shown useful for dealing with features and models that do not lie in…

Machine Learning · Computer Science 2015-05-21 Mehrtash Harandi , Richard Hartley , Chunhua Shen , Brian Lovell , Conrad Sanderson

Learning representations on Grassmann manifolds is popular in quite a few visual recognition tasks. In order to enable deep learning on Grassmann manifolds, this paper proposes a deep network architecture by generalizing the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Zhiwu Huang , Jiqing Wu , Luc Van Gool

Bayesian inference was once a gold standard for learning with neural networks, providing accurate full predictive distributions and well calibrated uncertainty. However, scaling Bayesian inference techniques to deep neural networks is…

Machine Learning · Computer Science 2019-07-18 Pavel Izmailov , Wesley J. Maddox , Polina Kirichenko , Timur Garipov , Dmitry Vetrov , Andrew Gordon Wilson

Bayesian optimization (BO) recently became popular in robotics to optimize control parameters and parametric policies in direct reinforcement learning due to its data efficiency and gradient-free approach. However, its performance may be…

Robotics · Computer Science 2019-10-14 Noémie Jaquier , Leonel Rozo , Sylvain Calinon , Mathias Bürger

Variational Bayes (VB) has become a widely-used tool for Bayesian inference in statistics and machine learning. Nonetheless, the development of the existing VB algorithms is so far generally restricted to the case where the variational…

Machine Learning · Computer Science 2021-08-04 Minh-Ngoc Tran , Dang H. Nguyen , Duy Nguyen

The last decade has witnessed an explosion in the development of models, theory and computational algorithms for "big data" analysis. In particular, distributed computing has served as a natural and dominating paradigm for statistical…

Machine Learning · Statistics 2018-11-02 Bayan Saparbayeva , Michael Minyi Zhang , Lizhen Lin

It is often possible to perform reduced order modelling by specifying linear subspace which accurately captures the dynamics of the system. This approach becomes especially appealing when linear subspace explicitly depends on parameters of…

Machine Learning · Computer Science 2026-04-17 Vladimir Fanaskov , Vladislav Trifonov , Alexander Rudikov , Ekaterina Muravleva , Ivan Oseledets

We investigate the problem of recovering a partially observed high-rank matrix whose columns obey a nonlinear structure such as a union of subspaces, an algebraic variety or grouped in clusters. The recovery problem is formulated as the…

Machine Learning · Statistics 2022-12-12 Florentin Goyens , Coralia Cartis , Armin Eftekhari

Modern machine learning increasingly leverages the insight that high-dimensional data often lie near low-dimensional, non-linear manifolds, an idea known as the manifold hypothesis. By explicitly modeling the geometric structure of data…

Machine Learning · Computer Science 2026-03-02 Willem Diepeveen , Deanna Needell

We propose an approach for capturing the signal variability in hyperspectral imagery using the framework of the Grassmann manifold. Labeled points from each class are sampled and used to form abstract points on the Grassmannian. The…

Computer Vision and Pattern Recognition · Computer Science 2015-02-04 Sofya Chepushtanova , Michael Kirby

This paper reviews recent developments in statistical structure learning; namely, Bayesian model reduction. Bayesian model reduction is a method for rapidly computing the evidence and parameters of probabilistic models that differ only in…

Methodology · Statistics 2019-10-15 Karl Friston , Thomas Parr , Peter Zeidman

Adaptive stochastic gradient algorithms in the Euclidean space have attracted much attention lately. Such explorations on Riemannian manifolds, on the other hand, are relatively new, limited, and challenging. This is because of the…

Machine Learning · Computer Science 2019-07-01 Hiroyuki Kasai , Pratik Jawanpuria , Bamdev Mishra

Matrix manifolds, such as manifolds of Symmetric Positive Definite (SPD) matrices and Grassmann manifolds, appear in many applications. Recently, by applying the theory of gyrogroups and gyrovector spaces that is a powerful framework for…

Machine Learning · Statistics 2023-06-06 Xuan Son Nguyen , Shuo Yang

Optimal dimensionality reduction methods are proposed for the Bayesian inference of a Gaussian linear model with additive noise in presence of overabundant data. Three different optimal projections of the observations are proposed based on…

Statistics Theory · Mathematics 2018-02-13 Loïc Giraldi , Olivier P. Le Maître , Ibrahim Hoteit , Omar M. Knio

Recent advances in computer vision and machine learning suggest that a wide range of problems can be addressed more appropriately by considering non-Euclidean geometry. In this paper we explore sparse dictionary learning over the space of…

Computer Vision and Pattern Recognition · Computer Science 2013-10-21 Mehrtash Harandi , Conrad Sanderson , Chunhua Shen , Brian C. Lovell