English
Related papers

Related papers: Learning Subspaces of Different Dimension

200 papers

The shape and orientation of data clouds reflect variability in observations that can confound pattern recognition systems. Subspace methods, utilizing Grassmann manifolds, have been a great aid in dealing with such variability. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Xiaofeng Ma , Michael Kirby , Chris Peterson

spectral-based subspace learning is a common data preprocessing step in many machine learning pipelines. The main aim is to learn a meaningful low dimensional embedding of the data. However, most subspace learning methods do not take into…

Machine Learning · Computer Science 2023-06-14 Firas Laakom , Jenni Raitoharju , Nikolaos Passalis , Alexandros Iosifidis , Moncef Gabbouj

In image set classification, a considerable advance has been made by modeling the original image sets by second order statistics or linear subspace, which typically lie on the Riemannian manifold. Specifically, they are Symmetric Positive…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Rui Wang , Xiao-Jun Wu , Kai-Xuan Chen , Josef Kittler

Recent advances in computer vision and machine learning suggest that a wide range of problems can be addressed more appropriately by considering non-Euclidean geometry. In this paper we explore sparse dictionary learning over the space of…

Computer Vision and Pattern Recognition · Computer Science 2013-10-21 Mehrtash Harandi , Conrad Sanderson , Chunhua Shen , Brian C. Lovell

Low-dimensional embeddings for data from disparate sources play critical roles in multi-modal machine learning, multimedia information retrieval, and bioinformatics. In this paper, we propose a supervised dimensionality reduction method…

Machine Learning · Computer Science 2021-01-15 Yanjun Li , Bihan Wen , Hao Cheng , Yoram Bresler

When constructing a Bayesian Machine Learning model, we might be faced with multiple different prior distributions and thus are required to properly consider them in a sensible manner in our model. While this situation is reasonably well…

Machine Learning · Computer Science 2021-04-20 Sarem Seitz

Subspace-based signal processing traditionally focuses on problems involving a few subspaces. Recently, a number of problems in different application areas have emerged that involve a significantly larger number of subspaces relative to the…

Statistics Theory · Mathematics 2016-11-22 Waheed U. Bajwa , Dustin G. Mixon

Recently developed techniques have made it possible to quickly learn accurate probability density functions from data in low-dimensional continuous space. In particular, mixtures of Gaussians can be fitted to data very quickly using an…

Machine Learning · Computer Science 2013-01-18 Scott Davies , Andrew Moore

We propose an approach for capturing the signal variability in hyperspectral imagery using the framework of the Grassmann manifold. Labeled points from each class are sampled and used to form abstract points on the Grassmannian. The…

Computer Vision and Pattern Recognition · Computer Science 2015-02-04 Sofya Chepushtanova , Michael Kirby

We study the problem of learning mixtures of $k$ Gaussians in $d$ dimensions. We make no separation assumptions on the underlying mixture components: we only require that the covariance matrices have bounded condition number and that the…

Data Structures and Algorithms · Computer Science 2024-11-20 Sitan Chen , Vasilis Kontonis , Kulin Shah

We propose an adaptive tracking algorithm where the object is modelled as a continuously updated bag of affine subspaces, with each subspace constructed from the object's appearance over several consecutive frames. In contrast to linear…

Computer Vision and Pattern Recognition · Computer Science 2016-02-08 Sareh Shirazi , Conrad Sanderson , Chris McCool , Mehrtash T. Harandi

Matrix completion and robust principal component analysis have been widely used for the recovery of data suffering from missing entries or outliers. In many real-world applications however, the data is also time-varying, and the naive…

Signal Processing · Electrical Eng. & Systems 2019-06-25 Charul , Uttkarsha Bhatt , Pravesh Biyani , Ketan Rajawat

Analysis of a Bayesian mixture model for the Matrix Langevin distribution on the Stiefel manifold is presented. The model exploits a particular parametrization of the Matrix Langevin distribution, various aspects of which are elaborated on.…

Methodology · Statistics 2017-08-25 Subhajit Sengupta , Subhadip Pal , Riten Mitra , Ying Guo , Arunava Banerjee , Yuan Ji

Learning well-separated features in high-dimensional spaces, such as text or image embeddings, is crucial for many machine learning applications. Achieving such separation can be effectively accomplished through the dispersion of…

Machine Learning · Computer Science 2025-08-27 Evgeniia Tokarchuk , Hua Chang Bakker , Vlad Niculae

Bayesian inference for neural networks, or Bayesian deep learning, has the potential to provide well-calibrated predictions with quantified uncertainty and robustness. However, the main hurdle for Bayesian deep learning is its computational…

Machine Learning · Statistics 2023-09-07 Sanket Jantre , Nathan M. Urban , Xiaoning Qian , Byung-Jun Yoon

We introduce a novel and scalable Bayesian framework for multivariate-density-density regression (DDR), designed to model relationships between multivariate distributions. Our approach addresses the critical issue of distributions residing…

Methodology · Statistics 2025-09-24 Khai Nguyen , Yang Ni , Peter Mueller

It has become increasingly common to collect high-dimensional binary response data; for example, with the emergence of new sampling techniques in ecology. In smaller dimensions, multivariate probit (MVP) models are routinely used for…

Methodology · Statistics 2022-10-26 Antik Chakraborty , Rihui Ou , David B. Dunson

We consider Bayesian analysis on high-dimensional spheres with angular central Gaussian priors. These priors model antipodally symmetric directional data, are easily defined in Hilbert spaces and occur, for instance, in Bayesian binary…

Statistics Theory · Mathematics 2024-02-27 H. C. Lie , D. Rudolf , B. Sprungk , T. J. Sullivan

The posterior probability distribution for a set of model parameters encodes all that the data have to tell us in the context of a given model; it is the fundamental quantity for Bayesian parameter estimation. In order to infer the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-16 Rupert Allison , Joanna Dunkley

In high-dimensional Bayesian statistics, various methods have been developed, including prior distributions that induce parameter sparsity to handle many parameters. Yet, these approaches often overlook the rich spectral structure of the…

Statistics Theory · Mathematics 2025-05-06 Tomoya Wakayama , Masaaki Imaizumi