English
Related papers

Related papers: Inductive Geometric Matrix Midranges

200 papers

In this paper we consider the problem of group invariant subspace clustering where the data is assumed to come from a union of group-invariant subspaces of a vector space, i.e. subspaces which are invariant with respect to action of a given…

Information Theory · Computer Science 2015-10-16 Shuchin Aeron , Eric Kernfeld

In recent years, Transformer-based auto-attention mechanisms have been successfully applied to the analysis of a variety of context-reliant data types, from texts to images and beyond, including data from non-Euclidean geometries. In this…

Machine Learning · Computer Science 2024-05-29 Mathieu Seraphim , Alexis Lechervy , Florian Yger , Luc Brun , Olivier Etard

Moir\'e materials such as magic angle twisted bilayer graphene (MATBG) exhibit remarkable phenomenology, but present significant challenges for certain experimental methods, particularly scanning probes such as scanning tunneling microscopy…

Strongly Correlated Electrons · Physics 2022-10-18 William Taranto , Samuel Lederer , Youngjoon Choi , Pavel Izmailov , Andrew Gordon Wilson , Stevan Nadj-Perge , Eun-Ah Kim

Topological data analysis is a relatively new branch of machine learning that excels in studying high dimensional data, and is theoretically known to be robust against noise. Meanwhile, data objects with mixed numeric and categorical…

Algebraic Topology · Mathematics 2020-06-15 Chengyuan Wu , Carol Anne Hargreaves

We study the convergence of a random iterative sequence of a family of operators on infinite dimensional Hilbert spaces, inspired by the Stochastic Gradient Descent (SGD) algorithm in the case of the noiseless regression, as studied in [1].…

Functional Analysis · Mathematics 2022-09-02 Soumyadip Ghosh , Yingdong Lu , Tomasz J. Nowicki

We introduce a novel algorithm for approximating the logarithm of the determinant of a symmetric positive definite (SPD) matrix. The algorithm is randomized and approximates the traces of a small number of matrix powers of a specially…

Data Structures and Algorithms · Computer Science 2016-09-01 Christos Boutsidis , Petros Drineas , Prabhanjan Kambadur , Eugenia-Maria Kontopoulou , Anastasios Zouzias

Extrinsic Gaussian process regression methods, such as wrapped Gaussian process, have been developed to analyze manifold data. However, there is a lack of intrinsic Gaussian process methods for studying complex data with manifold-valued…

Machine Learning · Statistics 2025-02-11 Zhanfeng Wang , Xinyu Li , Hao Ding , Jian Qing Shi

Longitudinal or panel data can be represented as a matrix with rows indexed by units and columns indexed by time. We consider inferential questions associated with the missing data version of panel data induced by staggered adoption. We…

Statistics Theory · Mathematics 2024-07-02 Yuling Yan , Martin J. Wainwright

Computational imaging has been revolutionized by compressed sensing algorithms, which offer guaranteed uniqueness, convergence, and stability properties. Model-based deep learning methods that combine imaging physics with learned…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Aniket Pramanik , M. Bridget Zimmerman , Mathews Jacob

The stochastic gradient descent (SGD) algorithm is widely used for parameter estimation, especially for huge data sets and online learning. While this recursive algorithm is popular for computation and memory efficiency, quantifying…

Machine Learning · Statistics 2021-06-23 Wanrong Zhu , Xi Chen , Wei Biao Wu

Information divergences are commonly used to measure the dissimilarity of two elements on a statistical manifold. Differentiable manifolds endowed with different divergences may possess different geometric properties, which can result in…

Signal Processing · Electrical Eng. & Systems 2021-08-17 Xiaoqiang Hua , Yusuke Ono , Linyu Peng , Yongqiang Cheng , Hongqiang Wang

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

Iterative procedures for parameter estimation based on stochastic gradient descent allow the estimation to scale to massive data sets. However, in both theory and practice, they suffer from numerical instability. Moreover, they are…

Methodology · Statistics 2016-06-08 Panos Toulis , Dustin Tran , Edoardo M. Airoldi

Traditional methods employed in matrix volatility forecasting often overlook the inherent Riemannian manifold structure of symmetric positive definite matrices, treating them as elements of Euclidean space, which can lead to suboptimal…

Computational Finance · Quantitative Finance 2024-12-13 Andrea Bucci , Michele Palma , Chao Zhang

We study the best low-rank Tucker decomposition of symmetric tensors. The motivating application is decomposing higher-order multivariate moments. Moment tensors have special structure and are important to various data science problems. We…

Numerical Analysis · Mathematics 2023-06-13 Ruhui Jin , Joe Kileel , Tamara G. Kolda , Rachel Ward

Unsupervised classification called clustering is a process of organizing objects into groups whose members are similar in some way. Clustering of uncertain data objects is a challenge in spatial data bases. In this paper we use Probability…

Databases · Computer Science 2013-12-10 Ramachandra Rao Kurada

This paper presents a new clustering algorithm for space-time data based on the concepts of topological data analysis and in particular, persistent homology. Employing persistent homology - a flexible mathematical tool from algebraic…

Machine Learning · Statistics 2019-10-28 Umar Islambekov , Yulia Gel

Representing images and videos with Symmetric Positive Definite (SPD) matrices, and considering the Riemannian geometry of the resulting space, has been shown to yield high discriminative power in many visual recognition tasks.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-23 Mehrtash Harandi , Mathieu Salzmann , Richard Hartley

Randomized iterative algorithms have attracted much attention in recent years because they can approximately solve large-scale linear systems of equations without accessing the entire coefficient matrix. In this paper, we propose two novel…

Numerical Analysis · Mathematics 2021-10-22 Kui Du , Xiao-Hui Sun

We introduce Thurstonian Boltzmann Machines (TBM), a unified architecture that can naturally incorporate a wide range of data inputs at the same time. Our motivation rests in the Thurstonian view that many discrete data types can be…

Machine Learning · Statistics 2014-08-04 Truyen Tran , Dinh Phung , Svetha Venkatesh