English
Related papers

Related papers: Low-rank multi-parametric covariance identificatio…

200 papers

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

Although there is no doubt that multi-parameter persistent homology is a useful tool to analyse multi-variate data, efficient ways to compute these modules are still lacking in the available topological data analysis toolboxes. Other issues…

Algebraic Topology · Mathematics 2021-04-15 Asilata Bapat , Robyn Brooks , Celia Hacker , Claudia Landi , Barbara I. Mahler

We consider regular polynomial interpolation algorithms on recursively defined sets of interpolation points which approximate global solutions of arbitrary well-posed systems of linear partial differential equations. Convergence of the…

Numerical Analysis · Mathematics 2008-07-10 Joerg Kampen

Efficient solution of the lowest eigenmodes is studied for a family of related eigenvalue problems with common $2\times 2$ block structure. It is assumed that the upper diagonal block varies between different versions while the lower…

Numerical Analysis · Mathematics 2020-06-19 Antti Hannukainen , Jarmo Malinen , Antti Ojalammi

To approximate solutions of a linear differential equation, we project, via trigonometric interpolation, its solution space onto a finite-dimensional space of trigonometric polynomials and construct a matrix representation of the…

Numerical Analysis · Mathematics 2011-08-30 Oksana Bihun , Austin Bren , Michael Dyrud , Kristin Heysse

In this paper, we consider optimal low-rank regularized inverse matrix approximations and their applications to inverse problems. We give an explicit solution to a generalized rank-constrained regularized inverse approximation problem,…

Numerical Analysis · Mathematics 2016-03-21 Julianne Chung , Matthias Chung

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

The dynamical low-rank approximation of time-dependent matrices is a low-rank factorization updating technique. It leads to differential equations for factors of the matrices, which need to be solved numerically. We propose and analyze a…

Numerical Analysis · Mathematics 2013-01-09 Christian Lubich , Ivan Oseledets

Low-rank approximation of a matrix by means of structured random sampling has been consistently efficient in its extensive empirical studies around the globe, but adequate formal support for this empirical phenomenon has been missing so…

Numerical Analysis · Mathematics 2016-07-21 Victor Pan , John Svadlenka , Liang Zhao

Low-rank modeling generally refers to a class of methods that solve problems by representing variables of interest as low-rank matrices. It has achieved great success in various fields including computer vision, data mining, signal…

Computer Vision and Pattern Recognition · Computer Science 2014-10-24 Xiaowei Zhou , Can Yang , Hongyu Zhao , Weichuan Yu

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

(Rephrased) Non-conformance decision-making processes in high-precision manufacturing of engineering structures are often delayed due to numerical simulations that are needed for analyzing the defective parts and assemblies. Interfaces…

Numerical Analysis · Mathematics 2024-05-31 Kiran Sagar Kollepara

Pooling second-order local feature statistics to form a high-dimensional bilinear feature has been shown to achieve state-of-the-art performance on a variety of fine-grained classification tasks. To address the computational demands of high…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Shu Kong , Charless Fowlkes

As distributed systems increase in size, the need for scalable algorithms becomes more and more important. We argue that in the context of system identification, an essential building block of any scalable algorithm is the ability to…

Optimization and Control · Mathematics 2014-07-23 Nikolai Matni , Anders Rantzer

Motivated by the problem of learning a linear regression model whose parameter is a large fixed-rank non-symmetric matrix, we consider the optimization of a smooth cost function defined on the set of fixed-rank matrices. We adopt the…

Machine Learning · Computer Science 2013-04-25 B. Mishra , G. Meyer , S. Bonnabel , R. Sepulchre

Given a set of $K$ probability densities, we consider the multimarginal generative modeling problem of learning a joint distribution that recovers these densities as marginals. The structure of this joint distribution should identify…

Machine Learning · Computer Science 2023-10-06 Michael S. Albergo , Nicholas M. Boffi , Michael Lindsey , Eric Vanden-Eijnden

A class of parametric functions formed by alternating compositions of multivariate polynomials and rectification style monomial maps is studied (the layer-wise exponents are treated as fixed hyperparameters and are not optimized). For this…

Optimization and Control · Mathematics 2026-02-13 Shravan Mohan

Determinantal varieties -- the sets of bounded-rank matrices or tensors -- have attracted growing interest in low-rank optimization. The tangent cone to low-rank sets is widely studied and underpins a range of geometric methods. The…

Optimization and Control · Mathematics 2025-12-12 Yan Yang , Bin Gao , Ya-xiang Yuan

Variational families with full-rank covariance approximations are known not to work well in black-box variational inference (BBVI), both empirically and theoretically. In fact, recent computational complexity results for BBVI have…

Machine Learning · Statistics 2025-11-14 Joohwan Ko , Kyurae Kim , Woo Chang Kim , Jacob R. Gardner

Low-rank approximations of data matrices are an important dimensionality reduction tool in machine learning and regression analysis. We consider the case of categorical variables, where it can be formulated as the problem of finding…

Machine Learning · Computer Science 2018-03-14 Reka Kovacs , Oktay Gunluk , Raphael Hauser