English
Related papers

Related papers: Coherent set identification via direct low rank ma…

200 papers

Low-rank matrix factorizations arise in a wide variety of applications -- including recommendation systems, topic models, and source separation, to name just a few. In these and many other applications, it has been widely noted that by…

Machine Learning · Statistics 2016-11-01 Liangbei Xu , Mark A. Davenport

Compression has emerged as one of the essential deep learning research topics, especially for the edge devices that have limited computation power and storage capacity. Among the main compression techniques, low-rank compression via matrix…

Machine Learning · Computer Science 2021-12-02 Moonjung Eo , Suhyun Kang , Wonjong Rhee

Differentiable systems in this paper means systems of equations that are described by differentiable real functions in real matrix variables. This paper proposes algorithms for finding minimal rank solutions to such systems over (arbitrary…

Optimization and Control · Mathematics 2017-05-30 Thanh Hieu Le

Structured low-rank approximation is the problem of minimizing a weighted Frobenius distance to a given matrix among all matrices of fixed rank in a linear space of matrices. We study exact solutions to this problem by way of computational…

Optimization and Control · Mathematics 2017-02-23 Giorgio Ottaviani , Pierre-Jean Spaenlehauer , Bernd Sturmfels

Efficient and accurate numerical approximation of the full Boltzmann equation has been a longstanding challenging problem in kinetic theory. This is mainly due to the high dimensionality of the problem and the complicated collision…

Numerical Analysis · Mathematics 2021-12-07 Jingwei Hu , Yubo Wang

Dynamic networks are interconnected dynamic systems with measured node signals and dynamic modules reflecting the links between the nodes. We address the problem of \red{identifying a dynamic network with known topology, on the basis of…

Systems and Control · Computer Science 2018-10-02 Harm H. M. Weerts , Paul M. J. Van den Hof , Arne G. Dankers

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

Data-fusion involves the integration of multiple related datasets. The statistical file-matching problem is a canonical data-fusion problem in multivariate analysis, where the objective is to characterise the joint distribution of a set of…

Methodology · Statistics 2021-04-08 Daniel Ahfock , Saumyadipta Pyne , Geoffrey J. McLachlan

Low-rank approximation with zeros aims to find a matrix of fixed rank and with a fixed zero pattern that minimizes the Euclidean distance to a given data matrix. We study the critical points of this optimization problem using algebraic…

Algebraic Geometry · Mathematics 2022-04-26 Kaie Kubjas , Luca Sodomaco , Elias Tsigaridas

Randomized algorithms have proven to perform well on a large class of numerical linear algebra problems. Their theoretical analysis is critical to provide guarantees on their behaviour, and in this sense, the stochastic analysis of the…

Numerical Analysis · Mathematics 2025-10-01 Alexandre Scotto Di Perrotolo , Youssef Diouane , Selime Gürol , Xavier Vasseur

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

Low-rank representation learning has emerged as a powerful tool for recovering missing values in power load data due to its ability to exploit the inherent low-dimensional structures of spatiotemporal measurements. Among various techniques,…

Machine Learning · Computer Science 2025-06-24 Yan Xia , Hao Feng , Hongwei Sun , Junjie Wang , Qicong Hu

Web page ranking and collaborative filtering require the optimization of sophisticated performance measures. Current Support Vector approaches are unable to optimize them directly and focus on pairwise comparisons instead. We present a new…

Information Retrieval · Computer Science 2007-05-23 Quoc Le , Alexander Smola

Reduced-rank (RR) regression may be interpreted as a dimensionality reduction technique able to reveal complex relationships among the data parsimoniously. However, RR regression models typically overlook any potential group structure among…

Methodology · Statistics 2024-06-26 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

Low-rank matrix completion consists of computing a matrix of minimal complexity that recovers a given set of observations as accurately as possible. Unfortunately, existing methods for matrix completion are heuristics that, while highly…

Machine Learning · Computer Science 2026-03-12 Dimitris Bertsimas , Ryan Cory-Wright , Sean Lo , Jean Pauphilet

We consider the problem of estimating high-dimensional covariance matrices of a particular structure, which is a summation of low rank and sparse matrices. This covariance structure has a wide range of applications including factor analysis…

Methodology · Statistics 2013-10-17 Lin Zhang , Abhra Sarkar , Bani K. Mallick

Low rank matrix approximation is an important tool in machine learning. Given a data matrix, low rank approximation helps to find factors, patterns and provides concise representations for the data. Research on low rank approximation…

Computational Complexity · Computer Science 2017-04-21 Chen Dan , Kristoffer Arnsfelt Hansen , He Jiang , Liwei Wang , Yuchen Zhou

Low-rank matrix estimation plays a central role in various applications across science and engineering. Recently, nonconvex formulations based on matrix factorization are provably solved by simple gradient descent algorithms with strong…

Signal Processing · Electrical Eng. & Systems 2021-04-07 Cong Ma , Yuanxin Li , Yuejie Chi

Structured distributions, i.e. distributions over combinatorial spaces, are commonly used to learn latent probabilistic representations from observed data. However, scaling these models is bottlenecked by the high computational and memory…

Computation and Language · Computer Science 2022-01-11 Justin T. Chiu , Yuntian Deng , Alexander M. Rush

In this paper, we introduce a novel and robust approach to Quantized Matrix Completion (QMC). First, we propose a rank minimization problem with constraints induced by quantization bounds. Next, we form an unconstrained optimization problem…

Machine Learning · Statistics 2019-02-20 Ashkan Esmaeili , Farokh Marvasti