English
Related papers

Related papers: A Riemannian gossip approach to decentralized matr…

200 papers

In this paper, we focus on subspace learning problems on the Grassmann manifold. Interesting applications in this setting include low-rank matrix completion and low-dimensional multivariate regression, among others. Motivated by privacy…

Machine Learning · Computer Science 2018-03-01 Bamdev Mishra , Hiroyuki Kasai , Pratik Jawanpuria , Atul Saroop

Factoring a matrix into two low rank matrices is at the heart of many problems. The problem of matrix completion especially uses it to decompose a sparse matrix into two non sparse, low rank matrices which can then be used to predict…

Machine Learning · Computer Science 2018-01-12 Mukul Bhutani , Bamdev Mishra

The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over…

Optimization and Control · Mathematics 2012-09-19 Bart Vandereycken

In the context of sensor networks, gossip algorithms are a popular, well esthablished technique for achieving consensus when sensor data is encoded in linear spaces. Gossip algorithms also have several extensions to non linear data spaces.…

Optimization and Control · Mathematics 2014-05-19 Anass Bellachehab , Jérémie Jakubowicz

We propose a new Riemannian geometry for fixed-rank matrices that is specifically tailored to the low-rank matrix completion problem. Exploiting the degree of freedom of a quotient space, we tune the metric on our search space to the…

Machine Learning · Computer Science 2012-11-13 B. Mishra , K. Adithya Apuroop , R. Sepulchre

The low-rank matrix completion problem can be solved by Riemannian optimization on a fixed-rank manifold. However, a drawback of the known approaches is that the rank parameter has to be fixed a priori. In this paper, we consider the…

Optimization and Control · Mathematics 2022-02-21 Bin Gao , P. -A. Absil

We exploit the versatile framework of Riemannian optimization on quotient manifolds to develop R3MC, a nonlinear conjugate-gradient method for low-rank matrix completion. The underlying search space of fixed-rank matrices is endowed with a…

Optimization and Control · Mathematics 2014-09-23 B. Mishra , R. Sepulchre

In this work we present a new framework for the analysis and design of randomized gossip algorithms for solving the average consensus problem. We show how classical randomized iterative methods for solving linear systems can be interpreted…

Optimization and Control · Mathematics 2019-06-04 Nicolas Loizou , Peter Richtárik

We study the Riemannian optimization methods on the embedded manifold of low rank matrices for the problem of matrix completion, which is about recovering a low rank matrix from its partial entries. Assume $m$ entries of an $n\times n$ rank…

Numerical Analysis · Mathematics 2016-04-12 Ke Wei , Jian-Feng Cai , Tony F. Chan , Shingyu Leung

We consider the problem of reconstructing a low-rank matrix from a small subset of its entries. In this paper, we describe the implementation of an efficient algorithm called OptSpace, based on singular value decomposition followed by local…

Numerical Analysis · Computer Science 2013-01-30 Raghunandan H. Keshavan , Sewoong Oh

Robust low-rank matrix completion (RMC), or robust principal component analysis with partially observed data, has been studied extensively for computer vision, signal processing and machine learning applications. This problem aims to…

Machine Learning · Computer Science 2021-06-09 Minhui Huang , Shiqian Ma , Lifeng Lai

As decentralized AI and edge intelligence become increasingly prevalent, ensuring robustness and trustworthiness in such distributed settings has become a critical issue-especially in the presence of corrupted or adversarial data.…

Machine Learning · Statistics 2025-09-12 Anna Van Elst , Igor Colin , Stephan Clémençon

We propose a novel Riemannian manifold preconditioning approach for the tensor completion problem with rank constraint. A novel Riemannian metric or inner product is proposed that exploits the least-squares structure of the cost function…

Machine Learning · Computer Science 2016-05-27 Hiroyuki Kasai , Bamdev Mishra

In decentralized networks (of sensors, connected objects, etc.), there is an important need for efficient algorithms to optimize a global cost function, for instance to learn a global model from the local data collected by each computing…

Machine Learning · Statistics 2019-01-25 Igor Colin , Aurélien Bellet , Joseph Salmon , Stéphan Clémençon

The problem of low rank matrix completion is considered in this paper. To exploit the underlying low-rank structure of the data matrix, we propose a hierarchical Gaussian prior model, where columns of the low-rank matrix are assumed to…

Machine Learning · Computer Science 2018-05-09 Linxiao Yang , Jun Fang , Huiping Duan , Hongbin Li , Bing Zeng

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

In this paper, we describe a low-rank matrix completion method based on matrix decomposition. An incomplete matrix is decomposed into submatrices which are filled with a proposed trimming step and then are recombined to form a low-rank…

Numerical Analysis · Mathematics 2010-06-29 Rick Ma , Samuel Cheng

This paper approaches high-rank matrix completion (HRMC) by filling missing entries in a data matrix where columns lie near a union of subspaces, clustering these columns, and identifying the underlying subspaces. Current methods often lack…

Machine Learning · Computer Science 2026-02-04 Huanran Li , Jeremy Johnson , Daniel Pimentel-Alarcón

In this paper, randomized gossip-type matrix-weighted consensus algorithms are proposed for both leaderless and leader-follower topologies. First, we introduce the notion of expected matrix-weighted network, which captures the…

Systems and Control · Electrical Eng. & Systems 2024-10-25 Nhat-Minh Le-Phan , Minh Hoang Trinh , Phuoc Doan Nguyen

The paper looks at a scaled variant of the stochastic gradient descent algorithm for the matrix completion problem. Specifically, we propose a novel matrix-scaling of the partial derivatives that acts as an efficient preconditioning for the…

Machine Learning · Computer Science 2016-10-06 Bamdev Mishra , Rodolphe Sepulchre
‹ Prev 1 2 3 10 Next ›