English
Related papers

Related papers: Rotation Synchronization via Deep Matrix Factoriza…

200 papers

We describe a graph-based neural acceleration technique for nonnegative matrix factorization that builds upon a connection between matrices and bipartite graphs that is well-known in certain fields, e.g., sparse linear algebra, but has not…

Machine Learning · Computer Science 2022-02-02 Jens Sjölund , Maria Bånkestad

We consider the two problems of predicting links in a dynamic graph sequence and predicting functions defined at each node of the graph. In many applications, the solution of one problem is useful for solving the other. Indeed, if these…

Machine Learning · Computer Science 2012-03-27 Emile Richard , Andreas Argyriou , Theodoros Evgeniou , Nicolas Vayatis

Recently, a large number of efficient deep learning methods for solving inverse problems have been developed and show outstanding numerical performance. For these deep learning methods, however, a solid theoretical foundation in the form of…

Numerical Analysis · Mathematics 2020-02-04 Daniel Obmann , Johannes Schwab , Markus Haltmeier

Data assisted reconstruction algorithms, incorporating trained neural networks, are a novel paradigm for solving inverse problems. One approach is to first apply a classical reconstruction method and then apply a neural network to improve…

Numerical Analysis · Mathematics 2020-03-26 Yoeri E. Boink , Markus Haltmeier , Sean Holman , Johannes Schwab

Square matrices appear in many machine learning problems and models. Optimization over a large square matrix is expensive in memory and in time. Therefore an economic approximation is needed. Conventional approximation approaches factorize…

Machine Learning · Computer Science 2021-09-20 Ruslan Khalitov , Tong Yu , Lei Cheng , Zhirong Yang

This paper presents a general method for applying hierarchical matrix skeletonization factorizations to the numerical solution of boundary integral equations with possibly rank-deficient integral operators. Rank-deficient operators arise in…

Numerical Analysis · Mathematics 2021-04-08 John Paul Ryan , Anil Damle

Matrix factorization models have been extensively studied as a valuable test-bed for understanding the implicit biases of overparameterized models. Although both low nuclear norm and low rank regularization have been studied for these…

Machine Learning · Computer Science 2025-06-03 Zhiwei Bai , Jiajie Zhao , Yaoyu Zhang

In the classical context of robotic mapping and localization, map matching is typically defined as the task of finding a rigid transformation (i.e., 3DOF rotation/translation on the 2D moving plane) that aligns the query and reference maps…

Robotics · Computer Science 2016-09-09 Kanji Tanaka

Despite the outstanding performance of deep neural networks in different applications, they are still computationally extensive and require a great number of memories. This motivates more research on reducing the resources required for…

Machine Learning · Computer Science 2023-01-09 Alireza Bordbar , Mohammad Hossein Kahaei

Matrix factorization is a widely used approach for top-N recommendation and collaborative filtering. When implemented on implicit feedback data (such as clicks), a common heuristic is to upweight the observed interactions. This strategy has…

Information Retrieval · Computer Science 2025-10-14 Alex Ayoub , Samuel Robertson , Dawen Liang , Harald Steck , Nathan Kallus

One of the most important problems in the field of distributed optimization is the problem of minimizing a sum of local convex objective functions over a networked system. Most of the existing work in this area focus on developing…

Optimization and Control · Mathematics 2019-01-08 Fatemeh Mansoori , Ermin Wei

The goal of affine matrix rank minimization problem is to reconstruct a low-rank or approximately low-rank matrix under linear constraints. In general, this problem is combinatorial and NP-hard. In this paper, a nonconvex fraction function…

Optimization and Control · Mathematics 2018-06-21 Angang Cui , Jigen Peng , Haiyang Li

Symmetric nonnegative matrix factorization (NMF), a special but important class of the general NMF, is demonstrated to be useful for data analysis and in particular for various clustering tasks. Unfortunately, designing fast algorithms for…

Machine Learning · Computer Science 2018-11-15 Zhihui Zhu , Xiao Li , Kai Liu , Qiuwei Li

Low-rank factorization is a popular model compression technique that minimizes the error $\delta$ between approximated and original weight matrices. Despite achieving performances close to the original models when $\delta$ is optimized, a…

Machine Learning · Computer Science 2025-12-24 Boyang Zhang , Daning Cheng , Yunquan Zhang , Fangming Liu , Jiake Tian

Matrix factorization is a popular approach to solving matrix estimation problems based on partial observations. Existing matrix factorization is based on least squares and aims to yield a low-rank matrix to interpret the conditional sample…

Machine Learning · Statistics 2017-03-06 Rui Zhu , Di Niu , Linglong Kong , Zongpeng Li

We derive approximation algorithms for the nonnegative matrix factorization problem, i.e. the problem of factorizing a matrix as the product of two matrices with nonnegative coefficients. We form convex approximations of this problem which…

Optimization and Control · Mathematics 2012-07-03 Vijay Krishnamurthy , Alexandre d'Aspremont

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

Machine Learning · Computer Science 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

Multiresolution analysis and matrix factorization are foundational tools in computer vision. In this work, we study the interface between these two distinct topics and obtain techniques to uncover hierarchical block structure in symmetric…

Computer Vision and Pattern Recognition · Computer Science 2017-05-17 Vamsi K. Ithapu , Risi Kondor , Sterling C. Johnson , Vikas Singh

The alignment of a set of objects by means of transformations plays an important role in computer vision. Whilst the case for only two objects can be solved globally, when multiple objects are considered usually iterative methods are used.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-12 Florian Bernard , Johan Thunberg , Peter Gemmar , Frank Hertel , Andreas Husch , Jorge Goncalves

Neural networks have achieved remarkable success in many cognitive tasks. However, when they are trained sequentially on multiple tasks without access to old data, their performance on early tasks tend to drop significantly. This problem is…

Machine Learning · Computer Science 2021-02-10 Dong Yin , Mehrdad Farajtabar , Ang Li , Nir Levine , Alex Mott