English
Related papers

Related papers: Rotation Synchronization via Deep Matrix Factoriza…

200 papers

The synchronization problem over the special orthogonal group $SO(d)$ consists of estimating a set of unknown rotations $R_1,R_2,...,R_n$ from noisy measurements of a subset of their pairwise ratios $R_{i}^{-1}R_{j}$. The problem has found…

Information Theory · Computer Science 2013-07-17 Lanhui Wang , Amit Singer

3D shape matching is a long-standing problem in computer vision and computer graphics. While deep neural networks were shown to lead to state-of-the-art results in shape matching, existing learning-based approaches are limited in the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Dongliang Cao , Florian Bernard

With the recent success of representation learning methods, which includes deep learning as a special case, there has been considerable interest in developing representation learning techniques that can incorporate known physical…

Machine Learning · Computer Science 2021-09-10 Harsha Vardhan Tetali , Joel B. Harley , Benjamin D. Haeffele

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Mathematically characterizing the implicit regularization induced by gradient-based optimization is a longstanding pursuit in the theory of deep learning. A widespread hope is that a characterization based on minimization of norms may…

Machine Learning · Computer Science 2020-10-20 Noam Razin , Nadav Cohen

It has been an important approach of using matrix completion to perform image restoration. Most previous works on matrix completion focus on the low-rank property by imposing explicit constraints on the recovered matrix, such as the…

Machine Learning · Computer Science 2022-06-28 Zhemin Li , Zhi-Qin John Xu , Tao Luo , Hongxia Wang

Dynamic graph clustering aims to detect and track time-varying clusters in dynamic graphs, revealing the evolutionary mechanisms of complex real-world dynamic systems. Matrix factorization-based methods are promising approaches for this…

Machine Learning · Computer Science 2025-02-11 Dongyuan Li , Satoshi Kosugi , Ying Zhang , Manabu Okumura , Feng Xia , Renhe Jiang

Matrix seriation, the problem of permuting the rows and columns of a matrix to uncover latent structure, is a fundamental technique in data science, particularly in the visualization and analysis of relational data. Applications span…

Optimization and Control · Mathematics 2025-06-25 Víctor Blanco , Alfredo Marín , Justo Puerto

Nonnegative matrix factorization (NMF) is widely used for clustering with strong interpretability. Among general NMF problems, symmetric NMF is a special one that plays an important role in graph clustering where each element measures the…

Machine Learning · Computer Science 2023-11-07 Mengyuan Zhang , Kai Liu

Data often comes in the form of an array or matrix. Matrix factorization techniques attempt to recover missing or corrupted entries by assuming that the matrix can be written as the product of two low-rank matrices. In other words, matrix…

Machine Learning · Computer Science 2015-12-16 Gintare Karolina Dziugaite , Daniel M. Roy

A new method to represent and approximate rotation matrices is introduced. The method represents approximations of a rotation matrix $Q$ with linearithmic complexity, i.e. with $\frac{1}{2}n\lg(n)$ rotations over pairs of coordinates,…

Machine Learning · Computer Science 2014-04-30 Michael Mathieu , Yann LeCun

Reconstructing the 3D model of a physical object typically requires us to align the depth scans obtained from different camera poses into the same coordinate system. Solutions to this global alignment problem usually proceed in two steps.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Xiangru Huang , Zhenxiao Liang , Xiaowei Zhou , Yao Xie , Leonidas Guibas , Qixing Huang

In this work we deal with parametric inverse problems, which consist in recovering a finite number of parameters describing the structure of an unknown object, from indirect measurements. State-of-the-art methods for approximating a…

Numerical Analysis · Mathematics 2021-12-22 Paolo Massa , Sara Garbarino , Federico Benvenuto

Constrained low-rank matrix approximations have been known for decades as powerful linear dimensionality reduction techniques to be able to extract the information contained in large data sets in a relevant way. However, such low-rank…

Machine Learning · Computer Science 2021-12-20 Pierre De Handschutter , Nicolas Gillis , Xavier Siebert

Recently, convex formulations of low-rank matrix factorization problems have received considerable attention in machine learning. However, such formulations often require solving for a matrix of the size of the data matrix, making it…

Machine Learning · Computer Science 2017-08-29 Benjamin D. Haeffele , Rene Vidal

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong

This paper gives a fresh look at network synchronization. Here we no longer analyze it from the view of mathematics, such as graph theory, while we probe into one from control theory. First, we analyze the synchronization region using the…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Jilie Zhang

This text investigates relations between two well-known family of algorithms, matrix factorisations and recursive linear filters, by describing a probabilistic model in which approximate inference corresponds to a matrix factorisation…

Machine Learning · Statistics 2015-09-08 Ömer Deniz Akyıldız

Implicit regularization is an important way to interpret neural networks. Recent theory starts to explain implicit regularization with the model of deep matrix factorization (DMF) and analyze the trajectory of discrete gradient dynamics in…

Machine Learning · Computer Science 2023-08-14 Jian Cao , Chen Qian , Yihui Huang , Dicheng Chen , Yuncheng Gao , Jiyang Dong , Di Guo , Xiaobo Qu

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung