English
Related papers

Related papers: Vector-wise Joint Diagonalization of Almost Commut…

200 papers

Symmetric orthogonalization via SVD, and closely related procedures, are well-known techniques for projecting matrices onto $O(n)$ or $SO(n)$. These tools have long been used for applications in computer vision, for example optimal 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Jake Levinson , Carlos Esteves , Kefan Chen , Noah Snavely , Angjoo Kanazawa , Afshin Rostamizadeh , Ameesh Makadia

In this paper we consider a family of algorithms for approximate implicitization of rational parametric curves and surfaces. The main approximation tool in all of the approaches is the singular value decomposition, and they are therefore…

Numerical Analysis · Mathematics 2016-05-30 Oliver J. D. Barrowclough , Tor Dokken

We study the problem of learning a structured approximation (low-rank, sparse, banded, etc.) to an unknown matrix $A$ given access to matrix-vector product (matvec) queries of the form $x \rightarrow Ax$ and $x \rightarrow A^Tx$. This…

Data Structures and Algorithms · Computer Science 2025-07-28 Noah Amsel , Pratyush Avi , Tyler Chen , Feyza Duman Keles , Chinmay Hegde , Cameron Musco , Christopher Musco , David Persson

Designing efficient quasi-Newton methods is an important problem in nonlinear optimization and the solution of systems of nonlinear equations. From the perspective of the matrix approximation process, this paper presents a unified framework…

Optimization and Control · Mathematics 2025-08-15 Zhenyuan Ji

A modification of the well-known step-by-step process for solving Nevanlinna-Pick problems in the class of $\bR_0$-functions gives rise to a linear pencil $H-\lambda J$, where $H$ and $J$ are Hermitian tridiagonal matrices. First, we show…

Classical Analysis and ODEs · Mathematics 2010-08-24 Maxim Derevyagin

We propose a unifying algorithm for non-smooth non-convex optimization. The algorithm approximates the objective function by a convex model function and finds an approximate (Bregman) proximal point of the convex model. This approximate…

Optimization and Control · Mathematics 2018-06-27 Peter Ochs , Jalal Fadili , Thomas Brox

The diagonalization of matrices may be the top priority in the application of modern physics. In this paper, we numerically demonstrate that, for real symmetric random matrices with non-positive off-diagonal elements, a universal scaling…

Quantum Physics · Physics 2020-11-06 Wei Pan , Jing Wang , Deyan Sun

The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over…

Optimization and Control · Mathematics 2012-09-19 Bart Vandereycken

In this paper, we propose an inexact proximal Newton-type method for nonconvex composite problems. We establish the global convergence rate of the order $\mathcal{O}(k^{-1/2})$ in terms of the minimal norm of the KKT residual mapping and…

Optimization and Control · Mathematics 2024-12-26 Hong Zhu

Many applications using large datasets require efficient methods for minimizing a proximable convex function subject to satisfying a set of linear constraints within a specified tolerance. For this task, we present a proximal projection…

Optimization and Control · Mathematics 2024-12-10 Howard Heaton

In this paper, we introduce a quasi-Newton method optimized for efficiently solving quasi-linear elliptic equations and systems, with a specific focus on GPU-based computation. By approximating the Jacobian matrix with a combination of…

Numerical Analysis · Mathematics 2025-03-25 Wenrui Hao , Sun Lee , Xiangxiong Zhang

Quadratic-support functions [Aravkin, Burke, and Pillonetto; J. Mach. Learn. Res. 14(1), 2013] constitute a parametric family of convex functions that includes a range of useful regularization terms found in applications of convex…

Optimization and Control · Mathematics 2018-08-23 Michael P. Friedlander , Gabriel Goh

Graph matching is a fundamental tool in computer vision and pattern recognition. In this paper, we introduce an algorithm for graph matching based on the proximal operator, referred to as differentiable proximal graph matching (DPGM).…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Haoru Tan , Chuang Wang , Xu-Yao Zhang , Cheng-Lin Liu

This paper explores the integration of symmetries into the Koopman-operator framework for the analysis and efficient learning of equivariant dynamical systems using a group-convolutional approach. Approximating the Koopman operator by…

Dynamical Systems · Mathematics 2025-05-27 Hans Harder , Feliks Nüske , Friedrich M. Philipp , Manuel Schaller , Karl Worthmann , Sebastian Peitz

We consider the following geometric optimization problem: Given $ n $ axis-aligned rectangles in the plane, the goal is to find a set of horizontal segments of minimum total length such that each rectangle is stabbed. A segment stabs a…

Computational Geometry · Computer Science 2021-07-15 Friedrich Eisenbrand , Martina Gallato , Ola Svensson , Moritz Venzin

We present an algorithm to compute the Jordan chain of a nearly defective matrix with a $2\times2$ Jordan block. The algorithm is based on an inverse-iteration procedure and only needs information about the invariant subspace corresponding…

Numerical Analysis · Mathematics 2017-04-25 Felipe Hernández , Adi Pick , Steven G. Johnson

In this paper, we consider distributed algorithms for solving the empirical risk minimization problem under the master/worker communication model. We develop a distributed asynchronous quasi-Newton algorithm that can achieve superlinear…

Optimization and Control · Mathematics 2019-06-11 Saeed Soori , Konstantin Mischenko , Aryan Mokhtari , Maryam Mehri Dehnavi , Mert Gurbuzbalaban

We develop and analyze a broad family of stochastic/randomized algorithms for inverting a matrix. We also develop specialized variants maintaining symmetry or positive definiteness of the iterates. All methods in the family converge…

Numerical Analysis · Mathematics 2016-03-24 Robert M. Gower , Peter Richtárik

We propose an algorithm that approximates a given matrix polynomial of degree $d$ by another skew-symmetric matrix polynomial of a specified rank and degree at most $d$. The algorithm is built on recent advances in the theory of generic…

Numerical Analysis · Mathematics 2026-01-26 Andrii Dmytryshyn , Froilán M. Dopico , Rakel Hellberg

We prove the convergence of the proximal point algorithm for finding the unique minimizer of a strongly quasiconvex function in general nonlinear Hadamard spaces, generalizing a recent result due to F. Lara. Our argument is rather…

Optimization and Control · Mathematics 2024-11-12 Nicholas Pischke