English
Related papers

Related papers: Scalable Algorithms for Tractable Schatten Quasi-N…

200 papers

In this paper, we study the nearest stable matrix pair problem: given a square matrix pair $(E,A)$, minimize the Frobenius norm of $(\Delta_E,\Delta_A)$ such that $(E+\Delta_E,A+\Delta_A)$ is a stable matrix pair. We propose a reformulation…

Numerical Analysis · Mathematics 2018-12-19 Nicolas Gillis , Volker Mehrmann , Punit Sharma

Given an affine space of matrices $\mathcal{L}$ and a matrix $\Theta\in \mathcal{L}$, consider the problem of computing the closest rank deficient matrix to $\Theta$ on $\mathcal{L}$ with respect to the Frobenius norm. This is a nonconvex…

Optimization and Control · Mathematics 2020-10-12 Diego Cifuentes

In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…

Machine Learning · Computer Science 2018-12-03 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

We consider a variety of criteria for selecting k representative columns from a real mxn matrix A, when sufficiently few columns are required, i.e., 1<= k<= min{rank(A), m/3}. The criteria include the following optimization problems:…

Numerical Analysis · Mathematics 2026-04-13 Ilse C. F. Ipsen , Arvind K. Saibaba

This paper addresses the problem of identifying linear systems from noisy input-output trajectories. We introduce Thresholded Ho-Kalman, an algorithm that leverages a rank-adaptive procedure to estimate a Hankel-like matrix associated with…

Systems and Control · Electrical Eng. & Systems 2025-10-10 Frédéric Zheng , Yassir Jedra , Alexandre Proutière

In this work, we analyze the variance of a stochastic estimator for computing Schatten norms of matrices. The estimator extracts information from a single sketch of the matrix, that is, the product of the matrix with a few standard Gaussian…

Numerical Analysis · Mathematics 2025-01-17 Ya-Chi Chu , Alice Cortinovis

We present a scalable post-processing algorithm for debiasing trained models, including deep neural networks (DNNs), which we prove to be near-optimal by bounding its excess Bayes risk. We empirically validate its advantages on standard…

Machine Learning · Computer Science 2022-08-24 Ibrahim Alabdulmohsin , Mario Lucic

We propose a loop optimization algorithm based on nuclear norm regularization for tensor network. The key ingredient of this scheme is to introduce a rank penalty term proposed in the context of data processing. Compared to standard…

Statistical Mechanics · Physics 2024-11-07 Kenji Homma , Tsuyoshi Okubo , Naoki Kawashima

We study the problem of residual error estimation for matrix and vector norms using a linear sketch. Such estimates can be used, for example, to quickly assess how useful a more expensive low-rank approximation computation will be. The…

Data Structures and Algorithms · Computer Science 2024-08-19 Yi Li , Honghao Lin , David P. Woodruff

Shadow tomography is a framework for constructing succinct descriptions of quantum states using randomized measurement bases, called classical shadows, with powerful methods to bound the estimators used. We recast existing experimental…

We present two algorithms to initialize layers of tensorized neural networks and general tensor network algorithms using partial computations of their Frobenius norms and positive lineal entrywise sums, depending on the type of tensor…

Machine Learning · Computer Science 2026-05-04 Alejandro Mata Ali , Iñigo Perez Delgado , Marina Ristol Roura , Aitor Moreno Fdez. de Leceta

We prove new results about the robustness of well-known convex noise-blind optimization formulations for the reconstruction of low-rank matrices from underdetermined linear measurements. Our results are applicable for symmetric rank-one…

Information Theory · Computer Science 2020-10-26 Felix Krahmer , Christian Kümmerle , Oleh Melnyk

Color image denoising is frequently encountered in various image processing and computer vision tasks. One traditional strategy is to convert the RGB image to a less correlated color space and denoise each channel of the new space…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yiwen Shan , Dong Hu , Zhi Wang , Tao Jia

Multi-relational learning has received lots of attention from researchers in various research communities. Most existing methods either suffer from superlinear per-iteration cost, or are sensitive to the given ranks. To address both issues,…

Machine Learning · Computer Science 2016-01-19 Fanhua Shang , James Cheng , Hong Cheng

We present a sublinear time algorithm for computing a near optimal low-rank approximation to any positive semidefinite (PSD) Toeplitz matrix $T\in \mathbb{R}^{d\times d}$, given noisy access to its entries. In particular, given entrywise…

Data Structures and Algorithms · Computer Science 2024-04-23 Cameron Musco , Kshiteej Sheth

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

A semidefinite program (SDP) is a particular kind of convex optimization problem with applications in operations research, combinatorial optimization, quantum information science, and beyond. In this work, we propose variational quantum…

Quantum Physics · Physics 2024-06-19 Dhrumil Patel , Patrick J. Coles , Mark M. Wilde

The development of scalable quantum networks requires coherent interfaces capable of converting microwave photons used in superconducting quantum processors into optical photons suitable for long-distance fiber transmission. This review…

Quantum Physics · Physics 2026-05-27 Tarvir Anjum Aditto , Jaiyan Sadid Ifty , Khondokar Zahin

In this paper, we investigate the generalized low rank approximation to the symmetric positive semidefinite matrix in the Frobenius norm: $$\underset{ rank(X)\leq k}{\min} \sum^m_{i=1}\left \Vert A_i - B_i XB_i^T \right \Vert^2_F,$$ where…

Optimization and Control · Mathematics 2019-12-24 Haixia Chang , Chunmei Li , Qionghui Huang

The class of quasiseparable matrices is defined by the property that any submatrix entirely below or above the main diagonal has small rank, namely below a bound called the order of quasiseparability. These matrices arise naturally in…

Symbolic Computation · Computer Science 2019-10-22 Clement Pernet , Arne Storjohann