English
Related papers

Related papers: Scalable Algorithms for Tractable Schatten Quasi-N…

200 papers

For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation…

Optimization and Control · Mathematics 2015-06-23 Weimin Miao , Shaohua Pan , Defeng Sun

We develop a class of minimax estimators for a normal mean matrix under the Frobenius loss, which generalizes the James--Stein and Efron--Morris estimators. It shrinks the Schatten norm towards zero and works well for low-rank matrices. We…

Statistics Theory · Mathematics 2024-06-11 Xiao Li , Takeru Matsuda , Fumiyasu Komaki

Patch-based low-rank minimization for image processing attracts much attention in recent years. The minimization of the matrix rank coupled with the Frobenius norm data fidelity can be solved by the hard thresholding filter with principle…

Computer Vision and Pattern Recognition · Computer Science 2018-02-22 Haijuan Hu , Jacques Froment , Quansheng Liu

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

Matrix rank minimization problems are gaining a plenty of recent attention in both mathematical and engineering fields. This class of problems, arising in various and across-discipline applications, is known to be NP-hard in general. In…

Optimization and Control · Mathematics 2010-10-06 Yun-Bin Zhao

The Thompson metric provides key geometric insights in the study or non-linear matrix equations and in many optimization problems. However, knowing that an approximate solution is within d_T units of the actual solution in the Thompson…

Functional Analysis · Mathematics 2016-08-12 David A. Snyder

We consider the twin problems of estimating the effective rank and the Schatten norms $\|{\bf A}\|_{s}$ of a rectangular $p\times q$ matrix ${\bf A}$ from noisy observations. When $s$ is an even integer, we introduce a polynomial-time…

Statistics Theory · Mathematics 2021-11-29 Solène Thépaut , Nicolas Verzelen

A scalable Bayesian machine learning framework is introduced for estimating scalar properties of an unknown quantum state from measurement data, which bypasses full density matrix reconstruction. This work is the first to integrate the…

Quantum Physics · Physics 2025-12-08 Hyunho Cha , Wonjung Kim , Jungwoo Lee

Nuclear-norm regularization plays a vital role in many learning tasks, such as low-rank matrix recovery (MR), and low-rank representation (LRR). Solving this problem directly can be computationally expensive due to the unknown rank of…

Machine Learning · Computer Science 2015-03-19 Mingkui Tan , Shijie Xiao , Junbin Gao , Dong Xu , Anton Van Den Hengel , Qinfeng Shi

The decomposition or approximation of a linear operator on a matrix space as a sum of Kronecker products plays an important role in matrix equations and low-rank modeling. The approximation problem in Frobenius norm admits a well-known…

Optimization and Control · Mathematics 2023-12-08 Mareike Dressler , André Uschmajew , Venkat Chandrasekaran

We propose an efficient approach to semidefinite spectral clustering (SSC), which addresses the Frobenius normalization with the positive semidefinite (p.s.d.) constraint for spectral clustering. Compared with the original Frobenius norm…

Machine Learning · Computer Science 2014-02-25 Yan Yan , Chunhua Shen , Hanzi Wang

Quantum state tomography is a fundamental task in quantum information science, enabling detailed characterization of correlations, entanglement, and electronic structure in quantum systems. However, its exponential measurement and…

Minimax problems have gained tremendous attentions across the optimization and machine learning community recently. In this paper, we introduce a new quasi-Newton method for minimax problems, which we call $J$-symmetric quasi-Newton method.…

Optimization and Control · Mathematics 2023-01-20 Azam Asl , Haihao Lu , Jinwen Yang

We present a randomized algorithm for producing a quasi-optimal hierarchically semi-separable (HSS) approximation to an $N\times N$ matrix $A$ using only matrix-vector products with $A$ and $A^T$. We prove that, using $O(k \log(N/k))$…

Numerical Analysis · Mathematics 2025-09-09 Noah Amsel , Tyler Chen , Feyza Duman Keles , Diana Halikias , Cameron Musco , Christopher Musco , David Persson

In this paper, we utilize stochastic optimization to reduce the space complexity of convex composite optimization with a nuclear norm regularizer, where the variable is a matrix of size $m \times n$. By constructing a low-rank estimate of…

Machine Learning · Computer Science 2015-12-08 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

Singular values of a data in a matrix form provide insights on the structure of the data, the effective dimensionality, and the choice of hyper-parameters on higher-level data analysis tools. However, in many practical applications such as…

Machine Learning · Statistics 2017-03-21 Ashish Khetan , Sewoong Oh

By introducing the "comparison and replacement" (CNR) operation, we propose a general-purpose pure quantum approximate optimization algorithm and derive its core optimization mechanism quantitatively. The algorithm is constructed to a…

Quantum Physics · Physics 2024-01-29 Da You Lv , An Min Wang

Recently, low-rank tensor completion has become increasingly attractive in recovering incomplete visual data. Considering a color image or video as a three-dimensional (3D) tensor, existing studies have put forward several definitions of…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Shengke Xue , Wenyuan Qiu , Fan Liu , Xinyu Jin

The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Anders Rantzer , Pontus Giselsson

We develop a new method for obtaining bounds on the negative eigenvalues of self-adjoint operators B in terms of a Schatten norm of the difference of the semigroups generated by A and B, where A is an operator with non-negative spectrum.…

Spectral Theory · Mathematics 2008-09-17 M. Demuth , G. Katriel