中文
相关论文

相关论文: Selecting Regularization Parameters for nuclear no…

200 篇论文

The low-rank matrix reconstruction (LRMR) approach is widely used in direction-of-arrival (DOA) estimation. As the rank norm penalty in an LRMR is NP-hard to compute, the nuclear norm (or the trace norm for a positive semidefinite (PSD)…

信息论 · 计算机科学 2017-12-07 Xiaohuan Wu , Wei-Ping Zhu , Jun Yan

We consider recovery of low-rank matrices from noisy data by shrinkage of singular values, in which a single, univariate nonlinearity is applied to each of the empirical singular values. We adopt an asymptotic framework, in which the matrix…

统计理论 · 数学 2016-05-17 Matan Gavish , David L. Donoho

We propose a loop optimization algorithm based on nuclear norm regularization for tensor network. The key ingredient of this scheme is to introduce a rank penalty term proposed in the context of data processing. Compared to standard…

统计力学 · 物理学 2024-11-07 Kenji Homma , Tsuyoshi Okubo , Naoki Kawashima

We propose two basic assumptions, under which the rate of convergence of the augmented Lagrange method for a class of composite optimization problems is estimated. We analyze the rate of local convergence of the augmented Lagrangian method…

最优化与控制 · 数学 2017-09-05 Liwei Zhang , Yule Zhang , Jia Wu

In large-scale, data-driven applications, parameters are often only known approximately due to noise and limited data samples. In this paper, we focus on high-dimensional optimization problems with linear constraints under uncertain…

最优化与控制 · 数学 2024-03-01 Naqi Huang , Nestor Parolya , Theresia van Essen

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

统计方法学 · 统计学 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

In this paper, we theoretically investigate the low-rank matrix recovery problem in the context of the unconstrained regularized nuclear norm minimization (RNNM) framework. Our theoretical findings show that, the RNNM method is able to…

数值分析 · 数学 2021-03-09 Wendong Wang , Feng Zhang , Jianjun Wang

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

机器学习 · 计算机科学 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Matrix rank minimization problems are gaining a plenty of recent attention in both mathematical and engineering fields. This class of problems, arising in various and across-discipline applications, is known to be NP-hard in general. In…

最优化与控制 · 数学 2010-10-06 Yun-Bin Zhao

Many applications require recovering a matrix of minimal rank within an affine constraint set, with matrix completion a notable special case. Because the problem is NP-hard in general, it is common to replace the matrix rank with the…

机器学习 · 计算机科学 2015-07-08 Bo Xin , David Wipf

We consider in this paper the problem of noisy 1-bit matrix completion under a general non-uniform sampling distribution using the max-norm as a convex relaxation for the rank. A max-norm constrained maximum likelihood estimate is…

机器学习 · 统计学 2013-09-25 T. Tony Cai , Wen-Xin Zhou

Over the past few years, trace regression models have received considerable attention in the context of matrix completion, quantum state tomography, and compressed sensing. Estimation of the underlying matrix from regularization-based…

机器学习 · 统计学 2015-04-24 Martin Slawski , Ping Li , Matthias Hein

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

数值分析 · 计算机科学 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

Rank minimization has attracted a lot of attention due to its robustness in data recovery. To overcome the computational difficulty, rank is often replaced with nuclear norm. For several rank minimization problems, such a replacement has…

机器学习 · 统计学 2013-07-02 Hongyang Zhang , Zhouchen Lin , Chao Zhang

This article introduces new multiplicative updates for nonnegative matrix factorization with the $\beta$-divergence and sparse regularization of one of the two factors (say, the activation matrix). It is well known that the norm of the…

机器学习 · 计算机科学 2024-03-13 Arthur Marmin , José Henrique de Morais Goulart , Cédric Févotte

Regularization and interior point approaches offer valuable perspectives to address constrained nonlinear optimization problems in view of control applications. This paper discusses the interactions between these techniques and proposes an…

最优化与控制 · 数学 2022-10-31 Alberto De Marchi

Low-rank matrix approximation, which aims to construct a low-rank matrix from an observation, has received much attention recently. An efficient method to solve this problem is to convert the problem of rank minimization into a nuclear norm…

信息论 · 计算机科学 2016-09-21 Seyedroohollah Hosseini

In the undetermined linear system $\bm{b}=\mathcal{A}(\bm{X})+\bm{s}$, vector $\bm{b}$ and operator $\mathcal{A}$ are the known measurements and $\bm{s}$ is the unknown noise. In this paper, we investigate sufficient conditions for exactly…

最优化与控制 · 数学 2023-08-08 Yan Li , Liping Zhang

Subspace identification is a classical and very well studied problem in system identification. The problem was recently posed as a convex optimization problem via the nuclear norm relaxation. Inspired by robust PCA, we extend this framework…

系统与控制 · 计算机科学 2013-12-10 Dorsa Sadigh , Henrik Ohlsson , S. Shankar Sastry , Sanjit A. Seshia

Estimating the values of unknown parameters from corrupted measured data faces a lot of challenges in ill-posed problems. In such problems, many fundamental estimation methods fail to provide a meaningful stabilized solution. In this work,…

信息论 · 计算机科学 2017-01-11 Mohamed Suliman , Tarig Ballal , Tareq Y. Al-Naffouri