中文
相关论文

相关论文: Analyzing the Weighted Nuclear Norm Minimization a…

200 篇论文

We propose a loop optimization algorithm based on nuclear norm regularization for tensor network. The key ingredient of this scheme is to introduce a rank penalty term proposed in the context of data processing. Compared to standard…

统计力学 · 物理学 2024-11-07 Kenji Homma , Tsuyoshi Okubo , Naoki Kawashima

Numerous applications in data mining and machine learning require recovering a matrix of minimal rank. Robust principal component analysis (RPCA) is a general framework for handling this kind of problems. Nuclear norm based convex surrogate…

计算机视觉与模式识别 · 计算机科学 2016-11-17 Zhao Kang , Chong Peng , Qiang Cheng

Nuclear-norm regularization plays a vital role in many learning tasks, such as low-rank matrix recovery (MR), and low-rank representation (LRR). Solving this problem directly can be computationally expensive due to the unknown rank of…

机器学习 · 计算机科学 2015-03-19 Mingkui Tan , Shijie Xiao , Junbin Gao , Dong Xu , Anton Van Den Hengel , Qinfeng Shi

One of the classical approaches for estimating the frequencies and damping factors in a spectrally sparse signal is the MUSIC algorithm, which exploits the low-rank structure of an autocorrelation matrix. Low-rank matrices have also…

信息论 · 计算机科学 2020-08-20 Shuang Li , Hassan Mansour , Michael B. Wakin

An incoherent low-rank matrix can be efficiently reconstructed after observing a few of its entries at random, and then solving a convex program that minimizes the nuclear norm. In many applications, in addition to these entries,…

信息论 · 计算机科学 2018-03-14 Armin Eftekhari , Dehui Yang , Michael B. Wakin

In a deep neural network (DNN), the number of the parameters is usually huge to get high learning performances. For that reason, it costs a lot of memory and substantial computational resources, and also causes overfitting. It is known that…

计算机视觉与模式识别 · 计算机科学 2020-04-10 Kakeru Mitsuno , Junichi Miyao , Takio Kurita

Nonnegative matrix factorization (NMF) has been widely used to learn low-dimensional representations of data. However, NMF pays the same attention to all attributes of a data point, which inevitably leads to inaccurate representation. For…

机器学习 · 计算机科学 2021-11-30 Jiao Wei , Can Tong , Bingxue Wu , Qiang He , Shouliang Qi , Yudong Yao , Yueyang Teng

In this paper we address the problem of recovering a matrix, with inherent low rank structure, from its lower dimensional projections. This problem is frequently encountered in wide range of areas including pattern recognition, wireless…

数值分析 · 计算机科学 2013-12-25 Anupriya Gogna , Ankita Shukla , Angshul Majumdar

The mathematical theory of super-resolution developed recently by Cand\`{e}s and Fernandes-Granda states that a continuous, sparse frequency spectrum can be recovered with infinite precision via a (convex) atomic norm technique given a set…

信息论 · 计算机科学 2015-10-19 Zai Yang , Lihua Xie

This paper describes a new algorithm for computing Nonnegative Low Rank Matrix (NLRM) approximation for nonnegative matrices. Our approach is completely different from classical nonnegative matrix factorization (NMF) which has been studied…

最优化与控制 · 数学 2020-06-18 Guang-Jing Song , Michael Kwok-Po Ng

Currently, machine learning plays an important role in the lives and individual activities of numerous people. Accordingly, it has become necessary to design machine learning algorithms to ensure that discrimination, biased views, or unfair…

机器学习 · 统计学 2015-11-09 Kazuto Fukuchi , Jun Sakuma

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

机器学习 · 计算机科学 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

In image denoising (IDN) processing, the low-rank property is usually considered as an important image prior. As a convex relaxation approximation of low rank, nuclear norm based algorithms and their variants have attracted significant…

图像与视频处理 · 电气工程与系统科学 2020-04-03 Yanwei Zhao , Ping Yang , Qiu Guan , Jianwei Zheng , Wanliang Wang

Minimizing the nuclear norm of a matrix has been shown to be very efficient in reconstructing a low-rank sampled matrix. Furthermore, minimizing the sum of nuclear norms of matricizations of a tensor has been shown to be very efficient in…

机器学习 · 统计学 2017-07-26 Morteza Ashraphijuo , Xiaodong Wang

Atomic norm minimization (ANM) is a key approach for line spectral estimation (LSE). Most related algorithms formulate ANM as a semidefinite programming (SDP), which incurs high computational cost. In this letter, we revisit the ANM problem…

最优化与控制 · 数学 2024-11-14 Xiaozhi Liu , Jinjiang Wei , Yong Xia

This paper is devoted to proposing a general weighted low-rank recovery model and designing a fast SVD-free computational scheme to solve it. First, our generic weighted low-rank recovery model unifies several existing approaches in the…

最优化与控制 · 数学 2022-08-02 Aritra Dutta , Jingwei Liang , Xin Li

To address the large model size and intensive computation requirement of deep neural networks (DNNs), weight pruning techniques have been proposed and generally fall into two categories, i.e., static regularization-based pruning and dynamic…

Nonnegative Matrix Factorization consists in (approximately) factorizing a nonnegative data matrix by the product of two low-rank nonnegative matrices. It has been successfully applied as a data analysis technique in numerous domains, e.g.,…

最优化与控制 · 数学 2012-08-13 Nicolas Gillis , François Glineur

We present a novel family of language model (LM) estimation techniques named Sparse Non-negative Matrix (SNM) estimation. A first set of experiments empirically evaluating it on the One Billion Word Benchmark shows that SNM $n$-gram LMs…

机器学习 · 计算机科学 2015-06-30 Noam Shazeer , Joris Pelemans , Ciprian Chelba

The low-rank matrix reconstruction (LRMR) approach is widely used in direction-of-arrival (DOA) estimation. As the rank norm penalty in an LRMR is NP-hard to compute, the nuclear norm (or the trace norm for a positive semidefinite (PSD)…

信息论 · 计算机科学 2017-12-07 Xiaohuan Wu , Wei-Ping Zhu , Jun Yan