中文
相关论文

相关论文: Minimizing L1 over L2 norms on the gradient

200 篇论文

This paper investigates total variation minimization in one spatial dimension for the recovery of gradient-sparse signals from undersampled Gaussian measurements. Recently established bounds for the required sampling rate state that uniform…

信息论 · 计算机科学 2022-04-12 Martin Genzel , Maximilian März , Robert Seidel

The 1-norm was proven to be a good convex regularizer for the recovery of sparse vectors from under-determined linear measurements. It has been shown that with an appropriate measurement operator, a number of measurements of the order of…

信息论 · 计算机科学 2018-12-05 Yann Traonmilin , Samuel Vaiter

So-called sparse estimators arise in the context of model fitting, when one a priori assumes that only a few (unknown) model parameters deviate from zero. Sparsity constraints can be useful when the estimation problem is under-determined,…

机器学习 · 统计学 2017-03-22 Jean Daunizeau

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with…

机器学习 · 计算机科学 2016-11-17 Paolo Di Lorenzo , Sergio Barbarossa , Paolo Banelli , Stefania Sardellitti

In this paper, we consider a class of structured nonsmooth fractional minimization, where the first part of the objective is the ratio of a nonnegative nonsmooth nonconvex function to a nonnegative nonsmooth convex function, while the…

最优化与控制 · 数学 2025-12-25 Junpeng Zhou , Na Zhang , Qia Li

Overparametrized neural networks trained by gradient descent (GD) can provably overfit any training data. However, the generalization guarantee may not hold for noisy data. From a nonparametric perspective, this paper studies how well…

机器学习 · 统计学 2021-09-28 Tianyang Hu , Wenjia Wang , Cong Lin , Guang Cheng

Sparse learning has recently received increasing attention in many areas including machine learning, statistics, and applied mathematics. The mixed-norm regularization based on the L1/Lq norm with q > 1 is attractive in many applications of…

机器学习 · 计算机科学 2010-09-27 Jun Liu , Jieping Ye

Image acquisition in many biomedical imaging modalities is corrupted by Poisson noise followed by additive Gaussian noise. While total variation and related regularization methods for solving biomedical inverse problems are known to yield…

图像与视频处理 · 电气工程与系统科学 2019-03-11 Manu Ghulyani , Muthuvel Arigovindan

In this work we investigate the practicality of stochastic gradient descent and recently introduced variants with variance-reduction techniques in imaging inverse problems. Such algorithms have been shown in the machine learning literature…

最优化与控制 · 数学 2021-01-26 Junqi Tang , Karen Egiazarian , Mohammad Golbabaee , Mike Davies

Because of the limitations of the infrared imaging principle and the properties of infrared imaging systems, infrared images have some drawbacks, including a lack of details, indistinct edges, and a large amount of salt-andpepper noise. To…

计算机视觉与模式识别 · 计算机科学 2019-10-02 Xingguo Liu , Yinping Chen , Zhenming Peng , Juan Wu

Existing gradient coding schemes introduce identical redundancy across the coordinates of gradients and hence cannot fully utilize the computation results from partial stragglers. This motivates the introduction of diverse redundancies…

分布式、并行与集群计算 · 计算机科学 2021-09-21 Qi Wang , Ying Cui , Chenglin Li , Junni Zou , Hongkai Xiong

The \(L_1/L_2\) norm ratio has gained significant attention as a measure of sparsity due to three merits: sharper approximation to the \(L_0\) norm compared to the \(L_1\) norm, being parameter-free and scale-invariant, and exceptional…

最优化与控制 · 数学 2024-11-14 Min Tao , Xiao-Ping Zhang , Yun-Bin Zhao

We propose an inference method to estimate sparse interactions and biases according to Boltzmann machine learning. The basis of this method is $L_1$ regularization, which is often used in compressed sensing, a technique for reconstructing…

机器学习 · 统计学 2015-06-24 Masayuki Ohzeki

We analyze an Iteratively Re-weighted Least Squares (IRLS) algorithm for promoting l1-minimization in sparse and compressible vector recovery. We prove its convergence and we estimate its local rate. We show how the algorithm can be…

数值分析 · 数学 2008-07-04 Ingrid Daubechies , Ronald DeVore , Massimo Fornasier , C. Sinan Gunturk

With the success of deep neural networks (NNs) in a variety of domains, the computational and storage requirements for training and deploying large NNs have become a bottleneck for further improvements. Sparsification has consequently…

机器学习 · 计算机科学 2024-04-24 Nadav Joseph Outmezguine , Noam Levi

In this paper, we consider the sparse least squares regression problem with probabilistic simplex constraint. Due to the probabilistic simplex constraint, one could not apply the L1 regularization to the considered regression model. To find…

最优化与控制 · 数学 2021-12-28 Guiyun Xiao , Zheng-Jian Bai

There are different problems for resolution of complex LC-MS or GC-MS data, such as the existence of embedded chromatographic peaks, continuum background and overlapping in mass channels for different components. These problems cause…

机器学习 · 计算机科学 2019-05-22 Ahmad Mani-Varnosfaderani , Mohammad Javad Masroor

Magnetic Resonance Imaging (MRI) is a kind of medical imaging technology used for diagnostic imaging of diseases, but its image quality may be suffered by the long acquisition time. The compressive sensing (CS) based strategy may decrease…

最优化与控制 · 数学 2021-11-25 Yanyun Ding , Peili Li , Yunhai Xiao , Haibin Zhang

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical…

机器学习 · 统计学 2013-12-06 Dmitry Malioutov , Aleksandr Aravkin

Patch-based low rank is an important prior assumption for image processing. Moreover, according to our calculation, the optimization of l0 norm corresponds to the maximum likelihood estimation under random-valued impulse noise. In this…

计算机视觉与模式识别 · 计算机科学 2022-09-13 Haijuan Hu