中文
相关论文

相关论文: Unique Sharp Local Minimum in $\ell_1$-minimizatio…

200 篇论文

We consider the problem of learning overcomplete dictionaries in the context of sparse coding, where each sample selects a sparse subset of dictionary elements. Our main result is a strategy to approximately recover the unknown dictionary…

机器学习 · 统计学 2014-07-08 Alekh Agarwal , Animashree Anandkumar , Praneeth Netrapalli

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

机器学习 · 计算机科学 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

We investigate conditions for the unique recoverability of sparse integer-valued signals from a small number of linear measurements. Both the objective of minimizing the number of nonzero components, the so-called $\ell_0$-norm, as well as…

信息论 · 计算机科学 2019-09-18 Jan-Hendrik Lange , Marc E. Pfetsch , Bianca M. Seib , Andreas M. Tillmann

This article considers constrained $\ell_1$ minimization methods for the recovery of high dimensional sparse signals in three settings: noiseless, bounded error and Gaussian noise. A unified and elementary treatment is given in these noise…

机器学习 · 计算机科学 2008-05-05 T. Tony Cai , Guangwu Xu , Jun Zhang

We study the problem of reconstructing an unknown point in $\mathbb{R}^d$ from approximate linear queries. This setting arises naturally in applications ranging from low-dimensional remote sensing and signal recovery to high-dimensional…

机器学习 · 计算机科学 2026-05-20 Yuval Filmus , Shay Moran , Elizaveta Nesterova

This paper studies the effect of discretizing the parametrization of a dictionary used for Matching Pursuit decompositions of signals. Our approach relies on viewing the continuously parametrized dictionary as an embedded manifold in the…

微分几何 · 数学 2009-11-13 Laurent Jacques , Christophe De Vleeschouwer

In this paper, we propose a novel Deep Micro-Dictionary Learning and Coding Network (DDLCN). DDLCN has most of the standard deep learning layers (pooling, fully, connected, input/output, etc.) but the main difference is that the fundamental…

计算机视觉与模式识别 · 计算机科学 2018-12-27 Hao Tang , Heng Wei , Wei Xiao , Wei Wang , Dan Xu , Yan Yan , Nicu Sebe

Optimization-based problems have become of great interest for signal approximation purposes, as they achieved good accuracy results while being extremely flexible and versatile. In this work, we put our focus on the context of periodic…

最优化与控制 · 数学 2021-11-30 Adrian Jarret

Clustering is a pivotal challenge in unsupervised machine learning and is often investigated through the lens of mixture models. The optimal error rate for recovering cluster labels in Gaussian and sub-Gaussian mixture models involves ad…

The simplex algorithm for linear programming is based on the fact that any local optimum with respect to the polyhedral neighborhood is also a global optimum. We show that a similar result carries over to submodular maximization. In…

数据结构与算法 · 计算机科学 2017-12-01 Simon Bruggmann , Rico Zenklusen

Dictionary learning aims to find a dictionary that can sparsely represent the training data. Methods in the literature typically formulate the dictionary learning problem as an optimisation with respect to two variables, i.e., dictionary…

信号处理 · 电气工程与系统科学 2019-11-21 Cheng Cheng , Wei Dai

Symbolic regression, a task discovering the formula best fitting the given data, is typically based on the heuristical search. These methods usually update candidate formulas to obtain new ones with lower prediction errors iteratively.…

机器学习 · 计算机科学 2025-09-11 Zihan Yu , Jingtao Ding , Yong Li , Depeng Jin

Audio inpainting refers to signal processing techniques that aim at restoring missing or corrupted consecutive samples in audio signals. Prior works have shown that $\ell_1$- minimization with appropriate weighting is capable of solving…

声音 · 计算机科学 2022-02-16 Shristi Rajbamshi , Georg Tauböck , Peter Balazs , Nicki Holighaus

In a sparse representation based recognition scheme, it is critical to learn a desired dictionary, aiming both good representational power and discriminative performance. In this paper, we propose a new dictionary learning model for…

计算机视觉与模式识别 · 计算机科学 2016-11-29 Xinglin Piao , Yongli Hu , Yanfeng Sun , Junbin Gao , Baocai Yin

We propose K-Deep Simplex(KDS) which, given a set of data points, learns a dictionary comprising synthetic landmarks, along with representation coefficients supported on a simplex. KDS employs a local weighted $\ell_1$ penalty that…

机器学习 · 计算机科学 2024-08-01 Pranay Tankala , Abiy Tasissa , James M. Murphy , Demba Ba

We propose a novel joint lossy image and residual compression framework for learning $\ell_\infty$-constrained near-lossless image compression. Specifically, we obtain a lossy reconstruction of the raw image through lossy image compression…

图像与视频处理 · 电气工程与系统科学 2021-04-01 Yuanchao Bai , Xianming Liu , Wangmeng Zuo , Yaowei Wang , Xiangyang Ji

This paper is concerned with the numerical minimization of energy functionals in Hilbert spaces involving convex constraints coinciding with a semi-norm for a subspace. The optimization is realized by alternating minimizations of the…

数值分析 · 数学 2007-12-17 Massimo Fornasier , Carola-Bibiane Schönlieb

We study the robustness properties of $\ell_1$ norm minimization for the classical linear regression problem with a given design matrix and contamination restricted to the dependent variable. We perform a fine error analysis of the $\ell_1$…

最优化与控制 · 数学 2014-02-26 Salvador Flores , Luis M. Briceno-Arias

In this paper we look at a particular problem related to under-determined linear systems of equations with sparse solutions. $\ell_1$-minimization is a fairly successful polynomial technique that can in certain statistical scenarios find…

信息论 · 计算机科学 2015-07-17 Mihailo Stojnic

In this paper, we consider the efficient and robust reconstruction of signals and images via $\ell_{1}-\alpha \ell_{2}~(0<\alpha\leq 1)$ minimization in impulsive noise case. To achieve this goal, we introduce two new models: the…

最优化与控制 · 数学 2018-10-15 Peng Li , Huanmin Ge , Wengu Chen