中文
相关论文

相关论文: Robust Low-Rank Matrix Completion via a New Sparsi…

200 篇论文

In this paper, we introduce a novel and robust approach to Quantized Matrix Completion (QMC). First, we propose a rank minimization problem with constraints induced by quantization bounds. Next, we form an unconstrained optimization problem…

机器学习 · 统计学 2019-02-20 Ashkan Esmaeili , Farokh Marvasti

This work addresses the robust reconstruction problem of a sparse signal from compressed measurements. We propose a robust formulation for sparse reconstruction which employs the $\ell_1$-norm as the loss function for the residual error and…

信息论 · 计算机科学 2017-03-30 Fei Wen , Yuan Yang , Ling Pei , Wenxian Yu , Peilin Liu

This paper proposes a proximal variant of the alternating direction method of multipliers (ADMM) for distributed optimization. Although the current versions of ADMM algorithm provide promising numerical results in producing solutions that…

最优化与控制 · 数学 2023-09-01 Reza Mirzaeifard , Naveen K. D. Venkategowda , Alexander Jung , Stefan Werner

Convex regularizers are often used for sparse learning. They are easy to optimize, but can lead to inferior prediction performance. The difference of $\ell_1$ and $\ell_2$ ($\ell_{1-2}$) regularizer has been recently proposed as a nonconvex…

机器学习 · 计算机科学 2017-06-21 Quanming Yao , James T. Kwok , Xiawei Guo

Recently, the $\l_{p}$-norm regularization minimization problem $(P_{p}^{\lambda})$ has attracted great attention in compressed sensing. However, the $\l_{p}$-norm $\|x\|_{p}^{p}$ in problem $(P_{p}^{\lambda})$ is nonconvex and…

最优化与控制 · 数学 2018-04-26 Angang Cui , Jigen Peng , Haiyang Li , Meng Wen , Jiajun Xiong

This paper studies the convergence of the mirror descent algorithm for finite horizon stochastic control problems with measure-valued control processes. The control objective involves a convex regularisation function, denoted as $h$, with…

最优化与控制 · 数学 2025-08-22 Bekzhan Kerimkulov , David Šiška , Łukasz Szpruch , Yufei Zhang

Composite minimization is a powerful framework in large-scale convex optimization, based on decoupling of the objective function into terms with structurally different properties and allowing for more flexible algorithmic design. We…

最优化与控制 · 数学 2023-02-17 Jelena Diakonikolas , Cristóbal Guzmán

This paper focuses on recovering an underlying matrix from its noisy partial entries, a problem commonly known as matrix completion. We delve into the investigation of a non-convex regularization, referred to as transformed $L_1$ (TL1),…

统计理论 · 数学 2025-03-05 Kun Zhao , Jiayi Wang , Yifei Lou

The use of convex regularizers allows for easy optimization, though they often produce biased estimation and inferior prediction performance. Recently, nonconvex regularizers have attracted a lot of attention and outperformed convex ones.…

最优化与控制 · 数学 2017-02-14 Quanming Yao , James. T Kwok

We tackle the inverse problem of reconstructing an unknown finite measure $\mu$ from a noisy observation of a generalized moment of $\mu$ defined as the integral of a continuous and bounded operator $\Phi$ with respect to $\mu$. When only a…

统计理论 · 数学 2009-06-03 Jean-Michel Loubes , Paul Rochet

Owing to their statistical properties, non-convex sparse regularizers have attracted much interest for estimating a sparse linear model from high dimensional data. Given that the solution is sparse, for accelerating convergence, a working…

机器学习 · 计算机科学 2021-10-22 Alain Rakotomamonjy , Rémi Flamary , Gilles Gasso , Joseph Salmon

Matrix-valued optimization tasks, including those involving symmetric positive definite (SPD) matrices, arise in a wide range of applications in machine learning, data science and statistics. Classically, such problems are solved via…

最优化与控制 · 数学 2024-10-15 Andrew Cheng , Melanie Weber

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

机器学习 · 统计学 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

Tensor-based methods have recently emerged as a more natural and effective formulation to address many problems in hyperspectral imaging. In hyperspectral unmixing (HU), low-rank constraints on the abundance maps have been shown to act as a…

计算机视觉与模式识别 · 计算机科学 2018-11-14 Tales Imbiriba , Ricardo Augusto Borsoi , José Carlos Moreira Bermudez

We propose a new algorithmic framework for constrained compressed sensing models that admit nonconvex sparsity-inducing regularizers including the log-penalty function as objectives, and nonconvex loss functions such as the Cauchy loss…

最优化与控制 · 数学 2022-06-17 Shuqin Sun , Ting Kei Pong

Variable selection is a fundamental task in statistical data analysis. Sparsity-inducing regularization methods are a popular class of methods that simultaneously perform variable selection and model estimation. The central problem is a…

机器学习 · 计算机科学 2016-03-16 Hongbo Dong , Kun Chen , Jeff Linderoth

The explicit low-rank regularization, e.g., nuclear norm regularization, has been widely used in imaging sciences. However, it has been found that implicit regularization outperforms explicit ones in various image processing tasks. Another…

计算机视觉与模式识别 · 计算机科学 2023-03-30 Zhemin Li , Tao Sun , Hongxia Wang , Bao Wang

Convex $\ell_1$ regularization using an infinite dictionary of neurons has been suggested for constructing neural networks with desired approximation guarantees, but can be affected by an arbitrary amount of over-parametrization. This can…

最优化与控制 · 数学 2022-06-01 Konstantin Pieper , Armenak Petrosyan

Building on a recent framework for distributionally robust optimization, we consider estimation of the inverse covariance matrix for multivariate data. We provide a novel notion of a Wasserstein ambiguity set specifically tailored to this…

机器学习 · 统计学 2019-10-08 Pedro Cisneros-Velarde , Sang-Yun Oh , Alexander Petersen

We propose a regularized Hessian-free Newton-type method for minimizing smooth convex functions with Lipschitz continuous Hessians. The algorithm constructs an approximate Hessian by finite differences and selects the regularization…