中文
相关论文

相关论文: CPGD: Cadzow Plug-and-Play Gradient Descent for Ge…

200 篇论文

This work explores generalizations of the Polyak-Lojasiewicz inequality (PLI) and their implications for the convergence behavior of gradient flows in optimization problems. Motivated by the continuous-time linear quadratic regulator…

最优化与控制 · 数学 2025-04-01 Arthur Castello B. de Oliveira , Leilei Cui , Eduardo D. Sontag

This paper proposes a new framework to regularize the highly ill-posed and non-linear phase retrieval problem through deep generative priors using simple gradient descent algorithm. We experimentally show effectiveness of proposed algorithm…

机器学习 · 计算机科学 2018-08-20 Fahad Shamshad , Ali Ahmed

Stochastic Gradient Decent (SGD) is one of the core techniques behind the success of deep neural networks. The gradient provides information on the direction in which a function has the steepest rate of change. The main problem with basic…

Finite-rate-of-innovation (FRI) signals are ubiquitous in applications such as radar, ultrasound, and time of flight imaging. Due to their finite degrees of freedom, FRI signals can be sampled at sub-Nyquist rates using appropriate sampling…

信号处理 · 电气工程与系统科学 2021-07-02 Satish Mulleti , Haiyang Zhang , Yonina C. Eldar

This paper is concerned with $\ell_q\,(0<q<1)$-norm regularized minimization problems with a twice continuously differentiable loss function. For this class of nonconvex and nonsmooth composite problems, many algorithms have been proposed…

最优化与控制 · 数学 2023-06-27 Yuqia Wu , Shaohua Pan , Xiaoqi Yang

Gradient regularization, as described in \citet{barrett2021implicit}, is a highly effective technique for promoting flat minima during gradient descent. Empirical evidence suggests that this regularization technique can significantly…

机器学习 · 统计学 2023-04-03 Xuran Meng , Yuan Cao , Difan Zou

Inverse problems for accelerated MRI typically incorporate domain-specific knowledge about the forward encoding operator in a regularized reconstruction framework. Recently physics-driven deep learning (DL) methods have been proposed to use…

图像与视频处理 · 电气工程与系统科学 2020-07-09 Seyed Amir Hossein Hosseini , Burhaneddin Yaman , Steen Moeller , Mingyi Hong , Mehmet Akçakaya

We study the minimization of a convex function $f(X)$ over the set of $n\times n$ positive semi-definite matrices, but when the problem is recast as $\min_U g(U) := f(UU^\top)$, with $U \in \mathbb{R}^{n \times r}$ and $r \leq n$. We study…

机器学习 · 统计学 2016-04-19 Srinadh Bhojanapalli , Anastasios Kyrillidis , Sujay Sanghavi

Rectified Flow (RF) models achieve state-of-the-art generation quality, yet controlling them for precise tasks -- such as semantic editing or blind image recovery -- remains a challenge. Current approaches bifurcate into inversion-based…

机器学习 · 计算机科学 2026-03-09 Vansh Bansal , James G Scott

Optimization problems with rank constraints arise in many applications, including matrix regression, structured PCA, matrix completion and matrix decomposition problems. An attractive heuristic for solving such problems is to factorize the…

统计理论 · 数学 2015-09-11 Yudong Chen , Martin J. Wainwright

We propose SING (StabIlized and Normalized Gradient), a plug-and-play technique that improves the stability and generalization of the Adam(W) optimizer. SING is straightforward to implement and has minimal computational overhead, requiring…

机器学习 · 计算机科学 2023-05-26 Adrien Courtois , Damien Scieur , Jean-Michel Morel , Pablo Arias , Thomas Eboli

In recent literature, a general two step procedure has been formulated for solving the problem of phase retrieval. First, a spectral technique is used to obtain a constant-error initial estimate, following which, the estimate is refined to…

机器学习 · 统计学 2023-07-10 Yan Shuo Tan , Roman Vershynin

Poisson-Gaussian noise describes the noise of various imaging systems thus the need of efficient algorithms for Poisson-Gaussian image restoration. Deep learning methods offer state-of-the-art performance but often require sensor-specific…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Maud Biquard , Marie Chabert , Florence Genin , Christophe Latry , Thomas Oberlin

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

最优化与控制 · 数学 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

机器学习 · 计算机科学 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

In this paper, we introduce convolutional proximal neural networks (cPNNs), which are by construction averaged operators. For filters of full length, we propose a stochastic gradient descent algorithm on a submanifold of the Stiefel…

最优化与控制 · 数学 2024-08-13 Johannes Hertrich , Sebastian Neumayer , Gabriele Steidl

Model-based reconstruction plays a key role in compressed sensing (CS) MRI, as it incorporates effective image regularizers to improve the quality of reconstruction. The Plug-and-Play and Regularization-by-Denoising frameworks leverage…

图像与视频处理 · 电气工程与系统科学 2026-01-13 Tao Hong , Umberto Villa , Jeffrey A. Fessler

We consider the problem of matrix completion with graphs as side information depicting the interrelations between variables. The key challenge lies in leveraging the similarity structure of the graph to enhance matrix recovery. Existing…

机器学习 · 计算机科学 2025-02-13 Yao Wang , Yiyang Yang , Kaidong Wang , Shanxing Gao , Xiuwu Liao

Fuzzy relational inequalities with fuzzy constraints (FRI-FC) are the generalized form of fuzzy relational inequalities (FRI) in which fuzzy inequality replaces ordinary inequality in the constraints. Fuzzy constraints enable us to attain…

最优化与控制 · 数学 2023-09-12 Amin Ghodousian , Romina Omidi

This work studies a composite minimization problem involving a differentiable function q and a nonsmooth function h, both of which may be nonconvex. This problem is ubiquitous in signal processing and machine learning yet remains…

信号处理 · 电气工程与系统科学 2025-09-22 Yiming Zhou , Wei Dai