English
Related papers

Related papers: CPGD: Cadzow Plug-and-Play Gradient Descent for Ge…

200 papers

Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper,…

Image and Video Processing · Electrical Eng. & Systems 2023-10-20 Martin Zach , Florian Knoll , Thomas Pock

In this study, we address the gradient-based domain generalization problem, where predictors aim for consistent gradient directions across different domains. Existing methods have two main challenges. First, minimization of gradient…

Machine Learning · Computer Science 2025-07-22 Khoi Do , Duong Nguyen , Nam-Khanh Le , Quoc-Viet Pham , Binh-Son Hua , Won-Joo Hwang

Optimization algorithms are pivotal in advancing various scientific and industrial fields but often encounter obstacles such as trapping in local minima, saddle points, and plateaus (flat regions), which makes the convergence to reasonable…

Optimization and Control · Mathematics 2026-01-15 Amir M. Vahedi , Horea T. Ilies

We study the D-optimal Data Fusion (DDF) problem, which aims to select new data points, given an existing Fisher information matrix, so as to maximize the logarithm of the determinant of the overall Fisher information matrix. We show that…

Optimization and Control · Mathematics 2022-08-09 Yongchun Li , Marcia Fampa , Jon Lee , Feng Qiu , Weijun Xie , Rui Yao

A high-dimensional and incomplete (HDI) matrix can describe the complex interactions among numerous nodes in various big data-related applications. A stochastic gradient descent (SGD)-based latent factor analysis (LFA) model is remarkably…

Systems and Control · Electrical Eng. & Systems 2023-03-08 Li Jinli , Yuan Ye

Deep-unrolling and plug-and-play (PnP) approaches have become the de-facto standard solvers for single-pixel imaging (SPI) inverse problem. PnP approaches, a class of iterative algorithms where regularization is implicitly performed by an…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Ping Wang , Lishun Wang , Gang Qu , Xiaodong Wang , Yulun Zhang , Xin Yuan

Numerous total variation (TV) regularizers, engaged in image restoration problem, encode the gradients by means of simple $[-1,1]$ FIR filter. Despite its low computational processing, this filter severely deviates signal's high frequency…

Optimization and Control · Mathematics 2015-06-17 Mahdi S. Hosseini , Konstantinos N. Plataniotis

We propose a flexible convex relaxation for the phase retrieval problem that operates in the natural domain of the signal. Therefore, we avoid the prohibitive computational cost associated with "lifting" and semidefinite programming (SDP)…

Information Theory · Computer Science 2017-03-17 Sohail Bahmani , Justin Romberg

Deep learning-based image compression (LIC) has achieved state-of-the-art rate-distortion (RD) performance, yet deploying these models on resource-constrained FPGAs remains a major challenge. This work presents a complete, multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiaxun Fang , Li Chen

The focus of this work is the numerical approximation of time-dependent partial differential equations associated to initial-boundary value problems. This master dissertation is mostly concerned with the actual computation of the solution…

Numerical Analysis · Mathematics 2024-12-20 Ciro Diaz

In the context of sparse recovery, it is known that most of existing regularizers such as $\ell_1$ suffer from some bias incurred by some leading entries (in magnitude) of the associated vector. To neutralize this bias, we propose a class…

Optimization and Control · Mathematics 2015-11-24 Zhaosong Lu , Xiaorui Li

Line-search methods are commonly used to solve optimization problems. The simplest line search method is steepest descent where one always moves in the direction of the negative gradient. Newton's method on the other hand is a second-order…

Optimization and Control · Mathematics 2025-08-15 Shikhar Saxena , Tejas Bodas , Arti Yardi

We present new policy mirror descent (PMD) methods for solving reinforcement learning (RL) problems with either strongly convex or general convex regularizers. By exploring the structural properties of these overall highly nonconvex…

Machine Learning · Computer Science 2022-04-08 Guanghui Lan

Goal: This work aims at developing a novel calibration-free fast parallel MRI (pMRI) reconstruction method incorporate with discrete-time optimal control framework. The reconstruction model is designed to learn a regularization that…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Wanyu Bian , Yunmei Chen , Xiaojing Ye

Post-stack seismic inversion is a widely used technique to retrieve high-resolution acoustic impedance models from migrated seismic data. Its modelling operator assumes that a migrated seismic data can be generated from the convolution of a…

Geophysics · Physics 2024-01-02 Nick Luiken , Juan Romero , Miguel Corrales , Matteo Ravasi

We study to what extent may stochastic gradient descent (SGD) be understood as a "conventional" learning rule that achieves generalization performance by obtaining a good fit to training data. We consider the fundamental stochastic convex…

Machine Learning · Computer Science 2023-01-13 Tomer Koren , Roi Livni , Yishay Mansour , Uri Sherman

Deep learning has achieved tremendous success by training increasingly large models, which are then compressed for practical deployment. We propose a drastically different approach to compact and optimal deep learning: We decouple the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Jiayun Wang , Yubei Chen , Stella X. Yu , Brian Cheung , Yann LeCun

We propose Dual-Feedback Generalized Proximal Gradient Descent (DFGPGD) as a new, hardware-friendly, operator splitting algorithm. We then establish convergence guarantees under approximate computational errors and we derive theoretical…

Optimization and Control · Mathematics 2023-06-30 Anis Hamadouche , Yun Wu , Andrew M. Wallace , Joao F. C. Mota

To improve the stability of GAN training we need to understand why they can produce realistic samples. Presently, this is attributed to properties of the divergence obtained under an optimal discriminator. This argument has a fundamental…

Machine Learning · Computer Science 2020-11-03 Florian Schäfer , Hongkai Zheng , Anima Anandkumar

Low-rank regularization (LRR) has been widely applied in various machine learning tasks, but the associated optimization is challenging. Directly optimizing the rank function under constraints is NP-hard in general. To overcome this…

Machine Learning · Computer Science 2025-05-22 Naiqi Li , Yuqiu Xie , Peiyuan Liu , Tao Dai , Yong Jiang , Shu-Tao Xia