English
Related papers

Related papers: Stochastic Primal-Dual Deep Unrolling

200 papers

Deep unfolded neural networks are designed by unrolling the iterations of optimization algorithms. They can be shown to achieve faster convergence and higher accuracy than their optimization counterparts. This paper proposes a new…

Machine Learning · Computer Science 2020-10-05 Huynh Van Luong , Boris Joukovsky , Yonina C. Eldar , Nikos Deligiannis

There is a recent interest on first-order methods for linear programming (LP). In this paper,we propose a stochastic algorithm using variance reduction and restarts for solving sharp primal-dual problems such as LP. We show that the…

Optimization and Control · Mathematics 2024-01-02 Haihao Lu , Jinwen Yang

Deep algorithm unrolling has emerged as a powerful model-based approach to develop deep architectures that combine the interpretability of iterative algorithms with the performance gains of supervised deep learning, especially in cases of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Yair Ben Sahel , John P. Bryan , Brian Cleary , Samouil L. Farhi , Yonina C. Eldar

Deep unfolding networks (DUNs), combining conventional iterative optimization algorithms and deep neural networks into a multi-stage framework, have achieved remarkable accomplishments in Image Restoration (IR), such as spectral imaging…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xiangming Wang , Haijin Zeng , Benteng Sun , Jiezhang Cao , Kai Zhang , Qiangqiang Shen , Yongyong Chen

The use of fluorescent molecules to create long sequences of low-density, diffraction-limited images enables highly-precise molecule localization. However, this methodology requires lengthy imaging times, which limits the ability to view…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Yair Ben Sahel , Yonina C. Eldar

We develop a data-driven regularization method for the severely ill-posed problem of photoacoustic image reconstruction from limited view data. Our approach is based on the regularizing networks that have been recently introduced and…

Numerical Analysis · Mathematics 2024-12-20 Johannes Schwab , Stephan Antholzer , Robert Nuster , Günther Paltauf , Markus Haltmeier

We propose a new approach for large-scale high-dynamic range computational imaging. Deep Neural Networks (DNNs) trained end-to-end can solve linear inverse imaging problems almost instantaneously. While unfolded architectures provide…

Instrumentation and Methods for Astrophysics · Physics 2023-09-28 Amir Aghabiglou , Matthieu Terris , Adrian Jackson , Yves Wiaux

Many consequential real-world systems, like wind fields and ocean currents, are dynamic and hard to model. Learning their governing dynamics remains a central challenge in scientific machine learning. Dynamic Mode Decomposition (DMD)…

Machine Learning · Computer Science 2025-11-26 Yujin Kim , Sarah Dean

Deep learning based unmixing methods have received great attention in recent years and achieve remarkable performance. These methods employ a data-driven approach to extract structure features from hyperspectral image, however, they tend to…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Min Zhao , Linruize Tang , Jie Chen

Prior methodologies have disregarded the diversities among distinct degradation types during image reconstruction, employing a uniform network model to handle multiple deteriorations. Nevertheless, we discover that prevalent degradation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Weilei Wen , Chunle Guo , Wenqi Ren , Hongpeng Wang , Xiuli Shao

Tomographic synthetic aperture radar (TomoSAR) imaging algorithms based on deep learning can effectively reduce computational costs. The idea of existing researches is to reconstruct the elevation for each range-azimuth cell in…

Signal Processing · Electrical Eng. & Systems 2022-10-06 Yu Ren , Xiaoling Zhang , Yunqiao Hu , Xu Zhan

Diffusion models are extensively used for modeling image priors for inverse problems. We introduce \emph{Diff-Unfolding}, a principled framework for learning posterior score functions of \emph{conditional diffusion models} by explicitly…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Yuanhao Wang , Shirin Shoushtari , Ulugbek S. Kamilov

We consider the problem of denoising with the help of prior information taken from a database of clean signals or images. Denoising with variational methods is very efficient if a regularizer well adapted to the nature of the data is…

Machine Learning · Computer Science 2023-10-06 Hui Shi , Yann Traonmilin , J-F Aujol

End-to-end autonomous driving has emerged as a dominant paradigm, yet its highly entangled black-box models pose significant challenges in terms of interpretability and safety assurance. To improve model transparency and training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ni Ding , Lei He , Shengbo Eben Li , Keqiang Li

Deep neural networks have had an enormous impact on image analysis. State-of-the-art training methods, based on weight decay and DropOut, result in impressive performance when a very large training set is available. However, they tend to…

Machine Learning · Computer Science 2019-09-02 Amal Rannen Triki , Matthew B. Blaschko

This paper introduces a novel method of Progressive Low Rank Decomposition (PLRD) tailored for the compression of large language models. Our approach leverages a pre-trained model, which is then incrementally decompressed to smaller sizes…

Computation and Language · Computer Science 2024-07-01 Habib Hajimolahoseini , Mohammad Hassanpour , Foozhan Ataiefard , Boxing Chen , Yang Liu

This paper studies how to train machine-learning models that directly approximate the optimal solutions of constrained optimization problems. This is an empirical risk minimization under constraints, which is challenging as training must…

Machine Learning · Computer Science 2022-11-24 Seonho Park , Pascal Van Hentenryck

Relying on either deep models or physical models are two mainstream approaches for solving inverse sample reconstruction problems in programmable illumination computational microscopy. Solutions based on physical models possess strong…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Ruiqing Sun , Delong Yang , Shaohui Zhang , Qun Hao

We develop a new randomized iterative algorithm---stochastic dual ascent (SDA)---for finding the projection of a given vector onto the solution space of a linear system. The method is dual in nature: with the dual being a non-strongly…

Numerical Analysis · Mathematics 2016-01-29 Robert Mansel Gower , Peter Richtarik

Learned image reconstruction has become a pillar in computational imaging and inverse problems. Among the most successful approaches are learned iterative networks, which are formulated by unrolling classical iterative optimisation…

Image and Video Processing · Electrical Eng. & Systems 2025-12-10 Andreas Hauptmann , Ozan Öktem