English
Related papers

Related papers: Deep Learning Meets Adaptive Filtering: A Stein's …

200 papers

Image reconstruction using deep learning algorithms offers improved reconstruction quality and lower reconstruction time than classical compressed sensing and model-based algorithms. Unfortunately, clean and fully sampled ground-truth data…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Hemant Kumar Aggarwal , Aniket Pramanik , Maneesh John , Mathews Jacob

Learning from unlabeled and noisy data is one of the grand challenges of machine learning. As such, it has seen a flurry of research with new ideas proposed continuously. In this work, we revisit a classical idea: Stein's Unbiased Risk…

Machine Learning · Statistics 2020-07-24 Christopher A. Metzler , Ali Mousavi , Reinhard Heckel , Richard G. Baraniuk

Deep unrolling, or unfolding, is an emerging learning-to-optimize method that unrolls a truncated iterative algorithm in the layers of a trainable neural network. However, the convergence guarantees and generalizability of the unrolled…

Machine Learning · Computer Science 2024-12-02 Samar Hadou , Navid NaderiAlizadeh , Alejandro Ribeiro

Recursive least squares (RLS) algorithms were once widely used for training small-scale neural networks, due to their fast convergence. However, previous RLS algorithms are unsuitable for training deep neural networks (DNNs), since they…

Machine Learning · Computer Science 2021-09-08 Chunyuan Zhang , Qi Song , Hui Zhou , Yigui Ou , Hongyao Deng , Laurence Tianruo Yang

Among the plethora of techniques devised to curb the prevalence of noise in medical images, deep learning based approaches have shown the most promise. However, one critical limitation of these deep learning based denoisers is the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Fahad Shamshad , Muhammad Awais , Muhammad Asim , Zain ul Aabidin Lodhi , Muhammad Umair , Ali Ahmed

In recent years, algorithm unrolling has emerged as a powerful technique for designing interpretable neural networks based on iterative algorithms. Imaging inverse problems have particularly benefited from unrolling-based deep network…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Yanan Zhao , Yuelong Li , Haichuan Zhang , Vishal Monga , Yonina C. Eldar

Anomaly detection (AD) is increasingly recognized as a key component for ensuring the resilience of future communication systems. While deep learning has shown state-of-the-art AD performance, its application in critical systems is hindered…

Machine Learning · Computer Science 2025-10-29 Lukas Schynol , Marius Pesavento

Deep algorithm unrolling has emerged as a powerful model-based approach to develop deep architectures that combine the interpretability of iterative algorithms with the performance gains of supervised deep learning, especially in cases of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Yair Ben Sahel , John P. Bryan , Brian Cleary , Samouil L. Farhi , Yonina C. Eldar

Deep learning algorithms that rely on extensive training data are revolutionizing image recovery from ill-posed measurements. Training data is scarce in many imaging applications, including ultra-high-resolution imaging. The deep image…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Maneesh John , Hemant Kumar Aggarwal , Qing Zou , Mathews Jacob

Algorithm unrolling has emerged as a learning-based optimization paradigm that unfolds truncated iterative algorithms in trainable neural-network optimizers. We introduce Stochastic UnRolled Federated learning (SURF), a method that expands…

Machine Learning · Computer Science 2024-02-08 Samar Hadou , Navid NaderiAlizadeh , Alejandro Ribeiro

The application of Deep Neural Networks (DNNs) to image denoising has notably challenged traditional denoising methods, particularly within complex noise scenarios prevalent in medical imaging. Despite the effectiveness of traditional and…

Image and Video Processing · Electrical Eng. & Systems 2024-08-31 Reeshad Khan , John Gauch , Ukash Nakarmi

Deep neural networks provide unprecedented performance gains in many real world problems in signal and image processing. Despite these gains, future development and practical deployment of deep networks is hindered by their blackbox nature,…

Image and Video Processing · Electrical Eng. & Systems 2020-08-10 Vishal Monga , Yuelong Li , Yonina C. Eldar

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient descent sometimes behaves inefficiently in deep learning…

Machine Learning · Computer Science 2025-05-01 Yaru Liu , Yiqi Gu , Michael K. Ng

Deep networks provide state-of-the-art performance in multiple imaging inverse problems ranging from medical imaging to computational photography. However, most existing networks are trained with clean signals which are often hard or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Dongdong Chen , Julián Tachella , Mike E. Davies

Unrolled computation graphs are prevalent throughout machine learning but present challenges to automatic differentiation (AD) gradient estimation methods when their loss functions exhibit extreme local sensitivtiy, discontinuity, or…

Neural and Evolutionary Computing · Computer Science 2023-12-12 Oscar Li , James Harrison , Jascha Sohl-Dickstein , Virginia Smith , Luke Metz

Recently, model-driven deep learning unrolls a certain iterative algorithm of a regularization model into a cascade network by replacing the first-order information (i.e., (sub)gradient or proximal operator) of the regularizer with a…

Machine Learning · Computer Science 2021-12-24 Zhuo-Xu Cui , Jing Cheng , Qingyong Zhu , Yuanyuan Liu , Sen Jia , Kankan Zhao , Ziwen Ke , Wenqi Huang , Haifeng Wang , Yanjie Zhu , Dong Liang

Distribution system state estimation (DSSE) is paramount for effective state monitoring and control. However, stochastic outputs of renewables and asynchronous streaming of multi-rate measurements in practical systems largely degrade the…

Systems and Control · Electrical Eng. & Systems 2023-10-23 Ying Zhang , Junbo Zhao , Di Shi , Sungjoo Chung

DRL agents circumvent the issue of classic models in the sense that they do not make assumptions like the financial returns being normally distributed and are able to deal with any information like the ESG score if they are configured to…

Portfolio Management · Quantitative Finance 2025-12-23 M. Coronado-Vaca

Much of Bayesian inference centers around the design of estimators for inverse problems which are optimal assuming the data comes from a known prior. But what do these optimality guarantees mean if the prior is unknown? In recent years,…

Machine Learning · Computer Science 2024-09-20 Aayush Karan , Kulin Shah , Sitan Chen , Yonina C. Eldar

Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a…

Machine Learning · Computer Science 2021-10-14 Akib Mashrur , Wei Luo , Nayyar A. Zaidi , Antonio Robles-Kelly
‹ Prev 1 2 3 10 Next ›