English
Related papers

Related papers: Towards Architecture-Agnostic Untrained Network Pr…

200 papers

We consider solving ill-posed imaging inverse problems without access to an image prior or ground-truth examples. An overarching challenge in these inverse problems is that an infinite number of images, including many that are implausible,…

Image and Video Processing · Electrical Eng. & Systems 2023-11-02 Oscar Leong , Angela F. Gao , He Sun , Katherine L. Bouman

The emergence of deep-learning-based methods to solve image-reconstruction problems has enabled a significant increase in reconstruction quality. Unfortunately, these new methods often lack reliability and explainability, and there is a…

Image and Video Processing · Electrical Eng. & Systems 2023-08-28 Alexis Goujon , Sebastian Neumayer , Pakshal Bohra , Stanislas Ducotterd , Michael Unser

Indirect image registration is a promising technique to improve image reconstruction quality by providing a shape prior for the reconstruction task. In this paper, we propose a novel hybrid method that seeks to reconstruct high quality…

Image and Video Processing · Electrical Eng. & Systems 2019-12-18 Jiulong Liu , Angelica I. Aviles-Rivero , Hui Ji , Carola-Bibiane Schönlieb

Sparsity in the structure of Neural Networks can lead to less energy consumption, less memory usage, faster computation times on convenient hardware, and automated machine learning. If sparsity gives rise to certain kinds of structure, it…

Machine Learning · Computer Science 2021-07-28 Julian Stier , Harshil Darji , Michael Granitzer

The phenomenon of implicit regularization has attracted interest in recent years as a fundamental aspect of the remarkable generalizing ability of neural networks. In a nutshell, it entails that gradient descent dynamics in many neural…

Machine Learning · Computer Science 2024-02-28 Hong T. M. Chu , Subhro Ghosh , Chi Thanh Lam , Soumendu Sundar Mukherjee

Deep neural networks have shown remarkable performance across a wide range of vision-based tasks, particularly due to the availability of large-scale datasets for training and better architectures. However, data seen in the real world are…

Machine Learning · Computer Science 2018-11-26 Muhammad Usama , Dong Eui Chang

Finetuning pretrained models occurs in a low-dimensional subspace of the full parameter space. Prior work has focused on characterizing this optimization subspace, but largely ignored the complementary question: why do certain directions…

Machine Learning · Computer Science 2026-05-11 Junjie Yu , Yue Wang , Zihan Deng , Yan Zhu , Wenxiao Ma , Quanying Liu

Nowadays, nonnegative matrix factorization (NMF) based methods have been widely applied to blind spectral unmixing. Introducing proper regularizers to NMF is crucial for mathematically constraining the solutions and physically exploiting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Min Zhao , Tiande Gao , Jie Chen , Wei Chen

Deep learning techniques have recently emerged to efficiently manage mmWave beam transmissions without requiring time consuming beam sweeping strategies. A fundamental challenge in these methods is their dependency on hardware-specific…

Signal Processing · Electrical Eng. & Systems 2025-01-08 Omar Mashaal , Elsayed Mohammed , Alec Digby , Lorne Swersky , Ashkan Eshaghbeigi , Hatem Abou-Zeid

Deep feedforward and recurrent networks have achieved impressive results in many perception and language processing applications. This success is partially attributed to architectural innovations such as convolutional and long short-term…

Machine Learning · Statistics 2015-11-24 Arvind Neelakantan , Luke Vilnis , Quoc V. Le , Ilya Sutskever , Lukasz Kaiser , Karol Kurach , James Martens

Limited-angle X-ray tomography reconstruction is an ill-conditioned inverse problem in general. Especially when the projection angles are limited and the measurements are taken in a photon-limited condition, reconstructions from classical…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Zhen Guo , Jung Ki Song , George Barbastathis , Michael E. Glinsky , Courtenay T. Vaughan , Kurt W. Larson , Bradley K. Alpert , Zachary H. Levine

Super-resolution and denoising are ill-posed yet fundamental image restoration tasks. In blind settings, the degradation kernel or the noise level are unknown. This makes restoration even more challenging, notably for learning-based…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Majed El Helou , Ruofan Zhou , Sabine Süsstrunk

Group equivariant convolutional neural networks (G-CNNs) are generalizations of convolutional neural networks (CNNs) which excel in a wide range of technical applications by explicitly encoding symmetries, such as rotations and…

Machine Learning · Computer Science 2022-09-14 Hannah Lawrence , Kristian Georgiev , Andrew Dienes , Bobak T. Kiani

Recent advances have shown that implicit bias of gradient descent on over-parameterized models enables the recovery of low-rank matrices from linear measurements, even with no prior knowledge on the intrinsic rank. In contrast, for robust…

Machine Learning · Computer Science 2020-06-17 Chong You , Zhihui Zhu , Qing Qu , Yi Ma

Deep learning networks have shown state-of-the-art performance in many image reconstruction problems. However, it is not well understood what properties of representation and learning may improve the generalization ability of the network.…

Machine Learning · Computer Science 2019-05-14 Sandesh Ghimire , Prashnna Kumar Gyawali , Jwala Dhamala , John L Sapp , Milan Horacek , Linwei Wang

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Neural networks have shown tremendous potential for reconstructing high-resolution images in inverse problems. The non-convex and opaque nature of neural networks, however, hinders their utility in sensitive applications such as medical…

Machine Learning · Computer Science 2020-12-10 Arda Sahiner , Morteza Mardani , Batu Ozturkler , Mert Pilanci , John Pauly

The goal of MRI reconstruction is to restore a high fidelity image from partially observed measurements. This partial view naturally induces reconstruction uncertainty that can only be reduced by acquiring additional measurements. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-02-11 Zizhao Zhang , Adriana Romero , Matthew J. Muckley , Pascal Vincent , Lin Yang , Michal Drozdzal

Machine learning methods are commonly used to solve inverse problems, wherein an unknown signal must be estimated from few indirect measurements generated via a known acquisition procedure. In particular, neural networks perform well…

Machine Learning · Computer Science 2025-12-05 Hannah Laus , Suzanna Parkinson , Vasileios Charisopoulos , Felix Krahmer , Rebecca Willett

A broad class of problems at the core of computational imaging, sensing, and low-level computer vision reduces to the inverse problem of extracting latent images that follow a prior distribution, from measurements taken under a known…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Steven Diamond , Vincent Sitzmann , Felix Heide , Gordon Wetzstein