English
Related papers

Related papers: Memory-efficient Learning for Large-scale Computat…

200 papers

Model-based learned iterative reconstruction methods have recently been shown to outperform classical reconstruction algorithms. Applicability of these methods to large scale inverse problems is however limited by the available memory for…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Andreas Hauptmann , Jonas Adler , Simon Arridge , Ozan Öktem

Magnetic resonance imaging (MRI) reconstruction is an active inverse problem which can be addressed by conventional compressed sensing (CS) MRI algorithms that exploit the sparse nature of MRI in an iterative optimization-based manner.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Yuxiang Dai , Peixian Zhuang

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

Applying convolutional neural networks to large images is computationally expensive because the amount of computation scales linearly with the number of image pixels. We present a novel recurrent neural network model that is capable of…

Machine Learning · Computer Science 2014-06-25 Volodymyr Mnih , Nicolas Heess , Alex Graves , Koray Kavukcuoglu

Learned image compression methods generally optimize a rate-distortion loss, trading off improvements in visual distortion for added bitrate. Increasingly, however, compressed imagery is used as an input to deep learning networks for…

Image and Video Processing · Electrical Eng. & Systems 2022-02-02 Maxime Kawawa-Beaudan , Ryan Roggenkemper , Avideh Zakhor

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Over the past decade, deep learning models have exhibited considerable advancements, reaching or even exceeding human-level performance in a range of visual perception tasks. This remarkable progress has sparked interest in applying deep…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yulin Wang , Yizeng Han , Chaofei Wang , Shiji Song , Qi Tian , Gao Huang

Training deep neural networks on large-scale datasets requires significant hardware resources whose costs (even on cloud platforms) put them out of reach of smaller organizations, groups, and individuals. Backpropagation, the workhorse for…

Machine Learning · Computer Science 2020-09-22 Alexander Ororbia , Ankur Mali , Daniel Kifer , C. Lee Giles

Compressed sensing (CS) leverages the sparsity prior to provide the foundation for fast magnetic resonance imaging (fastMRI). However, iterative solvers for ill-posed problems hinder their adaption to time-critical applications. Moreover,…

Image and Video Processing · Electrical Eng. & Systems 2021-03-16 Jingshuai Liu , Mehrdad Yaghoobi

The backpropagation algorithm remains the dominant and most successful method for training deep neural networks (DNNs). At the same time, training DNNs at scale comes at a significant computational cost and therefore a high carbon…

Machine Learning · Computer Science 2025-11-12 Sander Dalm , Joshua Offergeld , Nasir Ahmad , Marcel van Gerven

Recovering images from undersampled linear measurements typically leads to an ill-posed linear inverse problem, that asks for proper statistical priors. Building effective priors is however challenged by the low train and test overhead…

Artificial Intelligence · Computer Science 2017-11-29 Morteza Mardani , Hatef Monajemi , Vardan Papyan , Shreyas Vasanawala , David Donoho , John Pauly

When deploying deep learning models to a device, it is traditionally assumed that available computational resources (compute, memory, and power) remain static. However, real-world computing systems do not always provide stable resource…

Machine Learning · Computer Science 2021-10-11 Elvis Nunez , Maxwell Horton , Anish Prabhu , Anurag Ranjan , Ali Farhadi , Mohammad Rastegari

Recently, deep learning-based compressed sensing (CS) has achieved great success in reducing the sampling and computational cost of sensing systems and improving the reconstruction quality. These approaches, however, largely overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yu Zhou , Yu Chen , Xiao Zhang , Pan Lai , Lei Huang , Jianmin Jiang

Recent progress on many imaging and vision tasks has been driven by the use of deep feed-forward neural networks, which are trained by propagating gradients of a loss defined on the final output, back through the network up to the first…

Machine Learning · Computer Science 2016-11-03 Ayan Chakrabarti

The problem of high-dimensional and large-scale representation of visual data is addressed from an unsupervised learning perspective. The emphasis is put on discrete representations, where the description length can be measured in bits and…

Machine Learning · Computer Science 2019-01-25 Sohrab Ferdowsi

Physics-driven deep learning methods have emerged as a powerful tool for computational magnetic resonance imaging (MRI) problems, pushing reconstruction performance to new limits. This article provides an overview of the recent developments…

Image and Video Processing · Electrical Eng. & Systems 2022-10-17 Kerstin Hammernik , Thomas Küstner , Burhaneddin Yaman , Zhengnan Huang , Daniel Rueckert , Florian Knoll , Mehmet Akçakaya

Power consumption is a critical factor for the deployment of embedded computer vision systems. We explore the use of computational cameras that directly output binary gradient images to reduce the portion of the power consumption allocated…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Suren Jayasuriya , Orazio Gallo , Jinwei Gu , Jan Kautz

Recent progress in deep learning-based models has improved photo-realistic (or perceptual) single-image super-resolution significantly. However, despite their powerful performance, many methods are difficult to apply to real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Namhyuk Ahn , Byungkon Kang , Kyung-Ah Sohn

Recently, integrated optics has gained interest as a hardware platform for implementing machine learning algorithms. Of particular interest are artificial neural networks, since matrix-vector multi- plications, which are used heavily in…

Optics · Physics 2018-07-25 Tyler W. Hughes , Momchil Minkov , Yu Shi , Shanhui Fan

There remains an important need for the development of image reconstruction methods that can produce diagnostically useful images from undersampled measurements. In magnetic resonance imaging (MRI), for example, such methods can facilitate…

Image and Video Processing · Electrical Eng. & Systems 2021-06-28 Varun A. Kelkar , Sayantan Bhadra , Mark A. Anastasio