English
Related papers

Related papers: Memory-efficient Learning for Large-scale Computat…

200 papers

Autoencoder-based structures have dominated recent learned image compression methods. However, the inherent information loss associated with autoencoders limits their rate-distortion performance at high bit rates and restricts their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Hanyue Tu , Siqi Wu , Li Li , Wengang Zhou , Houqiang Li

To train deep convolutional neural networks, the input data and the intermediate activations need to be kept in memory to calculate the gradient descent step. Given the limited memory available in the current generation accelerator cards,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Hans Pinckaers , Geert Litjens

Model-based deep learning (MBDL) is a powerful methodology for designing deep models to solve imaging inverse problems. MBDL networks can be seen as iterative algorithms that estimate the desired image using a physical measurement model and…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Chicago Y. Park , Weijie Gan , Zihao Zou , Yuyang Hu , Zhixin Sun , Ulugbek S. Kamilov

An increasing number of applications in computer vision, specially, in medical imaging and remote sensing, become challenging when the goal is to classify very large images with tiny informative objects. Specifically, these classification…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Fanjie Kong , Ricardo Henao

As state of the art neural networks (NNs) continue to grow in size, their resource-efficient implementation becomes ever more important. In this paper, we introduce a compression scheme that reduces the number of computations required for…

Machine Learning · Computer Science 2025-04-25 Hans Rosenberger , Rodrigo Fischer , Johanna S. Fröhlich , Ali Bereyhi , Ralf R. Müller

While invaluable for many computer vision applications, decomposing a natural image into intrinsic reflectance and shading layers represents a challenging, underdetermined inverse problem. As opposed to strict reliance on conventional…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Qingnan Fan , Jiaolong Yang , Gang Hua , Baoquan Chen , David Wipf

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

Lossless image compression is an essential research field in image compression. Recently, learning-based image compression methods achieved impressive performance compared with traditional lossless methods, such as WebP, JPEG2000, and FLIF.…

Image and Video Processing · Electrical Eng. & Systems 2022-08-31 Ran Wang , Jinming Liu , Heming Sun , Jiro Katto

It is widely believed that the success of deep convolutional networks is based on progressively discarding uninformative variability about the input with respect to the problem at hand. This is supported empirically by the difficulty of…

Machine Learning · Computer Science 2018-06-25 Jörn-Henrik Jacobsen , Arnold Smeulders , Edouard Oyallon

Deep neural networks as image priors have been recently introduced for problems such as denoising, super-resolution and inpainting with promising performance gains over hand-crafted image priors such as sparsity and low-rank. Unlike learned…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Gauri Jagatap , Chinmay Hegde

Deep networks are now able to achieve human-level performance on a broad spectrum of recognition tasks. Independently, neuromorphic computing has now demonstrated unprecedented energy-efficiency through a new chip architecture based on…

The ability to learn continually without forgetting the past tasks is a desired attribute for artificial learning systems. Existing approaches to enable such learning in artificial neural networks usually rely on network growth, importance…

Machine Learning · Computer Science 2021-03-18 Gobinda Saha , Isha Garg , Kaushik Roy

Recently, deep learning-based compressive imaging (DCI) has surpassed the conventional compressive imaging in reconstruction quality and faster running time. While multi-scale has shown superior performance over single-scale, research in…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Thuong Nguyen Canh , Byeungwoo Jeon

While bigger and deeper neural network architectures continue to advance the state-of-the-art for many computer vision tasks, real-world adoption of these networks is impeded by hardware and speed constraints. Conventional model compression…

Machine Learning · Computer Science 2017-12-19 Anubhav Ashok , Nicholas Rhinehart , Fares Beainy , Kris M. Kitani

We introduce a novel technique for designing color filter metasurfaces using a data-driven approach based on deep learning. Our innovative approach employs inverse design principles to identify highly efficient designs that outperform all…

Most of the traditional work on intrinsic image decomposition rely on deriving priors about scene characteristics. On the other hand, recent research use deep learning models as in-and-out black box and do not consider the well-established,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Anil S. Baslamisli , Hoang-An Le , Theo Gevers

The excellent performance of deep neural networks has enabled us to solve several automatization problems, opening an era of autonomous devices. However, current deep net architectures are heavy with millions of parameters and require…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Dat Thanh Tran , Alexandros Iosifidis , Moncef Gabbouj

Magnetic resonance imaging (MRI) is a crucial tool for clinical diagnosis while facing the challenge of long scanning time. To reduce the acquisition time, fast MRI reconstruction aims to restore high-quality images from the undersampled…

Image and Video Processing · Electrical Eng. & Systems 2025-03-14 Yucong Meng , Zhiwei Yang , Minghong Duan , Yonghong Shi , Zhijian Song

Deep learning based techniques achieve state-of-the-art results in a wide range of image reconstruction tasks like compressed sensing. These methods almost always have hyperparameters, such as the weight coefficients that balance the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Alan Q. Wang , Adrian V. Dalca , Mert R. Sabuncu

Recent years have witnessed the great advance of deep learning in a variety of vision tasks. Many state-of-the-art deep neural networks suffer from large size and high complexity, which makes it difficult to deploy in resource-limited…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Zhengguang Zhou , Wengang Zhou , Xutao Lv , Xuan Huang , Xiaoyu Wang , Houqiang Li