English
Related papers

Related papers: Memory-efficient deep end-to-end posterior network…

200 papers

Deep neural networks suffer from storing millions and billions of weights in memory post-training, making challenging memory-intensive models to deploy on embedded devices. The weight-sharing technique is one of the popular compression…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Rasa Khosrowshahli , Shahryar Rahnamayan , Beatrice Ombuki-Berman

Efficient learning and model compression algorithm for deep neural network (DNN) is a key workhorse behind the rise of deep learning (DL). In this work, we propose a message passing based Bayesian deep learning algorithm called EM-TDAMP to…

Machine Learning · Computer Science 2024-06-11 Wei Xu , An Liu , Yiting Zhang , Vincent Lau

Geophysical inversion attempts to estimate the distribution of physical properties in the Earth's interior from observations collected at or above the surface. Inverse problems are commonly posed as least-squares optimization problems in…

Geophysics · Physics 2019-05-22 Vladimir Puzyrev

Traditionally, nonlinear inversion, direct inversion, or wave estimation methods have been used for reconstructing images from MRE displacement data. In this work, we propose a convolutional neural network architecture that can map MRE…

Medical Physics · Physics 2018-12-04 Ligin Solamen , Yipeng Shi , Justice Amoh

Fast and accurate MRI reconstruction is a key concern in modern clinical practice. Recently, numerous Deep-Learning methods have been proposed for MRI reconstruction, however, they usually fail to reconstruct sharp details from the…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Hanhui Yang , Juncheng Li , Lok Ming Lui , Shihui Ying , Jun Shi , Tieyong Zeng

Deep Neural Networks (DNNs) are computationally and memory intensive, which makes their hardware implementation a challenging task especially for resource constrained devices such as IoT nodes. To address this challenge, this paper…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Mohammed F. Tolba , Huruy Tekle Tesfai , Hani Saleh , Baker Mohammad , Mahmoud Al-Qutayri

Training end-to-end unrolled iterative neural networks for SPECT image reconstruction requires a memory-efficient forward-backward projector for efficient backpropagation. This paper describes an open-source, high performance Julia…

Signal Processing · Electrical Eng. & Systems 2023-04-04 Zongyu Li , Yuni K. Dewaraja , Jeffrey A. Fessler

We propose a registration algorithm for 2D CT/MRI medical images with a new unsupervised end-to-end strategy using convolutional neural networks. The contributions of our algorithm are threefold: (1) We transplant traditional image…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Siyuan Shan , Wen Yan , Xiaoqing Guo , Eric I-Chao Chang , Yubo Fan , Yan Xu

Recently, the deep learning technology has been successfully applied in the field of image compression, leading to superior rate-distortion performance. However, a challenge of many learning-based approaches is that they often achieve…

Image and Video Processing · Electrical Eng. & Systems 2023-08-24 Yongqiang Wang , Feng Liang , Haisheng Fu , Jie Liang , Haipeng Qin , Junzhe Liang

In this paper we address the memory demands that come with the processing of 3-dimensional, high-resolution, multi-channeled medical images in deep learning. We exploit memory-efficient backpropagation techniques, to reduce the memory…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Stefano B. Blumberg , Ryutaro Tanno , Iasonas Kokkinos , Daniel C. Alexander

It is known that unsupervised nonlinear dimensionality reduction and clustering is sensitive to the selection of hyperparameters, particularly for deep learning based methods, which hinders its practical use. How to select a proper network…

Machine Learning · Computer Science 2022-08-30 Xiao-Lei Zhang

To have a superior generalization, a deep learning neural network often involves a large size of training sample. With increase of hidden layers in order to increase learning ability, neural network has potential degradation in accuracy.…

Machine Learning · Computer Science 2019-01-01 Lianfa Li , Ying Fang , Jun Wu , Jinfeng Wang

As deep neural networks are increasingly used in applications suited for low-power devices, a fundamental dilemma becomes apparent: the trend is to grow models to absorb increasing data that gives rise to memory intensive; however low-power…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Weiyu Guo , Jiabin Ma , Liang Wang , Yongzhen Huang

Several machine learning techniques for accurate detection of skin cancer from medical images have been reported. Many of these techniques are based on pre-trained convolutional neural networks (CNNs), which enable training the models based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Aqsa Saeed Qureshi , Teemu Roos

Deep convolutional networks have attracted great attention in image restoration and enhancement. Generally, restoration quality has been improved by building more and more convolutional block. However, these methods mostly learn a specific…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Yukai Shi , Jinghui Qin

This paper presents a novel method for autonomously enhancing deep neural network training. My approach employs an Evaluation Neural Network (ENN) trained via deep reinforcement learning to predict the performance of the target network. The…

Machine Learning · Computer Science 2024-06-18 Ryohei Ino

In ill-posed inverse problems, it is commonly desirable to obtain insight into the full spectrum of plausible solutions, rather than extracting only a single reconstruction. Information about the plausible solutions and their likelihoods is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Omer Yair , Elias Nehme , Tomer Michaeli

Deep neural networks (DNNs) are powerful learning machines that have enabled breakthroughs in several domains. In this work, we introduce a new retrospective loss to improve the training of deep neural network models by utilizing the prior…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Surgan Jandial , Ayush Chopra , Mausoom Sarkar , Piyush Gupta , Balaji Krishnamurthy , Vineeth Balasubramanian

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

Machine Learning · Computer Science 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

Pre-trained encoders for offline feature extraction followed by multiple instance learning (MIL) aggregators have become the dominant paradigm in computational pathology (CPath), benefiting cancer diagnosis and prognosis. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Wenhao Tang , Rong Qin , Heng Fang , Fengtao Zhou , Hao Chen , Xiang Li , Ming-Ming Cheng