English
Related papers

Related papers: TernaryNet: Faster Deep Model Inference without GP…

200 papers

With recent advancing of Internet of Things (IoTs), it becomes very attractive to implement the deep convolutional neural networks (DCNNs) onto embedded/portable systems. Presently, executing the software-based DCNNs requires…

Computer Vision and Pattern Recognition · Computer Science 2017-02-01 Ao Ren , Ji Li , Zhe Li , Caiwen Ding , Xuehai Qian , Qinru Qiu , Bo Yuan , Yanzhi Wang

Video and image streaming on edge devices requires low latency. To address this, Neural Networks (NNs) are widely used, and prior work mainly focuses on accelerating them with single hardware units such as Graphics Processing Units (GPUs),…

Hardware Architecture · Computer Science 2026-05-04 Ali Emre Oztas , Mahir Demir , James Garside , Mikel Luj'an

Deep neural networks (DNN) have shown superior performance in a variety of tasks. As they rapidly evolve, their escalating computation and memory demands make it challenging to deploy them on resource-constrained edge devices. Though…

Machine Learning · Computer Science 2021-09-07 Jiaqi Gu , Hanqing Zhu , Chenghao Feng , Mingjie Liu , Zixuan Jiang , Ray T. Chen , David Z. Pan

Convolution neural networks (CNNs) have achieved remarkable success, but typically accompany high computation cost and numerous redundant weight parameters. To reduce the FLOPs, structure pruning is a popular approach to remove the entire…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Bo Ji , Tianyi Chen

Phenomenally successful in practical inference problems, convolutional neural networks (CNN) are widely deployed in mobile devices, data centers, and even supercomputers. The number of parameters needed in CNNs, however, are often large and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Jongsoo Park , Sheng Li , Wei Wen , Ping Tak Peter Tang , Hai Li , Yiran Chen , Pradeep Dubey

Automated segmentation of individual calf muscle compartments from 3D magnetic resonance (MR) images is essential for developing quantitative biomarkers for muscular disease progression and its prediction. Achieving clinically acceptable…

Image and Video Processing · Electrical Eng. & Systems 2020-12-23 Zhihui Guo , Honghai Zhang , Zhi Chen , Ellen van der Plas , Laurie Gutmann , Daniel Thedens , Peggy Nopoulos , Milan Sonka

We propose a new method for creating computationally efficient and compact convolutional neural networks (CNNs) using a novel sparse connection structure that resembles a tree root. This allows a significant reduction in computational cost…

Neural and Evolutionary Computing · Computer Science 2020-10-13 Yani Ioannou , Duncan Robertson , Roberto Cipolla , Antonio Criminisi

Deep neural network (DNN) based approaches have been widely investigated and deployed in medical image analysis. For example, fully convolutional neural networks (FCN) achieve the state-of-the-art performance in several applications of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Dong Yang , Holger Roth , Ziyue Xu , Fausto Milletari , Ling Zhang , Daguang Xu

GPUs are currently the platform of choice for training neural networks. However, training a deep neural network (DNN) is a time-consuming process even on GPUs because of the massive number of parameters that have to be learned. As a result,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Behnam Pourghassemi , Chenghao Zhang , Joo Hwan Lee , Aparna Chandramowlishwaran

The advancement of deep convolutional neural networks (DCNNs) has driven significant improvement in the accuracy of recognition systems for many computer vision tasks. However, their practical applications are often restricted in…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiaxin Gu , Ce Li , Baochang Zhang , Jungong Han , Xianbin Cao , Jianzhuang Liu , David Doermann

Low-bit quantized neural networks are of great interest in practical applications because they significantly reduce the consumption of both memory and computational resources. Binary neural networks are memory and computationally efficient…

Machine Learning · Computer Science 2022-05-20 Anton Trusov , Elena Limonova , Dmitry Nikolaev , Vladimir V. Arlazarov

Model based iterative reconstruction (MBIR) algorithms for low-dose X-ray CT are computationally expensive. To address this problem, we recently proposed a deep convolutional neural network (CNN) for low-dose X-ray CT and won the second…

Machine Learning · Statistics 2018-03-29 Eunhee Kang , Jaejun Yoo , Jong Chul Ye

Deep neural network (DNN) models have shown remarkable success in many real-world scenarios, such as object detection and classification. Unfortunately, these models are not yet widely adopted in health monitoring due to exceptionally high…

Machine Learning · Computer Science 2025-03-14 Johnson Loh , Lyubov Dudchenko , Justus Viga , Tobias Gemmeke

While convolutional neural networks (CNNs) and vision transformers (ViTs) have advanced medical image segmentation, they face inherent limitations such as local receptive fields in CNNs and high computational complexity in ViTs. This paper…

Image and Video Processing · Electrical Eng. & Systems 2025-04-02 Pooya Ashtari , Shahryar Noei , Fateme Nateghi Haredasht , Jonathan H. Chen , Giuseppe Jurman , Aleksandra Pizurica , Sabine Van Huffel

The encoder-decoder framework is state-of-the-art for offline semantic image segmentation. Since the rise in autonomous systems, real-time computation is increasingly desirable. In this paper, we introduce fast segmentation convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Rudra P K Poudel , Stephan Liwicki , Roberto Cipolla

Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this work, we propose a data driven non-iterative algorithm to overcome the shortcomings of earlier…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Suhas Lohit , Kuldeep Kulkarni , Ronan Kerviche , Pavan Turaga , Amit Ashok

The excellent performance of deep neural networks has enabled us to solve several automatization problems, opening an era of autonomous devices. However, current deep net architectures are heavy with millions of parameters and require…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Dat Thanh Tran , Alexandros Iosifidis , Moncef Gabbouj

We propose a new method to create compact convolutional neural networks (CNNs) by exploiting sparse convolutions. Different from previous works that learn sparsity in models, we directly employ hand-crafted kernels with regular sparse…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Chun-Fu Chen , Quanfu Fan , Marco Pistoia , Gwo Giun Lee

In trained deep neural networks, unstructured pruning can reduce redundant weights to lower storage cost. However, it requires the customization of hardwares to speed up practical inference. Another trend accelerates sparse model inference…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Zhuliang Yao , Shijie Cao , Wencong Xiao , Chen Zhang , Lanshun Nie

Convolutional neural network inference on video input is computationally expensive and requires high memory bandwidth. Recently, DeltaCNN managed to reduce the cost by only processing pixels with significant updates over the previous frame.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Mathias Parger , Chengcheng Tang , Thomas Neff , Christopher D. Twigg , Cem Keskin , Robert Wang , Markus Steinberger