中文
相关论文

相关论文: Parsimonious Inference on Convolutional Neural Net…

200 篇论文

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

计算机视觉与模式识别 · 计算机科学 2019-11-26 Meisam Rakhshanfar

Convolutional neural networks (CNNs) are revolutionizing machine learning, but they present significant computational challenges. Recently, many FPGA-based accelerators have been proposed to improve the performance and efficiency of CNNs.…

硬件体系结构 · 计算机科学 2018-04-13 Yongming Shen , Michael Ferdman , Peter Milder

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to image recognition…

计算机视觉与模式识别 · 计算机科学 2020-02-19 Elena Limonova , Alexander Sheshkus , Dmitry Nikolaev

The rising demand for networked embedded systems with machine intelligence has been a catalyst for sustained attempts by the research community to implement Convolutional Neural Networks (CNN) based inferencing on embedded resource-limited…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Swarnava Dey , Pallab Dasgupta , Partha P Chakrabarti

Blind inpainting algorithms based on deep learning architectures have shown a remarkable performance in recent years, typically outperforming model-based methods both in terms of image quality and run time. However, neural network…

计算机视觉与模式识别 · 计算机科学 2022-05-16 Jenny Schmalfuss , Erik Scheurer , Heng Zhao , Nikolaos Karantzas , Andrés Bruhn , Demetrio Labate

Training Convolutional Neural Networks (CNNs) usually requires a large number of computational resources. In this paper, \textit{SparseTrain} is proposed to accelerate CNN training by fully exploiting the sparsity. It mainly involves three…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Pengcheng Dai , Jianlei Yang , Xucheng Ye , Xingzhou Cheng , Junyu Luo , Linghao Song , Yiran Chen , Weisheng Zhao

This paper presents a new variational inference framework for image restoration and a convolutional neural network (CNN) structure that can solve the restoration problems described by the proposed framework. Earlier CNN-based image…

图像与视频处理 · 电气工程与系统科学 2022-07-20 Jae Woong Soh , Nam Ik Cho

The success of convolutional neural networks (CNNs) in various applications is accompanied by a significant increase in computation and parameter storage costs. Recent efforts to reduce these overheads involve pruning and compressing the…

Training deep Convolutional Neural Networks (CNN) is a time consuming task that may take weeks to complete. In this article we propose a novel, theoretically founded method for reducing CNN training time without incurring any loss in…

计算机视觉与模式识别 · 计算机科学 2016-10-13 Pedro Porto Buarque de Gusmão , Gianluca Francini , Skjalg Lepsøy , Enrico Magli

We propose a new formulation for pruning convolutional kernels in neural networks to enable efficient inference. We interleave greedy criteria-based pruning with fine-tuning by backpropagation - a computationally efficient procedure that…

机器学习 · 计算机科学 2017-06-12 Pavlo Molchanov , Stephen Tyree , Tero Karras , Timo Aila , Jan Kautz

Deep learning applications have achieved great success in numerous real-world applications. Deep learning models, especially Convolution Neural Networks (CNN) are often prototyped using FPGA because it offers high power efficiency and…

机器学习 · 计算机科学 2022-02-22 Adewale Adeyemo , Travis Sandefur , Tolulope A. Odetola , Syed Rafay Hasan

Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained large-scale models or…

计算机视觉与模式识别 · 计算机科学 2021-07-06 Chen Zhang , Yinghao Xu , Yujun Shen

There has been significant progress in developing neural network architectures that both achieve high predictive performance and that also achieve high application-level inference throughput (e.g., frames per second). Another metric of…

机器学习 · 计算机科学 2022-12-16 Jack Kosaian , Amar Phanishayee

The crucial role of convolutional models, both as standalone vision models and backbones in foundation models, necessitates effective acceleration techniques. This paper proposes a novel method to learn semi-structured sparsity patterns for…

机器学习 · 计算机科学 2024-11-04 David A. Danhofer

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

计算机视觉与模式识别 · 计算机科学 2018-10-10 Xiaobo Huang

Deep learning models have shown their superior performance in various vision tasks. However, the lack of precisely interpreting kernels in convolutional neural networks (CNNs) is becoming one main obstacle to wide applications of deep…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Jia-Xin Zhuang , Wanying Tao , Jianfei Xing , Wei Shi , Ruixuan Wang , Wei-shi Zheng

The technique of distillation helps transform cumbersome neural network into compact network so that the model can be deployed on alternative hardware devices. The main advantages of distillation based approaches include simple training…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Zi-Rui Wang , Jun Du

In this paper we propose cross-modal convolutional neural networks (X-CNNs), a novel biologically inspired type of CNN architectures, treating gradient descent-specialised CNNs as individual units of processing in a larger-scale network…

机器学习 · 统计学 2017-09-26 Petar Veličković , Duo Wang , Nicholas D. Lane , Pietro Liò

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

计算机视觉与模式识别 · 计算机科学 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

Recently, dynamic inference has emerged as a promising way to reduce the computational cost of deep convolutional neural network (CNN). In contrast to static methods (e.g. weight pruning), dynamic inference adaptively adjusts the inference…

计算机视觉与模式识别 · 计算机科学 2019-12-18 Zhihang Yuan , Bingzhe Wu , Zheng Liang , Shiwan Zhao , Weichen Bi , Guangyu Sun