中文
相关论文

相关论文: Designing Energy-Efficient Convolutional Neural Ne…

200 篇论文

Energy efficiency of Convolutional Neural Networks (CNNs) has become an important area of research, with various strategies being developed to minimize the power consumption of these models. Previous efforts, including techniques like model…

人工智能 · 计算机科学 2024-12-12 Michail Kinnas , John Violos , Ioannis Kompatsiaris , Symeon Papadopoulos

Convolutional neural networks (CNN) play a major role in image processing tasks like image classification, object detection, semantic segmentation. Very often CNN networks have from several to hundred stacked layers with several megabytes…

机器学习 · 计算机科学 2020-02-18 Marcin Pietron , Maciej Wielgosz

As deep neural networks are increasingly used in applications suited for low-power devices, a fundamental dilemma becomes apparent: the trend is to grow models to absorb increasing data that gives rise to memory intensive; however low-power…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Weiyu Guo , Jiabin Ma , Liang Wang , Yongzhen Huang

For many applications, utilizing DNNs (Deep Neural Networks) requires their implementation on a target architecture in an optimized manner concerning energy consumption, memory requirement, throughput, etc. DNN compression is used to reduce…

计算机视觉与模式识别 · 计算机科学 2020-08-21 Muhammad Sabih , Frank Hannig , Juergen Teich

In recent years, deep neural networks have known a wide success in various application domains. However, they require important computational and memory resources, which severely hinders their deployment, notably on mobile devices or for…

计算机视觉与模式识别 · 计算机科学 2021-12-16 Nathan Hubens , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

In today's world, a vast amount of data is being generated by edge devices that can be used as valuable training data to improve the performance of machine learning algorithms in terms of the achieved accuracy or to reduce the compute…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Aditya Rajagopal , Christos-Savvas Bouganis

Model pruning has become a useful technique that improves the computational efficiency of deep learning, making it possible to deploy solutions in resource-limited scenarios. A widely-used practice in relevant work assumes that a…

机器学习 · 计算机科学 2018-02-06 Jianbo Ye , Xin Lu , Zhe Lin , James Z. Wang

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

机器学习 · 计算机科学 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

Recently there has been a lot of work on pruning filters from deep convolutional neural networks (CNNs) with the intention of reducing computations.The key idea is to rank the filters based on a certain criterion (say, l1-norm) and retain…

机器学习 · 计算机科学 2018-12-27 Deepak Mittal , Shweta Bhardwaj , Mitesh M. Khapra , Balaraman Ravindran

Deep neural networks (DNNs) have been successfully applied in various fields. A major challenge of deploying DNNs, especially on edge devices, is power consumption, due to the large number of multiply-and-accumulate (MAC) operations. To…

神经与进化计算 · 计算机科学 2023-11-28 Richard Petri , Grace Li Zhang , Yiran Chen , Ulf Schlichtmann , Bing Li

Channel pruning has been broadly recognized as an effective technique to reduce the computation and memory cost of deep convolutional neural networks. However, conventional pruning methods have limitations in that: they are restricted to…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Zejiang Hou , Minghai Qin , Fei Sun , Xiaolong Ma , Kun Yuan , Yi Xu , Yen-Kuang Chen , Rong Jin , Yuan Xie , Sun-Yuan Kung

During the last years, algorithms known as Convolutional Neural Networks (CNNs) had become increasingly popular, expanding its application range to several areas. In particular, the image processing field has experienced a remarkable…

硬件体系结构 · 计算机科学 2024-08-27 Federico Nicolas Peccia , Luciano Ferreyro , Alejandro Furfaro

This work is focused on the pruning of some convolutional neural networks (CNNs) and improving theirs efficiency on graphic processing units (GPU) by using a direct sparse algorithm. The Nvidia deep neural network (cuDnn) library is the…

机器学习 · 计算机科学 2022-08-30 Marcin Pietroń , Dominik Żurek

Although 3D Convolutional Neural Networks (CNNs) are essential for most learning based applications involving dense 3D data, their applicability is limited due to excessive memory and computational requirements. Compressing such networks by…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Zhiwei Xu , Thalaiyasingam Ajanthan , Vibhav Vineet , Richard Hartley

Channel pruning is one of the major compression approaches for deep neural networks. While previous pruning methods have mostly focused on identifying unimportant channels, channel pruning is considered as a special case of neural…

计算机视觉与模式识别 · 计算机科学 2021-09-15 Xiangcheng Liu , Jian Cao , Hongyi Yao , Wenyu Sun , Yuan Zhang

We propose a new formulation for pruning convolutional kernels in neural networks to enable efficient inference. We interleave greedy criteria-based pruning with fine-tuning by backpropagation - a computationally efficient procedure that…

机器学习 · 计算机科学 2017-06-12 Pavlo Molchanov , Stephen Tyree , Tero Karras , Timo Aila , Jan Kautz

The increasing usage of Artificial Intelligence (AI) models, especially Deep Neural Networks (DNNs), is increasing the power consumption during training and inference, posing environmental concerns and driving the need for more…

神经与进化计算 · 计算机科学 2024-02-01 Gabriel Cortês , Nuno Lourenço , Penousal Machado

Pruning methods have shown to be effective at reducing the size of deep neural networks while keeping accuracy almost intact. Among the most effective methods are those that prune a network while training it with a sparsity prior loss and…

神经与进化计算 · 计算机科学 2019-12-20 Carl Lemaire , Andrew Achkar , Pierre-Marc Jodoin

Resource-efficient convolution neural networks enable not only the intelligence on edge devices but also opportunities in system-level optimization such as scheduling. In this work, we aim to improve the performance of resource-constrained…

计算机视觉与模式识别 · 计算机科学 2018-10-19 Ting-Wu Chin , Cha Zhang , Diana Marculescu

Using smart wearable devices to monitor patients electrocardiogram (ECG) for real-time detection of arrhythmias can significantly improve healthcare outcomes. Convolutional neural network (CNN) based deep learning has been used successfully…

机器学习 · 计算机科学 2021-09-07 Xiaolin Li , Rajesh Panicker , Barry Cardiff , Deepu John