English
Related papers

Related papers: NeuralPower: Predict and Deploy Energy-Efficient C…

200 papers

Much work has been dedicated to estimating and optimizing workloads in high-performance computing (HPC) and deep learning. However, researchers have typically relied on few metrics to assess the efficiency of those techniques. Most notably,…

Machine Learning · Computer Science 2023-10-17 Hugo Waltsburger , Erwan Libessart , Chengfang Ren , Anthony Kolar , Regis Guinvarc'h

Deep neural networks (DNNs) depend on the storage of a large number of parameters, which consumes an important portion of the energy used during inference. This paper considers the case where the energy usage of memory elements can be…

Machine Learning · Computer Science 2019-12-24 Sébastien Henwood , François Leduc-Primeau , Yvon Savaria

Convolutional Neural Networks (CNNs) have shown a great deal of success in diverse application domains including computer vision, speech recognition, and natural language processing. However, as the size of datasets and the depth of neural…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-07 Wonje Choi , Karthi Duraisamy , Ryan Gary Kim , Janardhan Rao Doppa , Partha Pratim Pande , Diana Marculescu , Radu Marculescu

Since the emergence of Deep Neural Networks (DNNs) as a prominent technique in the field of computer vision, the ImageNet classification challenge has played a major role in advancing the state-of-the-art. While accuracy figures have…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Alfredo Canziani , Adam Paszke , Eugenio Culurciello

Machine intelligence, especially using convolutional neural networks (CNNs), has become a large area of research over the past years. Increasingly sophisticated hardware accelerators are proposed that exploit e.g. the sparsity in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-23 Andreas Bytyn , René Ahlsdorf , Rainer Leupers , Gerd Ascheid

Training convolutional neural networks (CNNs) requires intense compute throughput and high memory bandwidth. Especially, convolution layers account for the majority of the execution time of CNN training, and GPUs are commonly used to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-28 Sangkug Lym , Donghyuk Lee , Mike O'Connor , Niladrish Chatterjee , Mattan Erez

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Convolutional neural networks (CNNs) demand huge DRAM bandwidth for computational imaging tasks, and block-based processing has recently been applied to greatly reduce the bandwidth. However, the induced additional computation for feature…

Machine Learning · Computer Science 2020-01-31 Chao-Tsung Huang

With the rise of AI in recent years and the increase in complexity of the models, the growing demand in computational resources is starting to pose a significant challenge. The need for higher compute power is being met with increasingly…

Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models…

Machine Learning · Computer Science 2020-02-21 Valentin Radu , Kuba Kaszyk , Yuan Wen , Jack Turner , Jose Cano , Elliot J. Crowley , Bjorn Franke , Amos Storkey , Michael O'Boyle

Power demand forecasting is a critical task for achieving efficiency and reliability in power grid operation. Accurate forecasting allows grid operators to better maintain the balance of supply and demand as well as to optimize operational…

Other Computer Science · Computer Science 2019-04-30 Yao Cheng , Chang Xu , Daisuke Mashima , Vrizlynn L. L. Thing , Yongdong Wu

The predictive power of Convolutional Neural Networks (CNNs) has been an integral factor for emerging latency-sensitive applications, such as autonomous drones and vehicles. Such systems employ multiple CNNs, each one trained for a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Stylianos I. Venieris , Christos-Savvas Bouganis

Power consumption is a major obstacle in the deployment of deep neural networks (DNNs) on end devices. Existing approaches for reducing power consumption rely on quite general principles, including avoidance of multiplication operations and…

Machine Learning · Computer Science 2022-02-08 Nurit Spingarn Eliezer , Ron Banner , Elad Hoffer , Hilla Ben-Yaakov , Tomer Michaeli

Recurrent neural networks (RNNs) have shown state of the art results for speech recognition, natural language processing, image captioning and video summarizing applications. Many of these applications run on low-power platforms, so their…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-09 Urmish Thakker , Ganesh Dasika , Jesse Beu , Matthew Mattina

We introduce a new method, called CNNAS (convolutional neural networks for atomistic systems), for calculating the total energy of atomic systems which rivals the computational cost of empirical potentials while maintaining the accuracy of…

Materials Science · Physics 2018-03-21 Kevin Ryczko , Kyle Mills , Iryna Luchak , Christa Homenick , Isaac Tamblyn

Recently, outstanding identification rates in image classification tasks were achieved by convolutional neural networks (CNNs). to use such skills, selective CNNs trained on a dataset of well-known images of metal surface defects captured…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Nadeem Jabbar Chaudhry , M. Bilal Khan , M. Javaid Iqbal , Siddiqui Muhammad Yasir

Today, deep learning optimization is primarily driven by research focused on achieving high inference accuracy and reducing latency. However, the energy efficiency aspect is often overlooked, possibly due to a lack of sustainability mindset…

Networking and Internet Architecture · Computer Science 2024-06-11 Xiaolong Tu , Anik Mallik , Dawei Chen , Kyungtae Han , Onur Altintas , Haoxin Wang , Jiang Xie

Heterogeneous network (HetNet) has been proposed as a promising solution for handling the wireless traffic explosion in future fifth-generation (5G) system. In this paper, a joint subchannel and power allocation problem is formulated for…

Signal Processing · Electrical Eng. & Systems 2019-03-04 Di Xu , Xiaojing Che , Changhao Wu , Shunqing Zhang , Shugong Xu , Shan Cao

On-device CNN inference for real-time computer vision applications can result in computational demands that far exceed the energy budgets of mobile devices. This paper proposes FixyNN, a co-designed hardware accelerator platform which…

Machine Learning · Computer Science 2019-02-28 Paul Whatmough , Chuteng Zhou , Patrick Hansen , Matthew Mattina

Unlike existing work in deep neural network (DNN) graphs optimization for inference performance, we explore DNN graph optimization for energy awareness and savings for power- and resource-constrained machine learning devices. We present a…

Machine Learning · Computer Science 2026-01-27 Yu Wang , Rong Ge , Shuang Qiu