中文
相关论文

相关论文: Exploiting Neural-Network Statistics for Low-Power…

200 篇论文

We propose a new structured pruning framework for compressing Deep Neural Networks (DNNs) with skip connections, based on measuring the statistical dependency of hidden layers and predicted outputs. The dependence measure defined by the…

机器学习 · 计算机科学 2022-01-28 Mohammadreza Soltani , Suya Wu , Yuerong Li , Jie Ding , Vahid Tarokh

The success of deep neural networks (DNNs) is attributable to three factors: increased compute capacity, more complex models, and more data. These factors, however, are not always present, especially for edge applications such as autonomous…

计算机视觉与模式识别 · 计算机科学 2019-08-26 Bichen Wu

The deep neural network (DNN) based AI applications on the edge require both low-cost computing platforms and high-quality services. However, the limited memory, computing resources, and power budget of the edge devices constrain the…

机器学习 · 计算机科学 2021-05-14 Yao Chen , Cole Hawkins , Kaiqi Zhang , Zheng Zhang , Cong Hao

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

The record-breaking performance of deep neural networks (DNNs) comes with heavy parameterization, leading to external dynamic random-access memory (DRAM) for storage. The prohibitive energy of DRAM accesses makes it non-trivial to deploy…

机器学习 · 计算机科学 2021-12-23 Xiaohan Chen , Yang Zhao , Yue Wang , Pengfei Xu , Haoran You , Chaojian Li , Yonggan Fu , Yingyan Lin , Zhangyang Wang

Edge AI systems often operate under stringent energy and volume constraints that demand extreme efficiency under limited battery capacity, with requirements worsening as intelligent capability demands advance. Prior literature suggests that…

硬件体系结构 · 计算机科学 2026-03-26 Paul Chen , Jeongeun Kim , Wenbo Zhu , Yuanhan Li , Shunyao Huang , Chenjie Weng , Christopher Torng

Recent works on Binary Neural Networks (BNNs) have made promising progress in narrowing the accuracy gap of BNNs to their 32-bit counterparts. However, the accuracy gains are often based on specialized model designs using additional 32-bit…

机器学习 · 计算机科学 2021-06-15 Nianhui Guo , Joseph Bethge , Haojin Yang , Kai Zhong , Xuefei Ning , Christoph Meinel , Yu Wang

This work aims to enable persistent, event-driven sensing and decision capabilities for energy-harvesting (EH)-powered devices by deploying lightweight DNNs onto EH-powered devices. However, harvested energy is usually weak and…

机器学习 · 计算机科学 2020-07-24 Yawen Wu , Zhepeng Wang , Zhenge Jia , Yiyu Shi , Jingtong Hu

Deep Neural Network (DNN) applications with edge computing presents a trade-off between responsiveness and computational resources. On one hand, edge computing can provide high responsiveness deploying computational resources close to end…

分布式、并行与集群计算 · 计算机科学 2021-01-29 Roberto G. Pacheco , Rodrigo S. Couto

Deep neural networks (DNNs) have become ubiquitous in machine learning, but their energy consumption remains problematically high. An effective strategy for reducing such consumption is supply-voltage reduction, but if done too…

机器学习 · 计算机科学 2024-12-13 Hao-Lun Sun , Lei Hsiung , Nandhini Chandramoorthy , Pin-Yu Chen , Tsung-Yi Ho

Deep convolutional neural networks (CNN) have shown their good performances in many computer vision tasks. However, the high computational complexity of CNN involves a huge amount of data movements between the computational processor core…

硬件体系结构 · 计算机科学 2017-03-07 Shihao Wang , Dajiang Zhou , Xushen Han , Takeshi Yoshimura

Power consumption is a major obstacle in the deployment of deep neural networks (DNNs) on end devices. Existing approaches for reducing power consumption rely on quite general principles, including avoidance of multiplication operations and…

机器学习 · 计算机科学 2022-02-08 Nurit Spingarn Eliezer , Ron Banner , Elad Hoffer , Hilla Ben-Yaakov , Tomer Michaeli

This paper investigates the energy savings that near-subthreshold processors can obtain in edge AI applications and proposes strategies to improve them while maintaining the accuracy of the application. The selected processors deploy…

机器学习 · 计算机科学 2023-04-20 Zichao Shen , Neil Howard , Jose Nunez-Yanez

Energy-harvesting technology provides a promising platform for future IoT applications. However, since communication is very expensive in these devices, applications will require inference "beyond the edge" to avoid wasting precious energy…

分布式、并行与集群计算 · 计算机科学 2019-02-04 Graham Gobieski , Nathan Beckmann , Brandon Lucia

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

机器学习 · 计算机科学 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

Deep neural networks (DNNs) have been increasingly deployed on and integrated with edge devices, such as mobile phones, drones, robots and wearables. To run DNN inference directly on edge devices (a.k.a. edge inference) with a satisfactory…

机器学习 · 计算机科学 2020-09-18 Bingqian Lu , Jianyi Yang , Shaolei Ren

Deep neural network (DNN) inference has become an important part of many data-center workloads. This has prompted focused efforts to design ever-faster deep learning accelerators such as GPUs and TPUs. However, an end-to-end DNN-based…

分布式、并行与集群计算 · 计算机科学 2024-04-23 Ahmed F. AbouElhamayed , Susanne Balle , Deshanand Singh , Mohamed S. Abdelfattah

Bayesian method is capable of capturing real world uncertainties/incompleteness and properly addressing the over-fitting issue faced by deep neural networks. In recent years, Bayesian Neural Networks (BNNs) have drawn tremendous attentions…

机器学习 · 计算机科学 2020-05-11 Xiaotao Jia , Jianlei Yang , Runze Liu , Xueyan Wang , Sorin Dan Cotofana , Weisheng Zhao

Emerging research in edge devices and micro-controller units (MCU) enables on-device computation of Deep Learning Training and Inferencing tasks. More recently, contemporary trends focus on making the Deep Neural Net (DNN) Models runnable…

分布式、并行与集群计算 · 计算机科学 2025-01-30 Ziliang Zhang

As the technology industry is moving towards implementing tasks such as natural language processing, path planning, image classification, and more on smaller edge computing devices, the demand for more efficient implementations of…

机器学习 · 计算机科学 2022-11-24 Peyton Chandarana , Mohammadreza Mohammadi , James Seekings , Ramtin Zand