中文
相关论文

相关论文: Training Progressively Binarizing Deep Networks Us…

200 篇论文

Compared to classical deep neural networks its binarized versions can be useful for applications on resource-limited devices due to their reduction in memory consumption and computational demands. In this work we study deep neural networks…

最优化与控制 · 数学 2021-10-26 Jannis Kurtz , Bubacarr Bah

Neural Networks (NNs) are increasingly used in the last decade in several demanding applications, such as object detection and classification, autonomous driving, etc. Among different computing platforms for implementing NNs, FPGAs have…

硬件体系结构 · 计算机科学 2024-04-03 Ioanna Souvatzoglou , Athanasios Papadimitriou , Aitzan Sari , Vasileios Vlagkoulis , Mihalis Psarakis

Deep neural networks (DNNs) have been increasingly deployed on and integrated with edge devices, such as mobile phones, drones, robots and wearables. To run DNN inference directly on edge devices (a.k.a. edge inference) with a satisfactory…

机器学习 · 计算机科学 2020-09-18 Bingqian Lu , Jianyi Yang , Shaolei Ren

Graph Neural Networks (GNNs) have shown great success in many applications such as recommendation systems, molecular property prediction, traffic prediction, etc. Recently, CPU-FPGA heterogeneous platforms have been used to accelerate many…

分布式、并行与集群计算 · 计算机科学 2021-12-23 Yi-Chien Lin , Bingyi Zhang , Viktor Prasanna

Spiking neural networks (SNNs) that enable low-power design on edge devices have recently attracted significant research. However, the temporal characteristic of SNNs causes high latency, high bandwidth and high energy consumption for the…

硬件体系结构 · 计算机科学 2022-05-05 Hong-Han Lien , Chung-Wei Hsu , Tian-Sheuan Chang

The record-breaking achievements of deep neural networks (DNNs) in image classification and detection tasks resulted in a surge of new computer vision applications during the past years. However, their computational complexity is…

图像与视频处理 · 电气工程与系统科学 2021-06-25 Petar Jokic , Stephane Emery , Luca Benini

3D reconstruction from videos has become increasingly popular for various applications, including navigation for autonomous driving of robots and drones, augmented reality (AR), and 3D modeling. This task often combines traditional…

硬件体系结构 · 计算机科学 2022-12-19 Nobuho Hashimoto , Shinya Takamaeda-Yamazaki

Recent studies have shown that Binary Graph Neural Networks (GNNs) are promising for saving computations of GNNs through binarized tensors. Prior work, however, mainly focused on algorithm designs or training techniques, leaving it open to…

分布式、并行与集群计算 · 计算机科学 2023-06-06 Jou-An Chen , Hsin-Hsuan Sung , Xipeng Shen , Sutanay Choudhury , Ang Li

Deep Neural Networks (DNN) achieve human level performance in many image analytics tasks but DNNs are mostly deployed to GPU platforms that consume a considerable amount of power. New hardware platforms using lower precision arithmetic…

神经与进化计算 · 计算机科学 2017-05-23 Antonio Jimeno Yepes , Jianbin Tang , Benjamin Scott Mashford

Neural networks have become dominant computational workloads across cloud and edge platforms, but their rapid growth in model size and deployment diversity has exposed hardware bottlenecks increasingly dominated by memory movement,…

系统与控制 · 电气工程与系统科学 2026-01-16 Bin Xu , Ayan Banerjee , Sandeep Gupta

Backpropagation has been the cornerstone of neural network training for decades, yet its inefficiencies in time and energy consumption limit its suitability for resource-constrained edge devices. While low-precision neural network…

机器学习 · 计算机科学 2025-07-01 Jingxiao Ma , Priyadarshini Panda , Sherief Reda

This study presents advanced neural network architectures including Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Long Short-Term Memory Networks (LSTMs), and Deep Belief Networks (DBNs) for enhanced ECG signal…

硬件体系结构 · 计算机科学 2023-07-18 Kayode Inadagbo , Baran Arig , Nisanur Alici , Murat Isik

Despite the growing popularity of deep learning technologies, high memory requirements and power consumption are essentially limiting their application in mobile and IoT areas. While binary convolutional networks can alleviate these…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Dmitry Ignatov , Andrey Ignatov

The training process of Deep Neural Network (DNN) is compute-intensive, often taking days to weeks to train a DNN model. Therefore, parallel execution of DNN training on GPUs is a widely adopted approach to speed up the process nowadays.…

分布式、并行与集群计算 · 计算机科学 2019-10-29 Chi-Chung Chen , Chia-Lin Yang , Hsiang-Yun Cheng

This paper proposes a Bitwise Gated Recurrent Unit (BGRU) network for the single-channel source separation task. Recurrent Neural Networks (RNN) require several sets of weights within its cells, which significantly increases the…

音频与语音处理 · 电气工程与系统科学 2019-08-26 Sunwoo Kim , Mrinmoy Maity , Minje Kim

Computation using brain-inspired spiking neural networks (SNNs) with neuromorphic hardware may offer orders of magnitude higher energy efficiency compared to the current analog neural networks (ANNs). Unfortunately, training SNNs with the…

神经与进化计算 · 计算机科学 2020-06-09 Eimantas Ledinauskas , Julius Ruseckas , Alfonsas Juršėnas , Giedrius Buračas

Mixed-signal neuromorphic processors provide extremely low-power operation for edge inference workloads, taking advantage of sparse asynchronous computation within Spiking Neural Networks (SNNs). However, deploying robust applications to…

新兴技术 · 计算机科学 2024-05-03 Uğurcan Çakal , Maryada , Chenxi Wu , Ilkay Ulusoy , Dylan R. Muir

Deep neural networks have proven to be particularly effective in visual and audio recognition tasks. Existing models tend to be computationally expensive and memory intensive, however, and so methods for hardware-oriented approximation have…

计算机视觉与模式识别 · 计算机科学 2019-07-09 Erwei Wang , James J. Davis , Ruizhe Zhao , Ho-Cheung Ng , Xinyu Niu , Wayne Luk , Peter Y. K. Cheung , George A. Constantinides

Binary Neural Networks (BNNs), which constrain both weights and activations to binary values, offer substantial reductions in computational complexity, memory footprint, and energy consumption. These advantages make them particularly well…

机器学习 · 计算机科学 2026-02-18 Luca Colombo , Fabrizio Pittorino , Daniele Zambon , Carlo Baldassi , Manuel Roveri , Cesare Alippi

Binary Neural Networks (BNNs) are an extremely promising method to reduce deep neural networks' complexity and power consumption massively. Binarization techniques, however, suffer from ineligible performance degradation compared to their…

机器学习 · 计算机科学 2022-04-06 Tal Rozen , Moshe Kimhi , Brian Chmiel , Avi Mendelson , Chaim Baskin