English
Related papers

Related papers: Improving Efficiency in Neural Network Accelerator…

200 papers

Iterative algorithms are widely used in digital signal processing applications. With the case study of radio astronomy calibration processing, this work contributes towards revealing and exploiting the intrinsic error resilience of…

Signal Processing · Electrical Eng. & Systems 2025-02-21 G. A. Gillani , A. Krapukhin , A. B. J. Kokkeler

Deep Neural Networks (DNNs) have been established as the state-of-the-art algorithm for advanced machine learning applications. Recently proposed by the Google Brain's team, the Capsule Networks (CapsNets) have improved the generalization…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Vojtech Mrazek , Muhammad Abdullah Hanif , Muhammad Shafique

The performance of deep neural networks is well-known to be sensitive to the setting of their hyperparameters. Recent advances in reverse-mode automatic differentiation allow for optimizing hyperparameters with gradients. The standard way…

Machine Learning · Computer Science 2016-04-07 Jie Fu , Hongyin Luo , Jiashi Feng , Kian Hsiang Low , Tat-Seng Chua

Deep Neural Networks (DNNs) are very popular because of their high performance in various cognitive tasks in Machine Learning (ML). Recent advancements in DNNs have brought beyond human accuracy in many tasks, but at the cost of high…

Hardware Architecture · Computer Science 2022-03-18 Giorgos Armeniakos , Georgios Zervakis , Dimitrios Soudris , Jörg Henkel

TensorDash is a hardware level technique for enabling data-parallel MAC units to take advantage of sparsity in their input operand streams. When used to compose a hardware accelerator for deep learning, TensorDash can speedup the training…

Hardware Architecture · Computer Science 2022-03-28 Mostafa Mahmoud , Isak Edo , Ali Hadi Zadeh , Omar Mohamed Awad , Gennady Pekhimenko , Jorge Albericio , Andreas Moshovos

Autonomous Aerial Vehicle (AAV)-assisted Internet of Things (IoT) represents a collaborative architecture in which AAV allocate resources over 6G links to jointly enhance user-intent interpretation and overall network performance. Owing to…

Artificial Intelligence · Computer Science 2026-01-30 Xiaoming He , Gaofeng Wang , Huajun Cui , Rui Yuan , Haitao Zhao

Automatic algorithm-hardware co-design for DNN has shown great success in improving the performance of DNNs on FPGAs. However, this process remains challenging due to the intractable search space of neural network architectures and hardware…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Zhen Dong , Yizhao Gao , Qijing Huang , John Wawrzynek , Hayden K. H. So , Kurt Keutzer

This paper considers utility optimal power control for energy harvesting wireless devices with a finite capacity battery. The distribution information of the underlying wireless environment and harvestable energy is unknown and only…

Optimization and Control · Mathematics 2019-08-27 Hao Yu , Michael J. Neely

The progress of some AI paradigms such as deep learning is said to be linked to an exponential growth in the number of parameters. There are many studies corroborating these trends, but does this translate into an exponential increase in…

Machine Learning · Computer Science 2023-03-30 Radosvet Desislavov , Fernando Martínez-Plumed , José Hernández-Orallo

In this paper, we consider the energy-bandwidth allocation for a network of multiple users, where the transmitters each powered by both an energy harvester and conventional grid, access the network orthogonally on the assigned frequency…

Information Theory · Computer Science 2017-08-04 Vaneet Aggarwal , Mark R. Bell , Anis Elgabli , Xiaodong Wang , Shan Zhong

Massive multiple input multiple output (MIMO) systems are typically designed under the assumption of linear power amplifiers (PAs). However, PAs are typically most energy-efficient when operating close to their saturation point, where they…

Machine Learning · Computer Science 2022-10-14 Thomas Feys , Xavier Mestre , François Rottenberg

This paper analyzes the performance and energy efficiency of Netcast, a recently proposed optical neural-network architecture designed for edge computing. Netcast performs deep neural network inference by dividing the computational task…

Emerging Technologies · Computer Science 2022-07-06 Ryan Hamerly , Alexander Sludds , Saumil Bandyopadhyay , Zaijun Chen , Zhizhen Zhong , Liane Bernstein , Dirk Englund

Energy efficiency and its optimization constitute critical tasks in the design of low-power wireless networks. The present work is devoted to the error rate analysis and energy-efficiency optimization of regenerative cooperative networks in…

Information Theory · Computer Science 2015-06-03 Mulugeta K. Fikadu , Paschalis C. Sofotasios , Qimei Cui , Mikko Valkama , George K. Karagiannidis

As neural networks (NN) are deployed across diverse sectors, their energy demand correspondingly grows. While several prior works have focused on reducing energy consumption during training, the continuous operation of ML-powered systems…

Machine Learning · Computer Science 2024-01-10 Minghao Yan , Hongyi Wang , Shivaram Venkataraman

Deep neural networks (DNN) have become significant applications in both cloud-server and edge devices. Meanwhile, the growing number of DNNs on those platforms raises the need to execute multiple DNNs on the same device. This paper proposes…

Hardware Architecture · Computer Science 2023-02-22 Midia Reshadi , David Gregg

The dramatic increase of network infrastructure comes at the cost of rapidly increasing energy consumption, which makes optimization of energy efficiency (EE) an important topic. Since EE is often modeled as the ratio of rate to power, we…

Information Theory · Computer Science 2015-03-19 Christian Isheden , Zhijiat Chong , Eduard Jorswieck , Gerhard Fettweis

The intrinsic error tolerance of neural network (NN) makes approximate computing a promising technique to improve the energy efficiency of NN inference. Conventional approximate computing focuses on balancing the efficiency-accuracy…

Machine Learning · Computer Science 2018-05-23 Xin He , Liu Ke , Wenyan Lu , Guihai Yan , Xuan Zhang

With the widespread use of deep neural networks(DNNs) in intelligent systems, DNN accelerators with high performance and energy efficiency are greatly demanded. As one of the feasible processing-in-memory(PIM) architectures,…

Hardware Architecture · Computer Science 2023-12-22 Junpeng Wang , Mengke Ge , Bo Ding , Qi Xu , Song Chen , Yi Kang

Recurrent Neural Networks (RNNs) are useful in temporal sequence tasks. However, training RNNs involves dense matrix multiplications which require hardware that can support a large number of arithmetic operations and memory accesses.…

Machine Learning · Computer Science 2023-12-18 Xi Chen , Chang Gao , Zuowen Wang , Longbiao Cheng , Sheng Zhou , Shih-Chii Liu , Tobi Delbruck

Despite the empirical success in various domains, it has been revealed that deep neural networks are vulnerable to maliciously perturbed input data that much degrade their performance. This is known as adversarial attacks. To counter…

Machine Learning · Computer Science 2021-08-17 Nanyang Ye , Qianxiao Li , Xiao-Yun Zhou , Zhanxing Zhu