English
Related papers

Related papers: Bit Transition Reduction by Data Transmission Orde…

200 papers

This paper focuses on optimal transmit power allocation to maximize the overall system throughput in a vehicle-to-everything (V2X) communication system. We propose two methods for solving the power allocation problem namely the weighted…

Signal Processing · Electrical Eng. & Systems 2019-06-26 Jin Gao , Muhammad R. A. Khandaker , Faisal Tariq , Kai-Kit Wong , Risala T. Khan

Recently, nested dropout was proposed as a method for ordering representation units in autoencoders by their information content, without diminishing reconstruction cost. However, it has only been applied to training fully-connected…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Chelsea Finn , Lisa Anne Hendricks , Trevor Darrell

Automated feature extraction capability and significant performance of Deep Neural Networks (DNN) make them suitable for Internet of Things (IoT) applications. However, deploying DNN on edge devices becomes prohibitive due to the colossal…

Machine Learning · Computer Science 2022-10-03 Rahul Mishra , Hari Prabhat Gupta

We propose a novel approach to reduce memory consumption of the backpropagation through time (BPTT) algorithm when training recurrent neural networks (RNNs). Our approach uses dynamic programming to balance a trade-off between caching of…

Neural and Evolutionary Computing · Computer Science 2016-06-13 Audrūnas Gruslys , Remi Munos , Ivo Danihelka , Marc Lanctot , Alex Graves

Non-orthogonal multiple access (NOMA) and beamforming are well-established techniques for enabling massive connectivity in future wireless networks. However, many optimal beamforming solutions rely on highly complex iterative algorithms and…

Signal Processing · Electrical Eng. & Systems 2026-02-24 Chentong Li , Saeed Mohammadzadeh , Kanapathippillai Cumanan , Octavia A. Dobre

Binary Neural Networks (BNNs) are showing tremendous success on realistic image classification tasks. Notably, their accuracy is similar to the state-of-the-art accuracy obtained by full-precision models tailored to edge devices. In this…

Hardware Architecture · Computer Science 2022-12-02 Franyell Silfa , Jose Maria Arnau , Antonio González

We propose a Digit-Serial Left-tO-righT (DSLOT) arithmetic based processing technique called DSLOT-NN with aim to accelerate inference of the convolution operation in the deep neural networks (DNNs). The proposed work has the ability to…

Hardware Architecture · Computer Science 2023-09-25 Muhammad Sohail Ibrahim , Muhammad Usman , Malik Zohaib Nisar , Jeong-A Lee

Pruning Deep Neural Networks (DNNs) is a prominent field of study in the goal of inference runtime acceleration. In this paper, we introduce a novel data-free pruning protocol RED++. Only requiring a trained neural network, and not specific…

Machine Learning · Computer Science 2021-10-05 Edouard Yvinec , Arnaud Dapogny , Matthieu Cord , Kevin Bailly

Deep neural networks (DNNs) have enabled smart applications on hardware devices. However, these hardware devices are vulnerable to unintended faults caused by aging, temperature variance, and write errors. These faults can cause bit-flips…

Machine Learning · Computer Science 2024-12-02 Ninnart Fuengfusin , Hakaru Tamukoh

Attention-based Neural Networks (NN) have demonstrated their effectiveness in accurate memory access prediction, an essential step in data prefetching. However, the substantial computational overheads associated with these models result in…

Neural and Evolutionary Computing · Computer Science 2024-02-23 Pengmiao Zhang , Neelesh Gupta , Rajgopal Kannan , Viktor K. Prasanna

We propose a novel approach for channel state information (CSI) compression in multiple-input multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) systems, where the frequency-domain channel matrix is treated as a…

Signal Processing · Electrical Eng. & Systems 2025-02-28 Bumsu Park , Heedong Do , Namyoon Lee

Convolutional neural network (CNN) accelerators are being widely used for their efficiency, but they require a large amount of memory, leading to the use of a slow and power consuming external memory. This paper exploits two schemes to…

Hardware Architecture · Computer Science 2022-12-23 Hyeong-Ju Kang

Batch Normalization (BN) has been proven to be quite effective at accelerating and improving the training of deep neural networks (DNNs). However, BN brings additional computation, consumes more memory and generally slows down the training…

Machine Learning · Computer Science 2019-05-23 Shuang Wu , Guoqi Li , Lei Deng , Liu Liu , Yuan Xie , Luping Shi

In Network on Chip (NoC) rooted system, energy consumption is affected by task scheduling and allocation schemes which affect the performance of the system. In this paper we test the pre-existing proposed algorithms and introduced a new…

Other Computer Science · Computer Science 2014-05-02 Vaibhav Jha , Mohit Jha , GK Sharma

Deep neural networks (DNN) have demonstrated effectiveness for various applications such as image processing, video segmentation, and speech recognition. Running state-of-the-art DNNs on current systems mostly relies on either…

Neural and Evolutionary Computing · Computer Science 2019-04-15 Mohsen Imani , Mohammad Samragh , Yeseong Kim , Saransh Gupta , Farinaz Koushanfar , Tajana Rosing

Acceleration of Convolutional Neural Network (CNN) on edge devices has recently achieved a remarkable performance in image classification and object detection applications. This paper proposes an efficient and scalable CNN-based SoC-FPGA…

Hardware Architecture · Computer Science 2022-07-29 Azzam Alhussain , Mingjie Lin

Learning accurate low-dimensional embeddings for a network is a crucial task as it facilitates many downstream network analytics tasks. For large networks, the trained embeddings often require a significant amount of space to store, making…

Machine Learning · Computer Science 2022-03-22 Tao He , Lianli Gao , Jingkuan Song , Yuan-Fang Li

Dynamic networks have shown their promising capability in reducing theoretical computation complexity by adapting their architectures to the input during inference. However, their practical runtime usually lags behind the theoretical…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Changlin Li , Guangrun Wang , Bing Wang , Xiaodan Liang , Zhihui Li , Xiaojun Chang

A fundamental question in designing lossy data compression schemes is how well one can do in comparison with the rate-distortion function, which describes the known theoretical limits of lossy compression. Motivated by the empirical success…

Information Theory · Computer Science 2024-03-05 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

Compressing DNNs is important for the real-world applications operating on resource-constrained devices. However, we typically observe drastic performance deterioration when changing model size after training is completed. Therefore,…

Machine Learning · Computer Science 2021-09-30 Atsushi Yaguchi , Taiji Suzuki , Shuhei Nitta , Yukinobu Sakata , Akiyuki Tanizawa