English
Related papers

Related papers: Weightless Neural Networks for Efficient Edge Infe…

200 papers

This paper studies task-oriented edge networks where multiple edge internet-of-things nodes execute machine learning tasks with the help of powerful deep neural networks (DNNs) at a network cloud. Separate edge nodes (ENs) result in a…

Information Theory · Computer Science 2023-12-05 Hoon Lee , Seung-Wook Kim

Weight pruning in deep neural networks (DNNs) can reduce storage and computation cost, but struggles to bring practical speedup to the model inference time. Tensor-cores can significantly boost the throughput of GPUs on dense computation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-15 Guyue Huang , Haoran Li , Minghai Qin , Fei Sun , Yufei Ding , Yuan Xie

Deep neural networks (DNNs) have been widely used to solve partial differential equations (PDEs) in recent years. In this work, a novel deep learning-based framework named Particle Weak-form based Neural Networks (ParticleWNN) is developed…

Machine Learning · Computer Science 2023-11-14 Yaohua Zang , Gang Bao

Despite their tremendous success and versatility, Deep Neural Networks (DNNs) such as Large Language Models (LLMs) suffer from inference inefficiency and rely on advanced computational infrastructure. To address these challenges and make…

Machine Learning · Computer Science 2025-05-05 Mohsen Dehghankar , Mahdi Erfanian , Abolfazl Asudeh

Deep neural networks with more parameters and FLOPs have higher capacity and generalize better to diverse domains. But to be deployed on edge devices, the model's complexity has to be constrained due to limited compute resource. In this…

Machine Learning · Computer Science 2019-12-02 Tianyuan Zhang , Bichen Wu , Xin Wang , Joseph Gonzalez , Kurt Keutzer

Transfer learning has gained significant attention in recent deep learning research due to its ability to accelerate convergence and enhance performance on new tasks. However, its success is often contingent on the similarity between source…

Machine Learning · Computer Science 2024-10-28 Bedionita Soro , Bruno Andreis , Hayeon Lee , Wonyong Jeong , Song Chong , Frank Hutter , Sung Ju Hwang

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

DNN inference can be accelerated by distributing the workload among a cluster of collaborative edge nodes. Heterogeneity among edge devices and accuracy-performance trade-offs of DNN models present a complex exploration space while catering…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-27 Zain Taufique , Antonio Miele , Pasi Liljeberg , Anil Kanduri

Although mission-critical applications require the use of deep neural networks (DNNs), their continuous execution at mobile devices results in a significant increase in energy consumption. While edge offloading can decrease energy…

Machine Learning · Computer Science 2022-09-07 Yoshitomo Matsubara , Davide Callegaro , Sameer Singh , Marco Levorato , Francesco Restuccia

For the past couple of decades, numerical optimization has played a central role in addressing wireless resource management problems such as power control and beamformer design. However, optimization algorithms often entail considerable…

Information Theory · Computer Science 2018-09-18 Haoran Sun , Xiangyi Chen , Qingjiang Shi , Mingyi Hong , Xiao Fu , Nicholas D. Sidiropoulos

Emerging intelligent embedded devices rely on Deep Neural Networks (DNNs) to be able to interact with the real-world environment. This interaction comes with the ability to retrain DNNs, since environmental conditions change continuously in…

Hardware Architecture · Computer Science 2020-10-13 Reza Hojabr , Kamyar Givaki , Kossar Pourahmadi , Parsa Nooralinejad , Ahmad Khonsari , Dara Rahmati , M. Hassan Najafi

Automated feature extraction capability and significant performance of Deep Neural Networks (DNN) make them suitable for Internet of Things (IoT) applications. However, deploying DNN on edge devices becomes prohibitive due to the colossal…

Machine Learning · Computer Science 2022-10-03 Rahul Mishra , Hari Prabhat Gupta

As the backbone technology of machine learning, deep neural networks (DNNs) have have quickly ascended to the spotlight. Running DNNs on resource-constrained mobile devices is, however, by no means trivial, since it incurs high performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-31 En Li , Zhi Zhou , Xu Chen

Hybrid light fidelity (LiFi) and wireless fidelity (WiFi) networks are a promising paradigm of heterogeneous network (HetNet), attributed to the complementary physical properties of optical spectra and radio frequency. However, the current…

Machine Learning · Computer Science 2025-09-09 Han Ji , Xiping Wu , Zhihong Zeng , Chen Chen

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Deep Neural Networks (DNNs) are the de facto algorithm for tackling cognitive tasks in real-world applications such as speech recognition and natural language processing. DNN inference comprises numerous dot product operations between…

Hardware Architecture · Computer Science 2023-11-20 Nitesh Narayana GS , Marc Ordoñez , Lokananda Hari , Franyell Silfa , Antonio González

Binarized Neural Networks (BNNs) significantly reduce the computation and memory demands with binarized weights and activations compared to full-precision NNs. Executing a layer in a BNN on different devices of a heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-13 Leonard David Bereholschi , Ching-Chi Lin , Mikail Yayla , Jian-Jia Chen

Deep Neural Networks (DNNs) have been widely applied in Internet of Things (IoT) systems for various tasks such as image classification and object detection. However, heavyweight DNN models can hardly be deployed on edge devices due to…

Machine Learning · Computer Science 2022-10-12 Tinghao Zhang , Zhijun Li , Yongrui Chen , Kwok-Yan Lam , Jun Zhao

Deep neural networks (DNNs) utilized recently are physically deployed with computational units (e.g., CPUs and GPUs). Such a design might lead to a heavy computational burden, significant latency, and intensive power consumption, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Quan Liu , Hanyu Zheng , Brandon T. Swartz , Ho hin Lee , Zuhayr Asad , Ivan Kravchenko , Jason G. Valentine , Yuankai Huo

Low-latency, energy-efficient deep neural networks (DNNs) inference are critical for edge applications, where traditional cloud-based deployment suffers from high latency and security risks. Field-Programmable Gate Arrays (FPGAs) offer a…

Hardware Architecture · Computer Science 2025-06-10 Zeyu Guo