English
Related papers

Related papers: Enhancing Split Computing and Early Exit Applicati…

200 papers

The MIT/IEEE/Amazon GraphChallenge.org encourages community approaches to developing new solutions for analyzing graphs and sparse data. Sparse AI analytics present unique scalability difficulties. The Sparse Deep Neural Network (DNN)…

Machine Learning · Computer Science 2020-12-24 Jeremy Kepner , Simon Alford , Vijay Gadepally , Michael Jones , Lauren Milechin , Albert Reuther , Ryan Robinett , Sid Samsi

Many recent pattern recognition applications rely on complex distributed architectures in which sensing and computational nodes interact together through a communication network. Deep neural networks (DNNs) play an important role in this…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-23 Luigi Capogrosso , Federico Cunico , Michele Lora , Marco Cristani , Franco Fummi , Davide Quaglia

The success of deep neural networks (DNNs) is attributable to three factors: increased compute capacity, more complex models, and more data. These factors, however, are not always present, especially for edge applications such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Bichen Wu

Recently, edge computing has emerged as a promising paradigm to support mobile access in IoT multinetworks. However, coexistence of heterogeneous wireless communication schemes brings about new challenges to the mobility management and…

Networking and Internet Architecture · Computer Science 2021-04-07 Di Wu , Xiang Nie , Hanhui Deng , Zhijin Qin

Even the AI has been widely used and significantly changed our life, deploying the large AI models on resource limited edge devices directly is not appropriate. Thus, the model split inference is proposed to improve the performance of edge…

Machine Learning · Computer Science 2024-09-26 Xin Yuan , Ning Li , Quan Chen , Wenchao Xu , Zhaoxin Zhang , Song Guo

Computer vision on low-power edge devices enables applications including search-and-rescue and security. State-of-the-art computer vision algorithms, such as Deep Neural Networks (DNNs), are too large for inference on low-power edge…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Abhinav Goel , Caleb Tung , Xiao Hu , George K. Thiruvathukal , James C. Davis , Yung-Hsiang Lu

Energy-harvesting technology provides a promising platform for future IoT applications. However, since communication is very expensive in these devices, applications will require inference "beyond the edge" to avoid wasting precious energy…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Graham Gobieski , Nathan Beckmann , Brandon Lucia

Wearable devices are revolutionizing personal technology, but their usability is often hindered by frequent charging due to high power consumption. This paper introduces Distributed Neural Networks (DistNN), a framework that distributes…

Emerging Technologies · Computer Science 2025-09-19 Meghna Roy Chowdhury , Ming-che Li , Archisman Ghosh , Md Faizul Bari , Shreyas Sen

Deep neural networks provide state-of-the-art accuracy for vision tasks but they require significant resources for training. Thus, they are trained on cloud servers far from the edge devices that acquire the data. This issue increases…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Yamin Sepehri , Pedram Pad , Ahmet Caner Yüzügüler , Pascal Frossard , L. Andrea Dunbar

Continual learning on edge devices poses unique challenges due to stringent resource constraints. This paper introduces a novel method that leverages stochastic competition principles to promote sparsity, significantly reducing deep network…

Machine Learning · Computer Science 2024-07-16 Theodoros Christophides , Kyriakos Tolias , Sotirios Chatzis

Deep neural networks (DNNs) are currently widely used for many artificial intelligence (AI) applications including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Vivienne Sze , Yu-Hsin Chen , Tien-Ju Yang , Joel Emer

The enormous and ever-increasing complexity of state-of-the-art neural networks (NNs) has impeded the deployment of deep learning on resource-limited devices such as the Internet of Things (IoTs). Stochastic computing exploits the inherent…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Alireza Khadem

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Fuqiang Liu , C. Liu

Early Exiting (EE) is a promising technique for speeding up inference by adaptively allocating compute resources to data points based on their difficulty. The approach enables predictions to exit at earlier layers for simpler samples while…

Machine Learning · Computer Science 2024-12-30 Mehrnaz Mofakhami , Reza Bayat , Ioannis Mitliagkas , Joao Monteiro , Valentina Zantedeschi

The rise of Deep Neural Networks (DNNs) has led to an increase in model size and complexity, straining the memory capacity of GPUs. Sparsity in DNNs, characterized as structural or ephemeral, has gained attention as a solution. This work…

Machine Learning · Computer Science 2023-11-30 Daniel Barley , Holger Fröning

Mobile Edge Computing (MEC) is a promising approach for enhancing the quality-of-service (QoS) of AI-enabled applications in the B5G/6G era, by bringing computation capability closer to end-users at the network edge. In this work, we…

Networking and Internet Architecture · Computer Science 2025-11-25 Huaizhe Liu , Jiaqi Wu , Zhizongkai Wang , Bin Cao , Lin Gao

Emerging resistive random-access memory (ReRAM) has recently been intensively investigated to accelerate the processing of deep neural networks (DNNs). Due to the in-situ computation capability, analog ReRAM crossbars yield significant…

Machine Learning · Computer Science 2019-11-21 Jingyang Zhang , Huanrui Yang , Fan Chen , Yitu Wang , Hai Li

The increasingly deeper neural networks hinder the democratization of privacy-enhancing distributed learning, such as federated learning (FL), to resource-constrained devices. To overcome this challenge, in this paper, we advocate the…

Machine Learning · Computer Science 2024-01-25 Zheng Lin , Guangyu Zhu , Yiqin Deng , Xianhao Chen , Yue Gao , Kaibin Huang , Yuguang Fang

Spiking Neural Networks (SNNs) are highly efficient due to their spike-based activation, which inherently produces bit-sparse computation patterns. Existing hardware implementations of SNNs leverage this sparsity pattern to avoid wasteful…

Hardware Architecture · Computer Science 2025-04-04 Chiyue Wei , Cong Guo , Feng Cheng , Shiyu Li , Hao "Frank" Yang , Hai "Helen" Li , Yiran Chen

Deep Neural Networks (DNNs) have become an essential component in many application domains including web-based services. A variety of these services require high throughput and (close to) real-time features, for instance, to respond or…

Machine Learning · Computer Science 2022-09-20 Mohammadamin Abedi , Yanni Iouannou , Pooyan Jamshidi , Hadi Hemmati