English
Related papers

Related papers: No DNN Left Behind: Improving Inference in the Clo…

200 papers

Deep Neural Networks (DNNs) are witnessing increased adoption in multiple domains owing to their high accuracy in solving real-world problems. However, this high accuracy has been achieved by building deeper networks, posing a fundamental…

Machine Learning · Computer Science 2021-01-20 Arjun Balasubramanian , Adarsh Kumar , Yuhan Liu , Han Cao , Shivaram Venkataraman , Aditya Akella

Deep neural networks (DNN) are growing in capability and applicability. Their effectiveness has led to their use in safety critical and autonomous systems, yet there is a dearth of cost-effective methods available for reasoning about the…

Neural and Evolutionary Computing · Computer Science 2019-08-22 David Shriver , Dong Xu , Sebastian Elbaum , Matthew B. Dwyer

Along with the rapid development in the field of artificial intelligence, especially deep learning, deep neural network applications are becoming more and more popular in reality. To be able to withstand the heavy load from mainstream…

Machine Learning · Computer Science 2021-09-27 Toan Pham Van , Ngoc N. Tran , Hoang Pham Minh , Tam Nguyen Minh , Thanh Ta Minh

Many real-time applications (e.g., Augmented/Virtual Reality, cognitive assistance) rely on Deep Neural Networks (DNNs) to process inference tasks. Edge computing is considered a key infrastructure to deploy such applications, as moving…

Due to limited resources on edge and different characteristics of deep neural network (DNN) models, it is a big challenge to optimize DNN inference performance in terms of energy consumption and end-to-end latency on edge devices. In…

Machine Learning · Computer Science 2023-06-26 Ziyang Zhang , Yang Zhao , Huan Li , Changyao Lin , Jie Liu

Recent advances in artificial intelligence have driven increasing intelligent applications at the network edge, such as smart home, smart factory, and smart city. To deploy computationally intensive Deep Neural Networks (DNNs) on…

Networking and Internet Architecture · Computer Science 2020-12-08 Liekang Zeng , Xu Chen , Zhi Zhou , Lei Yang , Junshan Zhang

The inference of Neural Networks is usually restricted by the resources (e.g., computing power, memory, bandwidth) on edge devices. In addition to improving the hardware design and deploying efficient models, it is possible to aggregate the…

Machine Learning · Computer Science 2021-11-05 Jun-Liang Lin , Sheng-De Wang

Deep neural network (DNN) and its variants have been extensively used for a wide spectrum of real applications such as image classification, face/speech recognition, fraud detection, and so on. In addition to many important machine learning…

Databases · Computer Science 2023-01-24 Xiang Lian , Xiaofei Zhang

The recent advances in virtualization technology have enabled the sharing of computing and networking resources of cloud data centers among multiple users. Virtual Network Embedding (VNE) is highly important and is an integral part of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-05 Hiren Kumar Thakkar , Chinmaya Kumar Dehury , Prasan Kumar Sahoo

Deep neural networks (DNNs) have proven to be quite effective in a vast array of machine learning tasks, with recent examples in cyber security and autonomous vehicles. Despite the superior performance of DNNs in these applications, it has…

Machine Learning · Computer Science 2017-08-22 Qinglong Wang , Wenbo Guo , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , Xue Liu , C. Lee Giles

The computation and storage requirements for Deep Neural Networks (DNNs) are usually high. This issue limits their deployability on ubiquitous computing devices such as smart phones, wearables and autonomous drones. In this paper, we…

Machine Learning · Computer Science 2017-02-28 Hande Alemdar , Vincent Leroy , Adrien Prost-Boucle , Frédéric Pétrot

As AI applications for mobile devices become more prevalent, there is an increasing need for faster execution and lower energy consumption for neural model inference. Historically, the models run on mobile devices have been smaller and…

Artificial Intelligence · Computer Science 2020-02-04 Mateen Ulhaq , Ivan V. Bajić

Distributed inference is a popular approach for efficient DNN inference at the edge. However, traditional Static and Dynamic DNNs are not distribution-friendly, causing system reliability and adaptability issues. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Lei Xun , Mingyu Hu , Hengrui Zhao , Amit Kumar Singh , Jonathon Hare , Geoff V. Merrett

Distributed deep neural networks (DNNs) have been shown to reduce the computational burden of mobile devices and decrease the end-to-end inference latency in edge computing scenarios. While distributed DNNs have been studied, to the best of…

Machine Learning · Computer Science 2025-10-02 Milin Zhang , Mohammad Abdi , Jonathan Ashdown , Francesco Restuccia

One of the fundamental problems in network virtualization is Virtual Network Embedding (VNE). The VNE problem deals with finding an effective mapping of the virtual nodes & links onto the substrate network. The recent advances in network…

Networking and Internet Architecture · Computer Science 2016-02-09 Luís Ferrolho , Max Alaluna , Nuno Neves , Fernando M. V. Ramos

Deep Neural Network (DNN) inference is emerging as the fundamental bedrock for a multitude of utilities and services. CPUs continue to scale up their raw compute capabilities for DNN inference along with mature high performance libraries to…

Deep learning models are increasingly used for end-user applications, supporting both novel features such as facial recognition, and traditional features, e.g. web search. To accommodate high inference throughput, it is common to host a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-01 Matthew LeMay , Shijian Li , Tian Guo

Deep transfer learning (DTL) has formed a long-term quest toward enabling deep neural networks (DNNs) to reuse historical experiences as efficiently as humans. This ability is named knowledge transferability. A commonly used paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yixiong Chen , Jingxian Li , Chris Ding , Li Liu

Current developments in Enterprise Systems observe a paradigm shift, moving the needle from the backend to the edge sectors of those; by distributing data, decentralizing applications and integrating novel components seamlessly to the…

Cryptography and Security · Computer Science 2019-07-10 Laurent Gomez , Marcus Wilhelm , José Márquez , Patrick Duverger

Digital twins (DT) have received significant attention due to their numerous benefits, such as real-time data analytics and cost reduction in production. DT serves as a fundamental component of many applications, encompassing smart…

Networking and Internet Architecture · Computer Science 2025-05-08 Chen Chen , Zihan Jia , Ze Wang , Lin Cui , Fung Po Tso