English
Related papers

Related papers: Early-exit deep neural networks for distorted imag…

200 papers

Balancing mutually diverging performance metrics, such as end-to-end latency, accuracy, and device energy consumption, is a challenging undertaking for deep neural network (DNN) inference in Just-in-Time edge environments that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-03 Motahare Mounesan , Xiaojie Zhang , Saptarshi Debroy

This paper presents an edge-based defocus blur estimation method from a single defocused image. We first distinguish edges that lie at depth discontinuities (called depth edges, for which the blur estimate is ambiguous) from edges that lie…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Ali Karaali , Naomi Harte , Claudio Rosito Jung

Graph neural networks (GNNs) have become a popular approach to integrating structural inductive biases into NLP models. However, there has been little work on interpreting them, and specifically on understanding which parts of the graphs…

Computation and Language · Computer Science 2022-10-04 Michael Sejr Schlichtkrull , Nicola De Cao , Ivan Titov

Ensembles of Deep Neural Networks (DNNs) have achieved qualitative predictions but they are computing and memory intensive. Therefore, the demand is growing to make them answer a heavy workload of requests with available computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

The record-breaking achievements of deep neural networks (DNNs) in image classification and detection tasks resulted in a surge of new computer vision applications during the past years. However, their computational complexity is…

Image and Video Processing · Electrical Eng. & Systems 2021-06-25 Petar Jokic , Stephane Emery , Luca Benini

Object detection using deep neural networks (DNNs) involves a huge amount of computation which impedes its implementation on resource/energy-limited user-end devices. The reason for the success of DNNs is due to having knowledge over all…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Mohammad Farhadi Bajestani , Mehdi Ghasemi , Sarma Vrudhula , Yezhou Yang

Deep Neural Networks (DNNs) are generally designed as sequentially cascaded differentiable blocks/layers with a prediction module connected only to its last layer. DNNs can be attached with prediction modules at multiple points along the…

Machine Learning · Computer Science 2022-09-21 Hari Narayan N U , Manjesh K. Hanawal , Avinash Bhardwaj

The training of deep and/or convolutional neural networks (DNNs/CNNs) is traditionally done on servers with powerful CPUs and GPUs. Recent efforts have emerged to localize machine learning tasks fully on the edge. This brings advantages in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Pranav Rama , Madison Threadgill , Andreas Gerstlauer

Early-exiting dynamic neural networks (EDNN), as one type of dynamic neural networks, has been widely studied recently. A typical EDNN has multiple prediction heads at different layers of the network backbone. During inference, the model…

Machine Learning · Computer Science 2022-12-01 Haichao Yu , Haoxiang Li , Gang Hua , Gao Huang , Humphrey Shi

Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at…

Neural and Evolutionary Computing · Computer Science 2017-09-07 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

This paper argues that deep neural networks (DNNs) mostly determine their outputs during the early stages of inference, where biases inherent in the model play a crucial role in shaping this process. We draw a parallel between this…

Machine Learning · Computer Science 2025-02-13 Song Park , Sanghyuk Chun , Byeongho Heo , Dongyoon Han

Deep Neural Networks (DNNs) have become an essential component in many application domains including web-based services. A variety of these services require high throughput and (close to) real-time features, for instance, to respond or…

Machine Learning · Computer Science 2022-09-20 Mohammadamin Abedi , Yanni Iouannou , Pooyan Jamshidi , Hadi Hemmati

Many real-time applications (e.g., Augmented/Virtual Reality, cognitive assistance) rely on Deep Neural Networks (DNNs) to process inference tasks. Edge computing is considered a key infrastructure to deploy such applications, as moving…

Partitioning and deploying Deep Neural Networks (DNNs) across edge nodes may be used to meet performance objectives of applications. However, the failure of a single node may result in cascading failures that will adversely impact the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-14 Ayesha Abdul Majeed , Peter Kilpatrick , Ivor Spence , Blesson Varghese

Deep neural networks are generally designed as a stack of differentiable layers, in which a prediction is obtained only after running the full stack. Recently, some contributions have proposed techniques to endow the networks with early…

Neural and Evolutionary Computing · Computer Science 2020-06-24 Simone Scardapane , Michele Scarpiniti , Enzo Baccarelli , Aurelio Uncini

With deep neural networks (DNNs) emerging as the backbone in a multitude of computer vision tasks, their adoption in real-world applications broadens continuously. Given the abundance and omnipresence of smart devices in the consumer…

Machine Learning · Computer Science 2023-08-08 Alexandros Kouris , Stylianos I. Venieris , Stefanos Laskaridis , Nicholas D. Lane

Deploying deep neural networks (DNNs) on IoT and mobile devices is a challenging task due to their limited computational resources. Thus, demanding tasks are often entirely offloaded to edge servers which can accelerate inference, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Arian Bakhtiarnia , Nemanja Milošević , Qi Zhang , Dragana Bajović , Alexandros Iosifidis

Almost in every heavily computation-dependent application, from 6G communication systems to autonomous driving platforms, a large portion of computing should be near to the client side. Edge computing (AI at Edge) in mobile devices is one…

Hardware Architecture · Computer Science 2024-07-29 Seyed Nima Omidsajedi , Rekha Reddy , Jianming Yi , Jan Herbst , Christoph Lipps , Hans Dieter Schotten

Due to limited resources on edge and different characteristics of deep neural network (DNN) models, it is a big challenge to optimize DNN inference performance in terms of energy consumption and end-to-end latency on edge devices. In…

Machine Learning · Computer Science 2023-06-26 Ziyang Zhang , Yang Zhao , Huan Li , Changyao Lin , Jie Liu

As the number of edge devices with computing resources (e.g., embedded GPUs, mobile phones, and laptops) increases, recent studies demonstrate that it can be beneficial to collaboratively run convolutional neural network (CNN) inference on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Xueyu Hou , Yongjie Guan , Tao Han , Ning Zhang