English
Related papers

Related papers: Learning the Optimal Path and DNN Partition for Co…

200 papers

Advances in deep neural networks (DNN) greatly bolster real-time detection of anomalous IoT data. However, IoT devices can hardly afford complex DNN models, and offloading anomaly detection tasks to the cloud incurs long delay. In this…

Machine Learning · Computer Science 2020-04-16 Mao V. Ngo , Tie Luo , Hakima Chaouchi , Tony Q. S. Quek

Several `edge-discovery' applications over graph-based data models are known to have worst-case quadratic time complexity in the nodes, even if the discovered edges are sparse. One example is the generic link discovery problem between two…

Artificial Intelligence · Computer Science 2017-07-04 Mayank Kejriwal

The execution of large deep neural networks (DNN) at mobile edge devices requires considerable consumption of critical resources, such as energy, while imposing demands on hardware capabilities. In approaches based on edge computing the…

Machine Learning · Computer Science 2023-06-23 Juliano S. Assine , J. C. S. Santos Filho , Eduardo Valle , Marco Levorato

Deep Neural Networks (DNNs) are analyzed via the theoretical framework of the information bottleneck (IB) principle. We first show that any DNN can be quantified by the mutual information between the layers and the input and output…

Machine Learning · Computer Science 2015-03-10 Naftali Tishby , Noga Zaslavsky

Edge offloading for deep neural networks (DNNs) can be adaptive to the input's complexity by using early-exit DNNs. These DNNs have side branches throughout their architecture, allowing the inference to end earlier in the edge. The branches…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Roberto G. Pacheco , Fernanda D. V. R. Oliveira , Rodrigo S. Couto

Deep neural networks (DNNs) have inspired new studies in myriad edge applications with robots, autonomous agents, and Internet-of-things (IoT) devices. However, performing inference of DNNs in the edge is still a severe challenge, mainly…

Signal Processing · Electrical Eng. & Systems 2020-11-18 Ramyad Hadidi , Bahar Asgari , Jiashen Cao , Younmin Bae , Da Eun Shim , Hyojong Kim , Sung-Kyu Lim , Michael S. Ryoo , Hyesoon Kim

Despite decades of development, existing IDSs still face challenges in improving detection accuracy, evasion, and detection of unknown attacks. To solve these problems, many researchers have focused on designing and developing IDSs that use…

Cryptography and Security · Computer Science 2025-01-28 Mofe O. Jeje

We study learning to learn for the multi-task structured bandit problem where the goal is to learn a near-optimal algorithm that minimizes cumulative regret. The tasks share a common structure and an algorithm should exploit the shared…

Machine Learning · Computer Science 2025-10-24 Subhojyoti Mukherjee , Josiah P. Hanna , Qiaomin Xie , Robert Nowak

This paper introduces partitioning an inference task of a deep neural network between an edge and a host platform in the IoT environment. We present a DNN as an encoding pipeline, and propose to transmit the output feature space of an…

Computer Vision and Pattern Recognition · Computer Science 2018-02-13 Jong Hwan Ko , Taesik Na , Mohammad Faisal Amir , Saibal Mukhopadhyay

The backpropagation algorithm remains the dominant and most successful method for training deep neural networks (DNNs). At the same time, training DNNs at scale comes at a significant computational cost and therefore a high carbon…

Machine Learning · Computer Science 2025-11-12 Sander Dalm , Joshua Offergeld , Nasir Ahmad , Marcel van Gerven

While many systems have been developed to train Graph Neural Networks (GNNs), efficient model inference and evaluation remain to be addressed. For instance, using the widely adopted node-wise approach, model evaluation can account for up to…

Machine Learning · Computer Science 2022-11-29 Peiqi Yin , Xiao Yan , Jinjing Zhou , Qiang Fu , Zhenkun Cai , James Cheng , Bo Tang , Minjie Wang

Bottleneck identification is a challenging task in network analysis, especially when the network is not fully specified. To address this task, we develop a unified online learning framework based on combinatorial semi-bandits that performs…

Machine Learning · Computer Science 2023-03-07 Fazeleh Hoseini , Niklas Åkerblom , Morteza Haghir Chehreghani

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

Training deep neural networks (DNNs) is computationally expensive, which is problematic especially when performing duplicated or similar training runs in model ensemble or fine-tuning pre-trained models, for example. Once we have trained…

Machine Learning · Computer Science 2023-10-04 Daiki Chijiwa

Split Computing (SC), where a Deep Neural Network (DNN) is intelligently split with a part of it deployed on an edge device and the rest on a remote server is emerging as a promising approach. It allows the power of DNNs to be leveraged for…

Machine Learning · Computer Science 2024-07-09 Luigi Capogrosso , Enrico Fraccaroli , Samarjit Chakraborty , Franco Fummi , Marco Cristani

While Deep Neural Network (DNN) models have provided remarkable advances in machine vision capabilities, their high computational complexity and model sizes present a formidable roadblock to deployment in AIoT-based sensing applications. In…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Kasthuri Jayarajah , Dhanuja Wanniarachchige , Archan Misra

Although distributed machine learning has opened up many new and exciting research frontiers, fragmentation of models and data across different machines, nodes, and sites still results in considerable communication overhead, impeding…

Machine Learning · Computer Science 2022-02-04 Bradley T. Baker , Aashis Khanal , Vince D. Calhoun , Barak Pearlmutter , Sergey M. Plis

The development of artificial intelligence (AI) provides opportunities for the promotion of deep neural network (DNN)-based applications. However, the large amount of parameters and computational complexity of DNN makes it difficult to…

Machine Learning · Computer Science 2023-10-25 Ce Xu , Jinxuan Li , Yuan Liu , Yushi Ling , Miaowen Wen

Many machine learning methods have been recently developed to circumvent the high computational cost of the gradient-based topology optimization. These methods typically require extensive and costly datasets for training, have a difficult…

Machine Learning · Computer Science 2021-05-10 Mohammad Mahdi Behzadi , Horea T. Ilies