English
Related papers

Related papers: Memory- and Communication-Aware Model Compression …

200 papers

Deep neural networks (DNNs) have provided brilliant performance across various tasks. However, this success often comes at the cost of unnecessarily large model sizes, high computational demands, and substantial memory footprints.…

Machine Learning · Computer Science 2025-11-26 Shaharyar Ahmed Khan Tareen , Filza Khan Tareen

Empowered by deep learning, semantic communication marks a paradigm shift from transmitting raw data to conveying task-relevant meaning, enabling more efficient and intelligent wireless systems. In this study, we explore a deep…

Information Theory · Computer Science 2026-01-28 Chenyang Wang , Roger Olsson , Stefan Forsström , Qing He

Deep neural networks have achieved increasingly accurate results on a wide variety of complex tasks. However, much of this improvement is due to the growing use and availability of computational resources (e.g use of GPUs, more layers, more…

Machine Learning · Computer Science 2018-08-03 Ini Oguntola , Subby Olubeko , Christopher Sweeney

Neural network compression has recently received much attention due to the computational requirements of modern deep models. In this work, our objective is to transfer knowledge from a deep and accurate model to a smaller one. Our…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Vasileios Belagiannis , Azade Farshad , Fabio Galasso

Severe constraints on memory and computation characterizing the Internet-of-Things (IoT) units may prevent the execution of Deep Learning (DL)-based solutions, which typically demand large memory and high processing load. In order to…

Machine Learning · Computer Science 2021-07-30 Simone Disabato , Manuel Roveri , Cesare Alippi

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

Federated learning enables cooperative training among massively distributed clients by sharing their learned local model parameters. However, with increasing model size, deploying federated learning requires a large communication bandwidth,…

Machine Learning · Computer Science 2022-12-13 Rui Song , Liguo Zhou , Lingjuan Lyu , Andreas Festag , Alois Knoll

Deep neural networks (DNNs) have achieved unprecedented success in the field of artificial intelligence (AI), including computer vision, natural language processing and speech recognition. However, their superior performance comes at the…

Machine Learning · Computer Science 2022-04-26 Han Cai , Ji Lin , Yujun Lin , Zhijian Liu , Haotian Tang , Hanrui Wang , Ligeng Zhu , Song Han

Edge intelligent applications like VR/AR and language model based chatbots have become widespread with the rapid expansion of IoT and mobile devices. However, constrained edge devices often cannot serve the increasingly large and complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-28 Zongshun Zhang , Ibrahim Matta

Fully convolutional networks (FCNs) have become de facto tool to achieve very high-level performance for many vision and non-vision tasks in general and face recognition in particular. Such high-level accuracies are normally obtained by…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Jayashree Karlekar , Jiashi Feng , Zi Sian Wong , Sugiri Pranata

In this paper, we investigate how to deploy computational intelligence and deep learning (DL) in edge-enabled industrial IoT networks. In this system, the IoT devices can collaboratively train a shared model without compromising data…

Machine Learning · Computer Science 2021-10-29 Shunpu Tang , Lunyuan Chen , Ke HeJunjuan Xia , Lisheng Fan , Arumugam Nallanathan

Deep learning model compression is an improving and important field for the edge deployment of deep learning models. Given the increasing size of the models and their corresponding power consumption, it is vital to decrease the model size…

Machine Learning · Computer Science 2022-10-12 Madhumitha Sakthi , Niranjan Yadla , Raj Pawate

Device-edge co-inference opens up new possibilities for resource-constrained wireless devices (WDs) to execute deep neural network (DNN)-based applications with heavy computation workloads. In particular, the WD executes the first few…

Machine Learning · Computer Science 2021-05-31 Jia Yan , Suzhi Bi , Ying-Jun Angela Zhang

The computation and storage requirements for Deep Neural Networks (DNNs) are usually high. This issue limits their deployability on ubiquitous computing devices such as smart phones, wearables and autonomous drones. In this paper, we…

Machine Learning · Computer Science 2017-02-28 Hande Alemdar , Vincent Leroy , Adrien Prost-Boucle , Frédéric Pétrot

Deploying trained convolutional neural networks (CNNs) to mobile devices is a challenging task because of the simultaneous requirements of the deployed model to be fast, lightweight and accurate. Designing and training a CNN architecture…

Machine Learning · Computer Science 2019-12-02 Ramit Pahwa , Manoj Ghuhan Arivazhagan , Ankur Garg , Siddarth Krishnamoorthy , Rohit Saxena , Sunav Choudhary

Though deep neural network models exhibit outstanding performance for various applications, their large model size and extensive floating-point operations render deployment on mobile computing platforms a major challenge, and, in…

Cryptography and Security · Computer Science 2022-08-04 Huming Qiu , Hua Ma , Zhi Zhang , Yifeng Zheng , Anmin Fu , Pan Zhou , Yansong Gao , Derek Abbott , Said F. Al-Sarawi

Transformer models are rapidly becoming a cornerstone of modern Internet of Things (IoT) applications, yet their computational and memory demands far exceed the capabilities of a single typical ultra-low-power IoT device. We present CATS, a…

Machine Learning · Computer Science 2026-05-19 Alexander Gräfe , Ding Huo , Vincent de Bakker , Johannes Berger , Marco Zimmerling , Sebastian Trimpe

Although Deep Neural Networks (DNN) have become the backbone technology of several ubiquitous applications, their deployment in resource-constrained machines, e.g., Internet of Things (IoT) devices, is still challenging. To satisfy the…

Machine Learning · Computer Science 2022-08-30 Emna Baccour , Aiman Erbad , Amr Mohamed , Mounir Hamdi , Mohsen Guizani

Deep neural networks (DNNs) have proven to be effective models for accurate Memory Access Prediction (MAP), a critical task in mitigating memory latency through data prefetching. However, existing DNN-based MAP models suffer from the…

Machine Learning · Computer Science 2024-02-22 Neelesh Gupta , Pengmiao Zhang , Rajgopal Kannan , Viktor Prasanna

Event processing is the cornerstone of the dynamic and responsive Internet of Things (IoT). Recent approaches in this area are based on representational state transfer (REST) principles, which allow event processing tasks to be placed at…

Machine Learning · Computer Science 2021-12-08 A. Mazayev , F. Al-Tam , N. Correia