English
Related papers

Related papers: Memory-Efficient and Secure DNN Inference on Trust…

200 papers

Deep Neural Networks (DNNs) have become an essential component in many application domains including web-based services. A variety of these services require high throughput and (close to) real-time features, for instance, to respond or…

Machine Learning · Computer Science 2022-09-20 Mohammadamin Abedi , Yanni Iouannou , Pooyan Jamshidi , Hadi Hemmati

With the development of deep learning processors and accelerators, deep learning models have been widely deployed on edge devices as part of the Internet of Things. Edge device models are generally considered as valuable intellectual…

Cryptography and Security · Computer Science 2023-03-24 Jinyin Chen , Haibin Zheng , Tao Liu , Rongchang Li , Yao Cheng , Xuhong Zhang , Shouling Ji

Deep neural network (DNN) inference in energy harvesting (EH) devices poses significant challenges due to resource constraints and frequent power interruptions. These power losses not only increase end-to-end latency, but also compromise…

Computational Engineering, Finance, and Science · Computer Science 2025-03-11 Sahidul Islam , Wei Wei , Jishnu Banarjee , Chen Pan

Deep Neural Networks (DNNs) have been established as the state-of-the-art algorithm for advanced machine learning applications. Recently proposed by the Google Brain's team, the Capsule Networks (CapsNets) have improved the generalization…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Vojtech Mrazek , Muhammad Abdullah Hanif , Muhammad Shafique

We propose distributed deep neural networks (DDNNs) over distributed computing hierarchies, consisting of the cloud, the edge (fog) and end devices. While being able to accommodate inference of a deep neural network (DNN) in the cloud, a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

Deploying large deep neural networks on memory-constrained mobile devices is a central challenge in edge ML. While compression, pruning, and quantization reduce per-parameter cost, transformer-based models remain too large for the 3.3-7.4…

Machine Learning · Computer Science 2026-05-21 Lakshani Manamperi , Disumi Pathirana , Thiwanka Pathirana , Nipun Premarathna , Kutila Gunasekera

Security concerns for IoT applications have been alarming because of their widespread use in different enterprise systems. The potential threats to these applications are constantly emerging and changing, and therefore, sophisticated and…

Cryptography and Security · Computer Science 2022-04-12 Sk. Tanzir Mehedi , Adnan Anwar , Ziaur Rahman , Kawsar Ahmed , Rafiqul Islam

The deployment of deep neural networks (DNNs) on resource-constrained edge devices is frequently hindered by their significant computational and memory requirements. While partitioning and distributing a DNN across multiple devices is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-14 Adiba Masud , Nicholas Foley , Pragathi Durga Rajarajan , Palden Lama

Electrodermal activity (EDA) is widely used in wearable Internet of Medical Things (IoMT) systems for continuous health monitoring, including autonomic assessment. However, EDA signals are highly vulnerable to motion artifacts and…

Signal Processing · Electrical Eng. & Systems 2026-05-08 Yongbin Lee , Andrew Peitzsch , Youngsun Kong , Jarod Zizza , Dong-hee Kang , Farnoush Baghestani , Ki H. Chon

Private inference (PI) has emerged as a promising solution to execute computations on encrypted data, safeguarding user privacy and model parameters in edge computing. However, existing PI methods are predominantly developed considering…

Machine Learning · Computer Science 2024-07-09 Tong Zhou , Jiahui Zhao , Yukui Luo , Xi Xie , Wujie Wen , Caiwen Ding , Xiaolin Xu

As the number of connected IoT devices continues to grow, securing these systems against cyber threats remains a major challenge, especially in environments with limited computational and energy resources. This paper presents an…

Cryptography and Security · Computer Science 2025-11-25 Saeid Jamshidi , Amin Nikanjam , Negar Shahabi , Kawser Wazed Nafi , Foutse Khomh , Samira Keivanpour , Rolando Herrero

User-facing software services are becoming increasingly reliant on remote servers to host Deep Neural Network (DNN) models, which perform inference tasks for the clients. Such services require the client to send input data to the service…

Cryptography and Security · Computer Science 2021-04-07 Sanjay Kariyappa , Ousmane Dia , Moinuddin K Qureshi

Utilization of Machine Learning (ML) algorithms, especially Deep Neural Network (DNN) models, becomes a widely accepted standard in many domains more particularly IoT-based systems. DNN models reach impressive performances in several…

Cryptography and Security · Computer Science 2021-05-05 Raphaël Joud , Pierre-Alain Moellic , Rémi Bernhard , Jean-Baptiste Rigaud

Larger Spiking Neural Network (SNN) models are typically favorable as they can offer higher accuracy. However, employing such models on the resource- and energy-constrained embedded platforms is inefficient. Towards this, we present a…

Neural and Evolutionary Computing · Computer Science 2022-06-20 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Edge machine learning can deliver low-latency and private artificial intelligent (AI) services for mobile devices by leveraging computation and storage resources at the network edge. This paper presents an energy-efficient edge processing…

Information Theory · Computer Science 2020-03-03 Kai Yang , Yuanming Shi , Wei Yu , Zhi Ding

Large Language Models (LLMs) are increasingly deployed on converged Cloud and High-Performance Computing (HPC) infrastructure. However, as LLMs handle confidential inputs and are fine-tuned on costly, proprietary datasets, their heightened…

Performance · Computer Science 2025-09-24 Marcin Chrapek , Marcin Copik , Etienne Mettaz , Torsten Hoefler

Deploying deep learning models on mobile devices draws more and more attention recently. However, designing an efficient inference engine on devices is under the great challenges of model compatibility, device diversity, and resource…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Xiaotang Jiang , Huan Wang , Yiliu Chen , Ziqi Wu , Lichuan Wang , Bin Zou , Yafeng Yang , Zongyang Cui , Yu Cai , Tianhang Yu , Chengfei Lv , Zhihua Wu

Robust speech recognition systems rely on cloud service providers for inference. It needs to ensure that an untrustworthy provider cannot deduce the sensitive content in speech. Sanitization can be done on speech content keeping in mind…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-02 Afsara Benazir , Felix Xiaozhu Lin

The huge computation demand of deep learning models and limited computation resources on the edge devices calls for the cooperation between edge device and cloud service by splitting the deep models into two halves. However, transferring…

Cryptography and Security · Computer Science 2020-01-03 Ruiyuan Gao , Ming Dun , Hailong Yang , Zhongzhi Luan , Depei Qian

Deep Neural Networks (DNNs) have been successfully implemented across various signal processing fields, resulting in significant enhancements in performance. However, DNNs generally require substantial computational resources, leading to…

Signal Processing · Electrical Eng. & Systems 2024-07-09 Shuai Wang , Dehao Zhang , Ammar Belatreche , Yichen Xiao , Hongyu Qing , Wenjie We , Malu Zhang , Yang Yang