English
Related papers

Related papers: Memory-Efficient and Secure DNN Inference on Trust…

200 papers

Data privacy concerns often prevent the use of cloud-based machine learning services for sensitive personal data. While homomorphic encryption (HE) offers a potential solution by enabling computations on encrypted data, the challenge is to…

Cryptography and Security · Computer Science 2021-03-08 Kanthi Sarpatwar , Karthik Nandakumar , Nalini Ratha , James Rayfield , Karthikeyan Shanmugam , Sharath Pankanti , Roman Vaculin

MLaaS (Machine Learning as a Service) has become popular in the cloud computing domain, allowing users to leverage cloud resources for running private inference of ML models on their data. However, ensuring user input privacy and secure…

Cryptography and Security · Computer Science 2024-04-12 Kishore Rajasekar , Randolph Loh , Kar Wai Fok , Vrizlynn L. L. Thing

Privacy and security-related concerns are growing as machine learning reaches diverse application domains. The data holders want to train or infer with private data while exploiting accelerators, such as GPUs, that are hosted in the cloud.…

Cryptography and Security · Computer Science 2022-07-04 Hanieh Hashemi , Yongqin Wang , Murali Annavaram

With the increased usage of AI accelerators on mobile and edge devices, on-device machine learning (ML) is gaining popularity. Thousands of proprietary ML models are being deployed today on billions of untrusted devices. This raises serious…

Cryptography and Security · Computer Science 2023-07-07 Zhichuang Sun , Ruimin Sun , Changming Liu , Amrita Roy Chowdhury , Long Lu , Somesh Jha

The rapid deployment of deep neural network (DNN) accelerators in safety-critical domains such as autonomous vehicles, healthcare systems, and financial infrastructure necessitates robust mechanisms to safeguard data confidentiality and…

Cryptography and Security · Computer Science 2026-02-25 Wei Xuan , Zihao Xuan , Rongliang Fu , Ning Lin , Kwunhang Wong , Zikang Yuan , Lang Feng , Zhongrui Wang , Tsung-Yi Ho , Yuzhong Jiao , Luhong Liang

As a key technology of enabling Artificial Intelligence (AI) applications in 5G era, Deep Neural Networks (DNNs) have quickly attracted widespread attention. However, it is challenging to run computation-intensive DNN-based tasks on mobile…

Networking and Internet Architecture · Computer Science 2019-10-14 En Li , Liekang Zeng , Zhi Zhou , Xu Chen

With the edge computing becoming an increasingly adopted concept in system architectures, it is expected its utilization will be additionally heightened when combined with deep learning (DL) techniques. The idea behind integrating demanding…

Networking and Internet Architecture · Computer Science 2020-03-12 Mounir Bensalem , Jasenka Dizdarević , Admela Jukan

Deep neural networks (DNNs) have succeeded in many different perception tasks, e.g., computer vision, natural language processing, reinforcement learning, etc. The high-performed DNNs heavily rely on intensive resource consumption. For…

Machine Learning · Computer Science 2022-10-10 Zhongnan Qu

Deploying deep neural networks (DNNs) on resource-constrained mobile devices presents significant challenges, particularly in achieving real-time performance while simultaneously coping with limited computational resources and battery life.…

Networking and Internet Architecture · Computer Science 2025-09-24 Zekai Sun , Xiuxian Guan , Zheng Lin , Zihan Fang , Xiangming Cai , Zhe Chen , Fangming Liu , Heming Cui , Jie Xiong , Wei Ni , Chau Yuen

On-device ML introduces new security challenges: DNN models become white-box accessible to device users. Based on white-box information, adversaries can conduct effective model stealing (MS) and membership inference attack (MIA). Using…

Cryptography and Security · Computer Science 2023-10-12 Ziqi Zhang , Chen Gong , Yifeng Cai , Yuanyuan Yuan , Bingyan Liu , Ding Li , Yao Guo , Xiangqun Chen

Deep neural networks (DNN) have achieved remarkable success in computer vision (CV). However, training and inference of DNN models are both memory and computation intensive, incurring significant overhead in terms of energy consumption and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Tao Luo , Wai Teng Tang , Matthew Kay Fei Lee , Chuping Qu , Weng-Fai Wong , Rick Goh

Machine learning models based on Deep Neural Networks (DNNs) are increasingly deployed in a wide range of applications ranging from self-driving cars to COVID-19 treatment discovery. To support the computational power necessary to learn a…

Cryptography and Security · Computer Science 2020-10-20 Aref Asvadishirehjini , Murat Kantarcioglu , Bradley Malin

CPU-based trusted execution environments (TEEs) and differential privacy (DP) have gained wide applications for private inference. Due to high inference latency in TEEs, researchers use partition-based approaches that offload linear model…

Cryptography and Security · Computer Science 2025-09-12 Honglan Yu , Yibin Wang , Feifei Dai , Dong Liu , Haihui Fan , Xiaoyan Gu

The effectiveness of deep neural networks (DNN) in vision, speech, and language processing has prompted a tremendous demand for energy-efficient high-performance DNN inference systems. Due to the increasing memory intensity of most DNN…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-15 Skanda Koppula , Lois Orosa , Abdullah Giray Yağlıkçı , Roknoddin Azizi , Taha Shahroodi , Konstantinos Kanellopoulos , Onur Mutlu

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Edge nodes are crucial for detection against multitudes of cyber attacks on Internet-of-Things endpoints and is set to become part of a multi-billion industry. The resource constraints in this novel network infrastructure tier constricts…

Cryptography and Security · Computer Science 2022-07-07 Praneet Singh , Jishnu Jaykumar , Akhil Pankaj , Reshmi Mitra

The proliferation of smart and autonomous systems has motivated a shift toward executing intelligence directly on edge devices. This shift becomes particularly challenging for zero-energy devices (ZEDs), where severe constraints on memory,…

Signal Processing · Electrical Eng. & Systems 2026-03-10 Shahab Jahanbazi , Mateen Ashraf , Lieven De Strycker , Jeroen Famaey , Onel L. A. Lopez

Deep Neural Network (DNN) workloads are quickly moving from datacenters onto edge devices, for latency, privacy, or energy reasons. While datacenter networks can be protected using conventional cybersecurity measures, edge neural networks…

Cryptography and Security · Computer Science 2019-11-28 Mihailo Isakov , Vijay Gadepally , Karen M. Gettings , Michel A. Kinsy

Despite showing state-of-the-art performance, deep learning for speech recognition remains challenging to deploy in on-device edge scenarios such as mobile and other consumer devices. Recently, there have been greater efforts in the design…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-15 Zhong Qiu Lin , Audrey G. Chung , Alexander Wong

This paper proposes a hardware-aware intrusion detection system (IDS) for Internet of Things (IoT) and Industrial IoT (IIoT) networks; it targets scenarios where classification is essential for fast, privacy-preserving, and…

Networking and Internet Architecture · Computer Science 2025-12-09 Ali Diab , Adel Chehade , Edoardo Ragusa , Paolo Gastaldo , Rodolfo Zunino , Amer Baghdadi , Mostafa Rizk