English
Related papers

Related papers: A Model Stealing Attack Against Multi-Exit Network…

200 papers

In privacy-preserving machine learning, it is common that the owner of the learned model does not have any physical access to the data. Instead, only a secured remote access to a data lake is granted to the model owner without any ability…

Cryptography and Security · Computer Science 2022-06-08 Huiyu Li , Nicholas Ayache , Hervé Delingette

Early-Exit Deep Neural Networks enable adaptive inference by allowing prediction at intermediary layers, significantly reducing computational costs and latency. Most of the early exit strategies greedily exit a sample at an intermediary…

Machine Learning · Computer Science 2025-09-30 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

In this paper, we propose a model-driven deep learning network for multiple-input multiple-output (MIMO) detection. The structure of the network is specially designed by unfolding the iterative algorithm. Some trainable parameters are…

Information Theory · Computer Science 2018-09-26 Hengtao He , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

We present an approach to adaptively utilize deep neural networks in order to reduce the evaluation time on new examples without loss of accuracy. Rather than attempting to redesign or approximate existing networks, we propose two schemes…

Machine Learning · Computer Science 2017-09-20 Tolga Bolukbasi , Joseph Wang , Ofer Dekel , Venkatesh Saligrama

Large language models have achieved remarkable capabilities, but their practical deployment is hindered by significant computational costs. While adaptive computation methods like early-exiting promise to reduce these costs, they introduce…

Computation and Language · Computer Science 2025-12-16 Sangmin Bae

Deep neural networks are normally executed in the forward direction. However, in this work, we identify a vulnerability that enables models to be trained in both directions and on different tasks. Adversaries can exploit this capability to…

Machine Learning · Computer Science 2024-05-20 Guy Amit , Mosh Levy , Yisroel Mirsky

We argue that the machine learning problem of model extraction is actually a cryptanalytic problem in disguise, and should be studied as such. Given oracle access to a neural network, we introduce a differential attack that can efficiently…

Machine Learning · Computer Science 2020-07-23 Nicholas Carlini , Matthew Jagielski , Ilya Mironov

Model extraction attacks are designed to steal trained models with only query access, as is often provided through APIs that ML-as-a-Service providers offer. Machine Learning (ML) models are expensive to train, in part because data is hard…

Machine Learning · Computer Science 2024-06-14 Avital Shafran , Ilia Shumailov , Murat A. Erdogdu , Nicolas Papernot

Deep Neural Networks (DNNs) have grown increasingly large in size to achieve state of the art performance across a wide range of tasks. However, their high computational requirements make them less suitable for resource-constrained…

Machine Learning · Computer Science 2025-01-15 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

High-performance Deep Neural Networks (DNNs) are increasingly deployed in many real-world applications e.g., cloud prediction APIs. Recent advances in model functionality stealing attacks via black-box access (i.e., inputs in, predictions…

Machine Learning · Computer Science 2020-03-04 Tribhuvanesh Orekondy , Bernt Schiele , Mario Fritz

Despite much success in natural language processing (NLP), pre-trained language models typically lead to a high computational cost during inference. Multi-exit is a mainstream approach to address this issue by making a trade-off between…

Computation and Language · Computer Science 2023-05-23 Yiming Chen , Simin Chen , Zexin Li , Wei Yang , Cong Liu , Robby T. Tan , Haizhou Li

Many real-world data come in the form of graphs. Graph neural networks (GNNs), a new family of machine learning (ML) models, have been proposed to fully leverage graph data to build powerful applications. In particular, the inductive GNNs,…

Cryptography and Security · Computer Science 2021-12-16 Yun Shen , Xinlei He , Yufei Han , Yang Zhang

Deep neural networks (DNNs) have been successfully applied in various fields. In DNNs, a large number of multiply-accumulate (MAC) operations are required to be performed, posing critical challenges in applying them in resource-constrained…

Machine Learning · Computer Science 2024-02-20 Jingcun Wang , Bing Li , Grace Li Zhang

Early-exiting neural networks enable adaptive inference by allowing inputs to exit at intermediate classifiers, reducing computation for easy samples while maintaining high accuracy. In practice, exits can be trained sequentially by…

Machine Learning · Computer Science 2026-05-08 Alaa Zniber , Ouassim Karrakchou , Mounir Ghogho

Neural networks are often trained on proprietary datasets, making them attractive attack targets. We present a novel dataset extraction method leveraging an innovative training time backdoor attack, allowing a malicious federated learning…

Cryptography and Security · Computer Science 2025-12-19 Eden Luzon , Guy Amit , Roy Weiss , Torsten Kraub , Alexandra Dmitrienko , Yisroel Mirsky

Model Extraction Attacks (MEAs) threaten modern machine learning systems by enabling adversaries to steal models, exposing intellectual property and training data. With the increasing deployment of machine learning models in distributed…

Cryptography and Security · Computer Science 2025-02-25 Kaixiang Zhao , Lincan Li , Kaize Ding , Neil Zhenqiang Gong , Yue Zhao , Yushun Dong

Model extraction aims to create a functionally similar copy from a machine learning as a service (MLaaS) API with minimal overhead, typically for illicit profit or as a precursor to further attacks, posing a significant threat to the MLaaS…

Cryptography and Security · Computer Science 2024-09-25 Hongyu Zhu , Wentao Hu , Sichu Liang , Fangqi Li , Wenwen Wang , Shilin Wang

Deep machine learning models are increasingly deployedin the wild for providing services to users. Adversaries maysteal the knowledge of these valuable models by trainingsubstitute models according to the inference results of thetargeted…

Cryptography and Security · Computer Science 2022-02-02 Chi Hong , Jiyue Huang , Lydia Y. Chen

Model extraction attacks are one type of inference-time attacks that approximate the functionality and performance of a black-box victim model by launching a certain number of queries to the model and then leveraging the model's predictions…

Cryptography and Security · Computer Science 2025-01-03 Yixu Wang , Tianle Gu , Yan Teng , Yingchun Wang , Xingjun Ma

Deploying deep learning services for time-sensitive and resource-constrained settings such as IoT using edge computing systems is a challenging task that requires dynamic adjustment of inference time. Multi-exit architectures allow deep…

Machine Learning · Computer Science 2021-04-23 Arian Bakhtiarnia , Qi Zhang , Alexandros Iosifidis