English
Related papers

Related papers: A Model Stealing Attack Against Multi-Exit Network…

200 papers

Model extraction is a major threat for embedded deep neural network models that leverages an extended attack surface. Indeed, by physically accessing a device, an adversary may exploit side-channel leakages to extract critical information…

Cryptography and Security · Computer Science 2022-11-11 Raphael Joud , Pierre-Alain Moellic , Simon Pontie , Jean-Baptiste Rigaud

The smartphone and laptop can be unlocked by face or fingerprint recognition, while neural networks which confront numerous requests every day have little capability to distinguish between untrustworthy and credible users. It makes model…

Human-Computer Interaction · Computer Science 2021-03-16 Ge Ren , Jun Wu , Gaolei Li , Shenghong Li

In this work, we propose a method to 'hack' generative models, pushing their outputs away from the original training distribution towards a new objective. We inject a small-scale trainable module between the intermediate layers of the model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Giacomo Aldegheri , Alina Rogalska , Ahmed Youssef , Eugenia Iofinova

Existing data-free model stealing methods use a generator to produce samples in order to train a student model to match the target model outputs. To this end, the two main challenges are estimating gradients of the target model without…

Machine Learning · Computer Science 2023-09-20 James Beetham , Navid Kardan , Ajmal Mian , Mubarak Shah

Deep neural networks have significantly improved performance on a range of tasks with the increasing demand for computational resources, leaving deployment on low-resource devices (with limited memory and battery power) infeasible. Binary…

Machine Learning · Computer Science 2022-06-22 Aaqib Saeed

Machine learning models were shown to be vulnerable to model stealing attacks, which lead to intellectual property infringement. Among other methods, substitute model training is an all-encompassing attack applicable to any machine learning…

Machine Learning · Computer Science 2025-03-11 Daryna Oliynyk , Rudolf Mayer , Andreas Rauber

Graph Neural Networks (GNNs) achieve high performance in various real-world applications, such as drug discovery, traffic states prediction, and recommendation systems. The fact that building powerful GNNs requires a large amount of…

Cryptography and Security · Computer Science 2025-08-29 Jing Xu , Franziska Boenisch , Adam Dziedzic

Uncertainty estimation for machine learning models is of high importance in many scenarios such as constructing the confidence intervals for model predictions and detection of out-of-distribution or adversarially generated points. In this…

Machine Learning · Computer Science 2022-05-06 Kirill Fedyanin , Evgenii Tsymbalov , Maxim Panov

Graph Neural Networks (GNNs) have shown promising results in modeling graphs in various tasks. The training of GNNs, especially on specialized tasks such as bioinformatics, demands extensive expert annotations, which are expensive and…

Machine Learning · Computer Science 2025-05-27 Minhua Lin , Enyan Dai , Junjie Xu , Jinyuan Jia , Xiang Zhang , Suhang Wang

Multi-exit network is a promising architecture for efficient model inference by sharing backbone networks and weights among multiple exits. However, the gradient conflict of the shared weights results in sub-optimal accuracy. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Cheng Gong , Yao Chen , Qiuyang Luo , Ye Lu , Tao Li , Yuzhi Zhang , Yufei Sun , Le Zhang

With growing popularity, deep learning (DL) models are becoming larger-scale, and only the companies with vast training datasets and immense computing power can manage their business serving such large models. Most of those DL models are…

Artificial Intelligence · Computer Science 2024-03-06 Younghan Lee , Sohee Jun , Yungi Cho , Woorim Han , Hyungon Moon , Yunheung Paek

Building advanced machine learning (ML) models requires expert knowledge and many trials to discover the best architecture and hyperparameter settings. Previous work demonstrates that model information can be leveraged to assist other…

Cryptography and Security · Computer Science 2023-02-24 Boyang Zhang , Xinlei He , Yun Shen , Tianhao Wang , Yang Zhang

Deep Neural Network (DNN) models are often deployed in resource-sharing clouds as Machine Learning as a Service (MLaaS) to provide inference services.To steal model architectures that are of valuable intellectual properties, a class of…

Cryptography and Security · Computer Science 2023-09-22 Yansong Gao , Huming Qiu , Zhi Zhang , Binghui Wang , Hua Ma , Alsharif Abuadbba , Minhui Xue , Anmin Fu , Surya Nepal

Model extraction attacks are a kind of attacks where an adversary obtains a machine learning model whose performance is comparable with one of the victim model through queries and their results. This paper presents a novel model extraction…

Cryptography and Security · Computer Science 2021-10-01 Masataka Tasumi , Kazuki Iwahana , Naoto Yanai , Katsunari Shishido , Toshiya Shimizu , Yuji Higuchi , Ikuya Morikawa , Jun Yajima

In Large Language Model (LLM) inference, early-exit refers to stopping computation at an intermediate layer once the prediction is sufficiently confident, thereby reducing latency and cost. However, recent LLMs adopt improved pretraining…

Computation and Language · Computer Science 2026-03-26 Rui Wei , Rui Du , Hanfei Yu , Devesh Tiwari , Jian Li , Zhaozhuo Xu , Hao Wang

Deep neural networks have long training and processing times. Early exits added to neural networks allow the network to make early predictions using intermediate activations in the network in time-sensitive applications. However, early…

Machine Learning · Computer Science 2022-12-27 Devdhar Patel , Hava Siegelmann

Data-free model stealing involves replicating the functionality of a target model into a substitute model without accessing the target model's structure, parameters, or training data. The adversary can only access the target model's…

Cryptography and Security · Computer Science 2024-12-23 Gaozheng Pei , Shaojie lyu , Ke Ma , Pinci Yang , Qianqian Xu , Yingfei Sun

As neural networks continue their reach into nearly every aspect of software operations, the details of those networks become an increasingly sensitive subject. Even those that deploy neural networks embedded in physical devices may wish to…

Cryptography and Security · Computer Science 2020-06-23 Xing Hu , Ling Liang , Lei Deng , Shuangchen Li , Xinfeng Xie , Yu Ji , Yufei Ding , Chang Liu , Timothy Sherwood , Yuan Xie

Today, machine learning is widely applied in sensitive, security-related, and financially lucrative applications. Model extraction attacks undermine current business models where a model owner sells model access, e.g., via MLaaS APIs.…

Cryptography and Security · Computer Science 2026-04-22 Jonas Sander , Anja Rabich , Nick Mahling , Felix Maurer , Jonah Heller , Qifan Wang , Thomas Eisenbarth , David Oswald

The widespread use of deep learning technology across various industries has made deep neural network models highly valuable and, as a result, attractive targets for potential attackers. Model extraction attacks, particularly query-based…

Cryptography and Security · Computer Science 2023-12-25 Zeyu Li , Chenghui Shi , Yuwen Pu , Xuhong Zhang , Yu Li , Jinbao Li , Shouling Ji