English
Related papers

Related papers: Efficient and Effective Model Extraction

200 papers

Model extraction is a growing concern for the security of AI systems. For deep neural network models, the architecture is the most important information an adversary aims to recover. Being a sequence of repeated computation blocks, neural…

Cryptography and Security · Computer Science 2024-02-07 Raphael Joud , Pierre-Alain Moellic , Simon Pontie , Jean-Baptiste Rigaud

Model extraction attacks are a kind of attacks where an adversary obtains a machine learning model whose performance is comparable with one of the victim model through queries and their results. This paper presents a novel model extraction…

Cryptography and Security · Computer Science 2021-10-01 Masataka Tasumi , Kazuki Iwahana , Naoto Yanai , Katsunari Shishido , Toshiya Shimizu , Yuji Higuchi , Ikuya Morikawa , Jun Yajima

Machine Learning (ML) models become vulnerable to Model Stealing Attacks (MSA) when they are deployed as a service. In such attacks, the deployed model is queried repeatedly to build a labelled dataset. This dataset allows the attacker to…

Machine Learning · Computer Science 2023-11-09 Akshit Jindal , Vikram Goyal , Saket Anand , Chetan Arora

Document-level Event Argument Extraction (EAE) requires the model to extract arguments of multiple events from a single document. Considering the underlying dependencies between these events, recent efforts leverage the idea of "memory",…

Computation and Language · Computer Science 2023-10-26 Quzhe Huang , Yanxi Zhang , Dongyan Zhao

Model extraction is a severe threat to Machine Learning-as-a-Service systems, especially through data-free approaches, where dishonest users can replicate the functionality of a black-box target model without access to realistic data.…

Machine Learning · Computer Science 2025-09-16 Dat-Thinh Nguyen , Kim-Hung Le , Nhien-An Le-Khac

The collection and availability of big data, combined with advances in pre-trained models (e.g. BERT), have revolutionized the predictive performance of natural language processing tasks. This allows corporations to provide machine learning…

Cryptography and Security · Computer Science 2022-11-01 Xuanli He , Chen Chen , Lingjuan Lyu , Qiongkai Xu

Recently, machine learning (ML) has introduced advanced solutions to many domains. Since ML models provide business advantage to model owners, protecting intellectual property of ML models has emerged as an important consideration.…

Machine Learning · Computer Science 2020-05-28 Buse Gul Atli , Sebastian Szyller , Mika Juuti , Samuel Marchal , N. Asokan

Machine Learning-as-a-Service (MLaaS) has become a widespread paradigm, making even the most complex machine learning models available for clients via e.g. a pay-per-query principle. This allows users to avoid time-consuming processes of…

Machine Learning · Computer Science 2023-06-07 Daryna Oliynyk , Rudolf Mayer , Andreas Rauber

With the increasing size of large language models, layer pruning has gained increased attention as a hardware-friendly approach for model compression. However, existing layer pruning methods struggle to simultaneously address key practical…

Computation and Language · Computer Science 2025-11-24 Tao Yuan , Haoli Bai , Yinfei Pan , Xuyang Cao , Tianyu Zhang , Lu Hou , Ting Hu , Xianzhi Yu

Argument structure extraction (ASE) aims to identify the discourse structure of arguments within documents. Previous research has demonstrated that contextual information is crucial for developing an effective ASE model. However, we observe…

Computation and Language · Computer Science 2023-10-10 Yun Luo , Zhen Yang , Fandong Meng , Yingjie Li , Jie Zhou , Yue Zhang

More tasks in Machine Reading Comprehension(MRC) require, in addition to answer prediction, the extraction of evidence sentences that support the answer. However, the annotation of supporting evidence sentences is usually time-consuming and…

Computation and Language · Computer Science 2022-10-25 Suzhe He , Shumin Shi , Chenghao Wu

In model extraction attacks, the goal is to reveal the parameters of a black-box machine learning model by querying the model for a selected set of data points. Due to an increasing demand for explanations, this may involve counterfactual…

Optimization and Control · Mathematics 2026-03-04 Daan Otto , Jannis Kurtz , Dick den Hertog , Ilker Birbil

Event argument extraction (EAE) is an important task for information extraction to discover specific argument roles. In this study, we cast EAE as a question-based cloze task and empirically analyze fixed discrete token template…

Computation and Language · Computer Science 2023-01-26 Hongbin Ye , Ningyu Zhang , Zhen Bi , Shumin Deng , Chuanqi Tan , Hui Chen , Fei Huang , Huajun Chen

Adversarial extraction attacks constitute an insidious threat against Deep Learning (DL) models in-which an adversary aims to steal the architecture, parameters, and hyper-parameters of a targeted DL model. Existing extraction attack…

Cryptography and Security · Computer Science 2023-02-01 William Hackett , Stefan Trawicki , Zhengxin Yu , Neeraj Suri , Peter Garraghan

With growing popularity, deep learning (DL) models are becoming larger-scale, and only the companies with vast training datasets and immense computing power can manage their business serving such large models. Most of those DL models are…

Artificial Intelligence · Computer Science 2024-03-06 Younghan Lee , Sohee Jun , Yungi Cho , Woorim Han , Hyungon Moon , Yunheung Paek

Information extraction (IE) systems aim to automatically extract structured information, such as named entities, relations between entities, and events, from unstructured texts. While most existing work addresses a particular IE task,…

Computation and Language · Computer Science 2023-05-22 Chang Gao , Wenxuan Zhang , Wai Lam , Lidong Bing

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

Cryptography and Security · Computer Science 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

Training advanced machine learning models demands massive datasets, resulting in prohibitive computational costs. To address this challenge, data pruning techniques identify and remove redundant training samples while preserving model…

Machine Learning · Computer Science 2025-06-23 Sebastian Schmidt , Prasanga Dhungel , Christoffer Löffler , Björn Nieth , Stephan Günnemann , Leo Schwinn

The rise of Machine Learning as a Service (MLaaS) has led to the widespread deployment of machine learning models trained on diverse datasets. These models are employed for predictive services through APIs, raising concerns about the…

Cryptography and Security · Computer Science 2024-03-28 Mahendra Gurve , Sankar Behera , Satyadev Ahlawat , Yamuna Prasad

Neural Architecture Search (NAS) has shown excellent results in designing architectures for computer vision problems. NAS alleviates the need for human-defined settings by automating architecture design and engineering. However, NAS methods…

Machine Learning · Computer Science 2021-10-29 Vasco Lopes , Saeid Alirezazadeh , Luís A. Alexandre