English
Related papers

Related papers: Model Extraction Warning in MLaaS Paradigm

200 papers

Federated Learning (FL) is a popular collaborative learning scheme involving multiple clients and a server. FL focuses on protecting clients' data but turns out to be highly vulnerable to Intellectual Property (IP) threats. Since FL…

Machine Learning · Computer Science 2023-03-16 Jingtao Li , Adnan Siraj Rakin , Xing Chen , Li Yang , Zhezhi He , Deliang Fan , Chaitali Chakrabarti

As Artificial Intelligence (AI) technologies continue to gain traction in the modern-day world, they ultimately pose an immediate threat to current cybersecurity systems via exploitative methods. Prompt engineering is a relatively new field…

Cryptography and Security · Computer Science 2023-12-05 Haiyan Xuan , Mohith Manohar

The text generated by large language models is commonly controlled by prompting, where a prompt prepended to a user's query guides the model's output. The prompts used by companies to guide their models are often treated as secrets, to be…

Computation and Language · Computer Science 2024-08-09 Yiming Zhang , Nicholas Carlini , Daphne Ippolito

Model Extraction attacks exploit the target model's prediction API to create a surrogate model in order to steal or reconnoiter the functionality of the target model in the black-box setting. Several recent studies have shown that a…

Machine Learning · Computer Science 2022-02-25 Amir Mahdi Sadeghzadeh , Amir Mohammad Sobhanian , Faezeh Dehghan , Rasool Jalili

Recently, advances in machine learning techniques have attracted the attention of the research community to build intrusion detection systems (IDS) that can detect anomalies in the network traffic. Most of the research works, however, do…

Cryptography and Security · Computer Science 2018-12-14 Tara Salman , Deval Bhamare , Aiman Erbad , Raj Jain , Mohammed Samaka

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman

Predictive process monitoring is a subfield of process mining that aims to estimate case or event features for running process instances. Such predictions are of significant interest to the process stakeholders. However, most of the…

We study model extraction attacks in natural language processing (NLP) where attackers aim to steal victim models by repeatedly querying the open Application Programming Interfaces (APIs). Recent works focus on limited-query budget settings…

Computation and Language · Computer Science 2023-10-24 Chengwei Dai , Minxuan Lv , Kun Li , Wei Zhou

Model stealing attacks present a dilemma for public machine learning APIs. To protect financial investments, companies may be forced to withhold important information about their models that could facilitate theft, including uncertainty…

Machine Learning · Computer Science 2022-06-29 Mantas Mazeika , Bo Li , David Forsyth

Due to their massive success in various domains, deep learning techniques are increasingly used to design network intrusion detection solutions that detect and mitigate unknown and known attacks with high accuracy detection rates and…

Cryptography and Security · Computer Science 2021-12-08 Huda Ali Alatwi , Charles Morisset

Machine Learning (ML) models are increasingly deployed in the wild to perform a wide range of tasks. In this work, we ask to what extent can an adversary steal functionality of such "victim" models based solely on blackbox interactions:…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Tribhuvanesh Orekondy , Bernt Schiele , Mario Fritz

Public intelligent services enabled by machine learning algorithms are vulnerable to model extraction attacks that can steal confidential information of the learning models through public queries. Though there are some protection options…

Cryptography and Security · Computer Science 2020-11-03 Haonan Yan , Xiaoguang Li , Hui Li , Jiamin Li , Wenhai Sun , Fenghua Li

Operating in a dynamic real world environment requires a forward thinking and adversarial aware design for classifiers, beyond fitting the model to the training data. In such scenarios, it is necessary to make classifiers - a) harder to…

Machine Learning · Computer Science 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic , Lingyu Lyua , Jiashun Chen

This paper investigates a class of attacks targeting the confidentiality aspect of security in Deep Reinforcement Learning (DRL) policies. Recent research have established the vulnerability of supervised machine learning models (e.g.,…

Machine Learning · Computer Science 2019-06-05 Vahid Behzadan , William Hsu

Traditional threat modeling occurs during design, but cloud deployments introduce unanticipated threats, especially multi-stage attacks chaining vulnerabilities across trust boundaries. Existing security tools analyze components in…

Cryptography and Security · Computer Science 2026-03-25 Nicholas Pecka , Lotfi Ben Othmane , Bharat Bhargava , Renee Bryce

Building advanced machine learning (ML) models requires expert knowledge and many trials to discover the best architecture and hyperparameter settings. Previous work demonstrates that model information can be leveraged to assist other…

Cryptography and Security · Computer Science 2023-02-24 Boyang Zhang , Xinlei He , Yun Shen , Tianhao Wang , Yang Zhang

Data-free model stealing involves replicating the functionality of a target model into a substitute model without accessing the target model's structure, parameters, or training data. The adversary can only access the target model's…

Cryptography and Security · Computer Science 2024-12-23 Gaozheng Pei , Shaojie lyu , Ke Ma , Pinci Yang , Qianqian Xu , Yingfei Sun

Machine learning models are widely recognized for their strong performance in forecasting. To keep that performance in streaming data settings, they have to be monitored and frequently re-trained. This can be done with machine learning…

Econometrics · Economics 2025-04-24 Yu Jeffrey Hu , Jeroen Rombouts , Ines Wilms

Adversarial attacks for machine learning models have become a highly studied topic both in academia and industry. These attacks, along with traditional security threats, can compromise confidentiality, integrity, and availability of…

Cryptography and Security · Computer Science 2020-12-10 Jakub Breier , Adrian Baldwin , Helen Balinsky , Yang Liu

This paper details the privacy and security landscape in today's cloud ecosystem and identifies that there is a gap in addressing the risks introduced by machine learning models. As machine learning algorithms continue to evolve and find…

Cryptography and Security · Computer Science 2024-02-05 Alka Luqman , Riya Mahesh , Anupam Chattopadhyay