English
Related papers

Related papers: SAME: Sample Reconstruction against Model Extracti…

200 papers

The security of deep learning (DL) systems is an extremely important field of study as they are being deployed in several applications due to their ever-improving performance to solve challenging tasks. Despite overwhelming promises, the…

Machine Learning · Computer Science 2022-08-19 Manaar Alam , Shubhajit Datta , Debdeep Mukhopadhyay , Arijit Mondal , Partha Pratim Chakrabarti

Model extraction increasingly attracts research attentions as keeping commercial AI models private can retain a competitive advantage. In some scenarios, AI models are trained proprietarily, where neither pre-trained models nor sufficient…

Machine Learning · Computer Science 2021-04-14 Xinyi Zhang , Chengfang Fang , Jie Shi

The proliferation of IoT devices has significantly increased network vulnerabilities, creating an urgent need for effective Intrusion Detection Systems (IDS). Machine Learning-based IDS (ML-IDS) offer advanced detection capabilities but…

Cryptography and Security · Computer Science 2025-02-12 Elvin Li , Zhengli Shang , Onat Gungor , Tajana Rosing

In Self-Supervised Learning (SSL), it is known that frequent occurrences of the collision in which target data and its negative samples share the same class can decrease performance. Especially in real-world data such as crawled data or…

Machine Learning · Computer Science 2022-11-01 Won-Seok Choi , Dong-Sig Han , Hyundo Lee , Junseok Park , Byoung-Tak Zhang

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

Cryptography and Security · Computer Science 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

As deep learning applications, especially programs of computer vision, are increasingly deployed in our lives, we have to think more urgently about the security of these applications.One effective way to improve the security of deep…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Xiao Tan , Jingbo Gao , Ruolin Li

Machine learning models are shown to face a severe threat from Model Extraction Attacks, where a well-trained private model owned by a service provider can be stolen by an attacker pretending as a client. Unfortunately, prior works focus on…

Machine Learning · Computer Science 2021-12-02 Bang Wu , Xiangwen Yang , Shirui Pan , Xingliang Yuan

Language models trained on web-scale corpora risk memorizing and exposing sensitive information, prompting the need for effective machine unlearning. Prior methods mainly focus on input queries to suppress sensitive outputs, yet this often…

Artificial Intelligence · Computer Science 2025-10-01 Junbeom Kim , Kyuyoung Kim , Jihoon Tack , Dongha Lim , Jinwoo Shin

With the rise of large foundation models, split inference (SI) has emerged as a popular computational paradigm for deploying models across lightweight edge devices and cloud servers, addressing data privacy and computational cost concerns.…

Machine Learning · Computer Science 2025-09-16 Wa-Kin Lei , Jun-Cheng Chen , Shang-Tse Chen

Reinforcement learning (RL) has been pivotal in enhancing the reasoning capabilities of large language models (LLMs), but it often suffers from limited exploration and entropy collapse, where models exploit a narrow set of solutions,…

Machine Learning · Computer Science 2025-10-20 Shijia Kang , Muhan Zhang

With the widespread real-world deployment of large language models (LLMs), ensuring their behavior complies with safety standards has become crucial. Jailbreak attacks exploit vulnerabilities in LLMs to induce undesirable behavior, posing a…

Computation and Language · Computer Science 2025-05-26 Jiaqi Wu , Chen Chen , Chunyan Hou , Xiaojie Yuan

Recent work has proposed stateful defense models (SDMs) as a compelling strategy to defend against a black-box attacker who only has query access to the model, as is common for online machine learning platforms. Such stateful defenses aim…

Cryptography and Security · Computer Science 2023-09-27 Ryan Feng , Ashish Hooda , Neal Mangaokar , Kassem Fawaz , Somesh Jha , Atul Prakash

Despite the extent of recent advances in Machine Learning (ML) and Neural Networks, providing formal guarantees on the behavior of these systems is still an open problem, and a crucial requirement for their adoption in regulated or…

Machine Learning · Computer Science 2024-10-01 Matteo Francobaldi , Michele Lombardi

A significant number of machine learning models are vulnerable to model extraction attacks, which focus on stealing the models by using specially curated queries against the target model. This task is well accomplished by using part of the…

Cryptography and Security · Computer Science 2023-08-11 Harshit Shah , Aravindhan G , Pavan Kulkarni , Yuvaraj Govidarajulu , Manojkumar Parmar

Recent studies have shown that deep neural networks (DNN) are vulnerable to adversarial samples: maliciously-perturbed samples crafted to yield incorrect model outputs. Such attacks can severely undermine DNN systems, particularly in…

Machine Learning · Computer Science 2017-04-28 Ji Gao , Beilun Wang , Zeming Lin , Weilin Xu , Yanjun Qi

Model extraction attacks currently pose a non-negligible threat to the security and privacy of deep learning models. By querying the model with a small dataset and usingthe query results as the ground-truth labels, an adversary can steal a…

Cryptography and Security · Computer Science 2024-07-02 Huajie Chen , Tianqing Zhu , Lefeng Zhang , Bo Liu , Derui Wang , Wanlei Zhou , Minhui Xue

Machine unlearning addresses the problem of updating a machine learning model/system trained on a dataset $S$ so that the influence of a set of deletion requests $U \subseteq S$ on the unlearned model is minimized. The gold standard…

Machine Learning · Computer Science 2025-06-09 Linda Lu , Ayush Sekhari , Karthik Sridharan

Adversarial examples are known to mislead deep learning models to incorrectly classify them, even in domains where such models achieve state-of-the-art performance. Until recently, research on both attack and defense methods focused on…

Cryptography and Security · Computer Science 2019-11-22 Ishai Rosenberg , Asaf Shabtai , Yuval Elovici , Lior Rokach

Large language models (LLMs) excel in various tasks but remain vulnerable to jailbreak attacks, where adversaries manipulate prompts to generate harmful outputs. Examining jailbreak prompts helps uncover the shortcomings of LLMs. However,…

Computation and Language · Computer Science 2024-12-18 Weixiong Zheng , Peijian Zeng , Yiwei Li , Hongyan Wu , Nankai Lin , Junhao Chen , Aimin Yang , Yongmei Zhou

The challenge of WAD (web attack detection) is growing as hackers continuously refine their methods to evade traditional detection. Deep learning models excel in handling complex unknown attacks due to their strong generalization and…

Machine Learning · Computer Science 2024-06-19 Lijia Shi , Shihao Dong