中文
相关论文

相关论文: SAME: Sample Reconstruction against Model Extracti…

200 篇论文

The security of deep learning (DL) systems is an extremely important field of study as they are being deployed in several applications due to their ever-improving performance to solve challenging tasks. Despite overwhelming promises, the…

机器学习 · 计算机科学 2022-08-19 Manaar Alam , Shubhajit Datta , Debdeep Mukhopadhyay , Arijit Mondal , Partha Pratim Chakrabarti

Model extraction increasingly attracts research attentions as keeping commercial AI models private can retain a competitive advantage. In some scenarios, AI models are trained proprietarily, where neither pre-trained models nor sufficient…

机器学习 · 计算机科学 2021-04-14 Xinyi Zhang , Chengfang Fang , Jie Shi

The proliferation of IoT devices has significantly increased network vulnerabilities, creating an urgent need for effective Intrusion Detection Systems (IDS). Machine Learning-based IDS (ML-IDS) offer advanced detection capabilities but…

密码学与安全 · 计算机科学 2025-02-12 Elvin Li , Zhengli Shang , Onat Gungor , Tajana Rosing

In Self-Supervised Learning (SSL), it is known that frequent occurrences of the collision in which target data and its negative samples share the same class can decrease performance. Especially in real-world data such as crawled data or…

机器学习 · 计算机科学 2022-11-01 Won-Seok Choi , Dong-Sig Han , Hyundo Lee , Junseok Park , Byoung-Tak Zhang

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

密码学与安全 · 计算机科学 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

As deep learning applications, especially programs of computer vision, are increasingly deployed in our lives, we have to think more urgently about the security of these applications.One effective way to improve the security of deep…

计算机视觉与模式识别 · 计算机科学 2022-06-02 Xiao Tan , Jingbo Gao , Ruolin Li

Machine learning models are shown to face a severe threat from Model Extraction Attacks, where a well-trained private model owned by a service provider can be stolen by an attacker pretending as a client. Unfortunately, prior works focus on…

机器学习 · 计算机科学 2021-12-02 Bang Wu , Xiangwen Yang , Shirui Pan , Xingliang Yuan

Language models trained on web-scale corpora risk memorizing and exposing sensitive information, prompting the need for effective machine unlearning. Prior methods mainly focus on input queries to suppress sensitive outputs, yet this often…

人工智能 · 计算机科学 2025-10-01 Junbeom Kim , Kyuyoung Kim , Jihoon Tack , Dongha Lim , Jinwoo Shin

With the rise of large foundation models, split inference (SI) has emerged as a popular computational paradigm for deploying models across lightweight edge devices and cloud servers, addressing data privacy and computational cost concerns.…

机器学习 · 计算机科学 2025-09-16 Wa-Kin Lei , Jun-Cheng Chen , Shang-Tse Chen

Reinforcement learning (RL) has been pivotal in enhancing the reasoning capabilities of large language models (LLMs), but it often suffers from limited exploration and entropy collapse, where models exploit a narrow set of solutions,…

机器学习 · 计算机科学 2025-10-20 Shijia Kang , Muhan Zhang

With the widespread real-world deployment of large language models (LLMs), ensuring their behavior complies with safety standards has become crucial. Jailbreak attacks exploit vulnerabilities in LLMs to induce undesirable behavior, posing a…

计算与语言 · 计算机科学 2025-05-26 Jiaqi Wu , Chen Chen , Chunyan Hou , Xiaojie Yuan

Recent work has proposed stateful defense models (SDMs) as a compelling strategy to defend against a black-box attacker who only has query access to the model, as is common for online machine learning platforms. Such stateful defenses aim…

密码学与安全 · 计算机科学 2023-09-27 Ryan Feng , Ashish Hooda , Neal Mangaokar , Kassem Fawaz , Somesh Jha , Atul Prakash

Despite the extent of recent advances in Machine Learning (ML) and Neural Networks, providing formal guarantees on the behavior of these systems is still an open problem, and a crucial requirement for their adoption in regulated or…

机器学习 · 计算机科学 2024-10-01 Matteo Francobaldi , Michele Lombardi

A significant number of machine learning models are vulnerable to model extraction attacks, which focus on stealing the models by using specially curated queries against the target model. This task is well accomplished by using part of the…

密码学与安全 · 计算机科学 2023-08-11 Harshit Shah , Aravindhan G , Pavan Kulkarni , Yuvaraj Govidarajulu , Manojkumar Parmar

Recent studies have shown that deep neural networks (DNN) are vulnerable to adversarial samples: maliciously-perturbed samples crafted to yield incorrect model outputs. Such attacks can severely undermine DNN systems, particularly in…

机器学习 · 计算机科学 2017-04-28 Ji Gao , Beilun Wang , Zeming Lin , Weilin Xu , Yanjun Qi

Model extraction attacks currently pose a non-negligible threat to the security and privacy of deep learning models. By querying the model with a small dataset and usingthe query results as the ground-truth labels, an adversary can steal a…

密码学与安全 · 计算机科学 2024-07-02 Huajie Chen , Tianqing Zhu , Lefeng Zhang , Bo Liu , Derui Wang , Wanlei Zhou , Minhui Xue

Machine unlearning addresses the problem of updating a machine learning model/system trained on a dataset $S$ so that the influence of a set of deletion requests $U \subseteq S$ on the unlearned model is minimized. The gold standard…

机器学习 · 计算机科学 2025-06-09 Linda Lu , Ayush Sekhari , Karthik Sridharan

Adversarial examples are known to mislead deep learning models to incorrectly classify them, even in domains where such models achieve state-of-the-art performance. Until recently, research on both attack and defense methods focused on…

密码学与安全 · 计算机科学 2019-11-22 Ishai Rosenberg , Asaf Shabtai , Yuval Elovici , Lior Rokach

Large language models (LLMs) excel in various tasks but remain vulnerable to jailbreak attacks, where adversaries manipulate prompts to generate harmful outputs. Examining jailbreak prompts helps uncover the shortcomings of LLMs. However,…

计算与语言 · 计算机科学 2024-12-18 Weixiong Zheng , Peijian Zeng , Yiwei Li , Hongyan Wu , Nankai Lin , Junhao Chen , Aimin Yang , Yongmei Zhou

The challenge of WAD (web attack detection) is growing as hackers continuously refine their methods to evade traditional detection. Deep learning models excel in handling complex unknown attacks due to their strong generalization and…

机器学习 · 计算机科学 2024-06-19 Lijia Shi , Shihao Dong