中文
相关论文

相关论文: MER-Inspector: Assessing model extraction risks fr…

200 篇论文

Machine Learning (ML) has automated a multitude of our day-to-day decision making domains such as education, employment and driving automation. The continued success of ML largely depends on our ability to trust the model we are using.…

机器学习 · 计算机科学 2022-04-01 Sakshi Udeshi , Shanshan Peng , Gerald Woo , Lionell Loh , Louth Rawshan , Sudipta Chattopadhyay

Cyber attacks constitute a significant threat to organizations with implications ranging from economic, reputational, and legal consequences. As cybercriminals' techniques get sophisticated, information security professionals face a more…

密码学与安全 · 计算机科学 2021-04-01 Emrah Tufan , Cihangir Tezcan , Cengiz Acartürk

Graph Neural Networks (GNNs) have gained traction in Graph-based Machine Learning as a Service (GMLaaS) platforms, yet they remain vulnerable to graph-based model extraction attacks (MEAs), where adversaries reconstruct surrogate models by…

机器学习 · 计算机科学 2025-03-24 Zhan Cheng , Bolin Shen , Tianming Sha , Yuan Gao , Shibo Li , Yushun Dong

Language models are prone to memorizing their training data, making them vulnerable to extraction attacks. While existing research often examines isolated setups, such as a single model or a fixed prompt, real-world adversaries have a…

密码学与安全 · 计算机科学 2025-08-11 Yash More , Prakhar Ganesh , Golnoosh Farnadi

In response to adversarial text attacks, attack detection models have been proposed and shown to successfully identify text modified by adversaries. Attack detection models can be leveraged to provide an additional check for NLP models and…

计算与语言 · 计算机科学 2025-09-26 Jonathan Rusert

LLM agents increasingly perform end-to-end ML engineering tasks where success is judged by a single scalar test metric. This creates a structural vulnerability: an agent can increase the reported score by compromising the evaluation…

人工智能 · 计算机科学 2026-03-13 Yonas Atinafu , Robin Cohen

Magecart skimming attacks have emerged as a significant threat to client-side security and user trust in online payment systems. This paper addresses the challenge of achieving robust and explainable detection of Magecart attacks through a…

密码学与安全 · 计算机科学 2025-11-07 Pedro Pereira , José Gouveia , João Vitorino , Eva Maia , Isabel Praça

While state-of-the-art Deep Neural Network (DNN) models are considered to be robust to random perturbations, it was shown that these architectures are highly vulnerable to deliberately crafted perturbations, albeit being…

机器学习 · 计算机科学 2021-06-03 Omer Faruk Tuna , Ferhat Ozgur Catak , M. Taner Eskil

Indiscriminate data poisoning attacks aim to decrease a model's test accuracy by injecting a small amount of corrupted training data. Despite significant interest, existing attacks remain relatively ineffective against modern machine…

机器学习 · 计算机科学 2023-06-07 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Membership Inference Attacks (MIAs) infer whether a data point is in the training data of a machine learning model. It is a threat while being in the training data is private information of a data point. MIA correctly infers some data…

密码学与安全 · 计算机科学 2022-10-31 Mauro Conti , Jiaxin Li , Stjepan Picek

Machine unlearning enables the removal of specific data from ML models to uphold the right to be forgotten. While approximate unlearning algorithms offer efficient alternatives to full retraining, this work reveals that they fail to…

机器学习 · 计算机科学 2025-07-29 Yaxin Xiao , Qingqing Ye , Li Hu , Huadi Zheng , Haibo Hu , Zi Liang , Haoyang Li , Yijie Jiao

DNN accelerators have been widely deployed in many scenarios to speed up the inference process and reduce the energy consumption. One big concern about the usage of the accelerators is the confidentiality of the deployed models: model…

密码学与安全 · 计算机科学 2023-08-03 Xiaobei Yan , Xiaoxuan Lou , Guowen Xu , Han Qiu , Shangwei Guo , Chip Hong Chang , Tianwei Zhang

Information leakage is becoming a critical problem as various information becomes publicly available by mistake, and machine learning models train on that data to provide services. As a result, one's private information could easily be…

机器学习 · 计算机科学 2022-12-02 Geon Heo , Steven Euijong Whang

In model extraction attacks, the goal is to reveal the parameters of a black-box machine learning model by querying the model for a selected set of data points. Due to an increasing demand for explanations, this may involve counterfactual…

最优化与控制 · 数学 2026-03-04 Daan Otto , Jannis Kurtz , Dick den Hertog , Ilker Birbil

Machine learning models can leak information regarding the dataset they have trained. In this paper, we present the first membership inference attack against black-boxed object detection models that determines whether the given data records…

计算机视觉与模式识别 · 计算机科学 2020-01-29 Yeachan Park , Myungjoo Kang

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

机器学习 · 计算机科学 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

Membership inference attacks (MIAs) aim to determine whether a data sample was included in a machine learning (ML) model's training set and have become the de facto standard for measuring privacy leakages in ML. We propose an evaluation…

密码学与安全 · 计算机科学 2026-03-25 Najeeb Jebreel , David Sánchez , Josep Domingo-Ferrer

Model inversion (MI) attacks aim to infer and reconstruct private training data by abusing access to a model. MI attacks have raised concerns about the leaking of sensitive information (e.g. private face images used in training a face…

机器学习 · 计算机科学 2023-06-16 Ngoc-Bao Nguyen , Keshigeyan Chandrasegaran , Milad Abdollahzadeh , Ngai-Man Cheung

As deep learning applications are becoming more and more pervasive in robotics, the question of evaluating the reliability of inferences becomes a central question in the robotics community. This domain, known as predictive uncertainty, has…

机器学习 · 统计学 2019-08-21 Michel Moukari , Loïc Simon , Sylvaine Picard , Frédéric Jurie

Model extraction is a growing concern for the security of AI systems. For deep neural network models, the architecture is the most important information an adversary aims to recover. Being a sequence of repeated computation blocks, neural…

密码学与安全 · 计算机科学 2024-02-07 Raphael Joud , Pierre-Alain Moellic , Simon Pontie , Jean-Baptiste Rigaud