中文
相关论文

相关论文: Breaking the Black-Box: Confidence-Guided Model In…

200 篇论文

Most deep learning models are easily vulnerable to adversarial attacks. Various adversarial attacks are designed to evaluate the robustness of models and develop defense model. Currently, adversarial attacks are brought up to attack their…

密码学与安全 · 计算机科学 2019-06-10 Jinyin Chen , Mengmeng Su , Shijing Shen , Hui Xiong , Haibin Zheng

Deep learning has made significant breakthroughs in many fields, including electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, deep learning models are vulnerable to adversarial attacks, in which deliberately…

机器学习 · 计算机科学 2019-11-12 Xue Jiang , Xiao Zhang , Dongrui Wu

Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is…

密码学与安全 · 计算机科学 2023-10-17 Joann Qiongna Chen , Xinlei He , Zheng Li , Yang Zhang , Zhou Li

This report summarizes all the MIA experiments (Membership Inference Attacks) of the Embedding Attack Project, including threat models, experimental setup, experimental results, findings and discussion. Current results cover the evaluation…

机器学习 · 计算机科学 2024-01-26 Jiameng Pu , Zafar Takhirov

Membership inference attacks (MIAs) pose a critical privacy threat to fine-tuned large language models (LLMs), especially when models are adapted to domain-specific tasks using sensitive data. While prior black-box MIA techniques rely on…

密码学与安全 · 计算机科学 2025-12-23 Zhexi Lu , Hongliang Chi , Nathalie Baracaldo , Swanand Ravindra Kadhe , Yuseok Jeon , Lei Yu

Neural network-based image classifiers are powerful tools for computer vision tasks, but they inadvertently reveal sensitive attribute information about their classes, raising concerns about their privacy. To investigate this privacy…

Deep neural networks are vulnerable to adversarial examples, even in the black-box setting, where the attacker is restricted solely to query access. Existing black-box approaches to generating adversarial examples typically require a…

机器学习 · 计算机科学 2019-07-02 Moustafa Alzantot , Yash Sharma , Supriyo Chakraborty , Huan Zhang , Cho-Jui Hsieh , Mani Srivastava

We develop practical and theoretically grounded membership inference attacks (MIAs) against both independent and identically distributed (i.i.d.) data and graph-structured data. Building on the Bayesian decision-theoretic framework of…

机器学习 · 计算机科学 2025-10-29 Marcus Lassila , Johan Östman , Khac-Hoang Ngo , Alexandre Graell i Amat

Multi-domain graph pre-training has emerged as a pivotal technique in developing graph foundation models. While it greatly improves the generalization of graph neural networks, its privacy risks under membership inference attacks (MIAs),…

机器学习 · 计算机科学 2025-11-25 Jiayi Luo , Qingyun Sun , Yuecen Wei , Haonan Yuan , Xingcheng Fu , Jianxin Li

In the rapidly evolving field of artificial intelligence, machine learning emerges as a key technology characterized by its vast potential and inherent risks. The stability and reliability of these models are important, as they are frequent…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Haibo Zhang , Zhihua Yao , Kouichi Sakurai , Takeshi Saitoh

In the scenario of black-box adversarial attack, the target model's parameters are unknown, and the attacker aims to find a successful adversarial perturbation based on query feedback under a query budget. Due to the limited feedback…

机器学习 · 计算机科学 2023-01-03 Fei Yin , Yong Zhang , Baoyuan Wu , Yan Feng , Jingyi Zhang , Yanbo Fan , Yujiu Yang

Membership inference attacks (MIAs) threaten the privacy of machine learning models by revealing whether a specific data point was used during training. Existing MIAs often rely on impractical assumptions such as access to public datasets,…

机器学习 · 计算机科学 2026-02-24 Abdullah Caglar Oksuz , Anisa Halimi , Erman Ayday

Machine Learning (ML) has made unprecedented progress in the past several decades. However, due to the memorability of the training data, ML is susceptible to various attacks, especially Membership Inference Attacks (MIAs), the objective of…

机器学习 · 计算机科学 2022-05-16 Shuhao Li , Yajie Wang , Yuanzhang Li , Yu-an Tan

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

机器学习 · 计算机科学 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

While Multimodal Large Language Models (MLLMs) show remarkable capabilities, their safety alignments are susceptible to jailbreak attacks. Existing attack methods typically focus on text-image interplay, treating the visual modality as a…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Yuan Xiong , Ziqi Miao , Lijun Li , Chen Qian , Jie Li , Jing Shao

Recently, the textual adversarial attack models become increasingly popular due to their successful in estimating the robustness of NLP models. However, existing works have obvious deficiencies. (1) They usually consider only a single…

计算与语言 · 计算机科学 2021-09-10 Yangyi Chen , Jin Su , Wei Wei

Model extraction attacks (MEAs) enable an attacker to replicate the functionality of a victim deep neural network (DNN) model by only querying its API service remotely, posing a severe threat to the security and integrity of pay-per-query…

密码学与安全 · 计算机科学 2026-03-17 Di Mi , Yanjun Zhang , Leo Yu Zhang , Shengshan Hu , Qi Zhong , Haizhuan Yuan , Shirui Pan

Black-box adversarial attacks present a realistic threat to action recognition systems. Existing black-box attacks follow either a query-based approach where an attack is optimized by querying the target model, or a transfer-based approach…

计算机视觉与模式识别 · 计算机科学 2022-11-24 Rohit Gupta , Naveed Akhtar , Gaurav Kumar Nayak , Ajmal Mian , Mubarak Shah

Diffusion models have achieved remarkable progress in image generation, but their increasing deployment raises serious concerns about privacy. In particular, fine-tuned models are highly vulnerable, as they are often fine-tuned on small and…

密码学与安全 · 计算机科学 2026-01-30 Puwei Lian , Yujun Cai , Songze Li , Bingkun Bao

In a membership inference attack (MIA), an attacker exploits the overconfidence exhibited by typical machine learning models to determine whether a specific data point was used to train a target model. In this paper, we analyze the…

信息论 · 计算机科学 2025-06-10 Meiyi Zhu , Caili Guo , Chunyan Feng , Osvaldo Simeone