English
Related papers

Related papers: Breaking the Black-Box: Confidence-Guided Model In…

200 papers

Model Inversion (MI) attacks aim to reconstruct private training data by abusing access to machine learning models. Contemporary MI attacks have achieved impressive attack performance, posing serious threats to privacy. Meanwhile, all…

Machine Learning · Computer Science 2024-05-10 Sy-Tuyen Ho , Koh Jun Hao , Keshigeyan Chandrasegaran , Ngoc-Bao Nguyen , Ngai-Man Cheung

Current multi-task adversarial text attacks rely on abundant access to shared internal features and numerous queries, often limited to a single task type. As a result, these attacks are less effective against practical scenarios involving…

Cryptography and Security · Computer Science 2025-08-15 Wenqiang Wang , Yan Xiao , Hao Lin , Yangshijie Zhang , Xiaochun Cao

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

Cryptography and Security · Computer Science 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

Multi-targeted adversarial attacks aim to mislead classifiers toward specific target classes using a single perturbation generator with a conditional input specifying the desired target class. Existing methods face two key limitations: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Taïga Gonçalves , Tomo Miyazaki , Shinichiro Omachi

Image AutoRegressive generation has emerged as a new powerful paradigm with image autoregressive models (IARs) matching state-of-the-art diffusion models (DMs) in image quality (FID: 1.48 vs. 1.58) while allowing for a higher generation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Antoni Kowalczuk , Jan Dubiński , Franziska Boenisch , Adam Dziedzic

The increasing use of diffusion models for image generation, especially in sensitive areas like medical imaging, has raised significant privacy concerns. Membership Inference Attack (MIA) has emerged as a potential approach to determine if…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Xinkai Zhao , Yuta Tokuoka , Junichiro Iwasawa , Keita Oda

Decision-based black-box attacks often necessitate a large number of queries to craft an adversarial example. Moreover, decision-based attacks based on querying boundary points in the estimated normal vector direction often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Md Farhamdur Reza , Ali Rahmati , Tianfu Wu , Huaiyu Dai

Membership inference attacks (MIAs) pose a serious threat to the privacy of machine learning models by allowing adversaries to determine whether a specific data sample was included in the training set. Although federated learning (FL) is…

Cryptography and Security · Computer Science 2026-01-27 Mohammad Zare , Pirooz Shamsinejadbabaki

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

Machine Learning · Computer Science 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

Black-box adversarial attack has attracted a lot of research interests for its practical use in AI safety. Compared with the white-box attack, a black-box setting is more difficult for less available information related to the attacked…

Machine Learning · Computer Science 2020-09-02 Linjun Zhou , Peng Cui , Yinan Jiang , Shiqiang Yang

The rise of generative image models leads to privacy concerns when it comes to the huge datasets used to train such models. This paper investigates the possibility of inferring if a set of face images was used for fine-tuning a Latent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Lauritz Christian Holme , Anton Mosquera Storgaard , Siavash Arjomand Bigdeli

Large vision-language models (LVLMs) derive their capabilities from extensive training on vast corpora of visual and textual data. Empowered by large-scale parameters, these models often exhibit strong memorization of their training data,…

Cryptography and Security · Computer Science 2025-11-05 Jinhua Yin , Peiru Yang , Chen Yang , Huili Wang , Zhiyang Hu , Shangguang Wang , Yongfeng Huang , Tao Qi

Transfer learning is an important approach that produces pre-trained teacher models which can be used to quickly build specialized student models. However, recent research on transfer learning has found that it is vulnerable to various…

Cryptography and Security · Computer Science 2022-03-15 Dayong Ye , Huiqiang Chen , Shuai Zhou , Tianqing Zhu , Wanlei Zhou , Shouling Ji

Data is the foundation of most science. Unfortunately, sharing data can be obstructed by the risk of violating data privacy, impeding research in fields like healthcare. Synthetic data is a potential solution. It aims to generate data that…

Machine Learning · Computer Science 2023-02-27 Boris van Breugel , Hao Sun , Zhaozhi Qian , Mihaela van der Schaar

Graph Neural Network-based methods face privacy leakage risks due to the introduction of topological structures about the targets, which allows attackers to bypass the target's prior knowledge of the sensitive attributes and realize…

Machine Learning · Computer Science 2025-05-27 Jinyan Wang , Liu Yang , Yuecen Wei , Jiaxuan Si , Chenhao Guo , Qingyun Sun , Xianxian Li , Xingcheng Fu

Deep learning models are vulnerable to adversarial examples crafted by applying human-imperceptible perturbations on benign inputs. However, under the black-box setting, most existing adversaries often have a poor transferability to attack…

Machine Learning · Computer Science 2020-02-04 Jiadong Lin , Chuanbiao Song , Kun He , Liwei Wang , John E. Hopcroft

Neural networks are susceptible to small perturbations in the form of 2D rotations and shifts, image crops, and even changes in object colors. Past works attribute these errors to dataset bias, claiming that models fail on these perturbed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Spandan Madan , Tomotake Sasaki , Hanspeter Pfister , Tzu-Mao Li , Xavier Boix

Machine learning (ML) models have been widely applied to various applications, including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that ML models are vulnerable to…

Machine Learning · Computer Science 2022-02-04 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Philip S. Yu , Xuyun Zhang

Membership inference attacks (MIAs) on code completion models offer an effective way to assess privacy risks by inferring whether a given code snippet was part of the training data. Existing black- and gray-box MIAs rely on expensive…

Software Engineering · Computer Science 2025-11-20 Yuan Jiang , Zehao Li , Shan Huang , Christoph Treude , Xiaohong Su , Tiantian Wang

Existing black-box attacks have demonstrated promising potential in creating adversarial examples (AE) to deceive deep learning models. Most of these attacks need to handle a vast optimization space and require a large number of queries,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Renyang Liu , Wei Zhou , Tianwei Zhang , Kangjie Chen , Jun Zhao , Kwok-Yan Lam