English
Related papers

Related papers: Prediction Exposes Your Face: Black-box Model Inve…

200 papers

Neural network-based image classifiers are powerful tools for computer vision tasks, but they inadvertently reveal sensitive attribute information about their classes, raising concerns about their privacy. To investigate this privacy…

Machine Learning · Computer Science 2023-06-14 Lukas Struppek , Dominik Hintersdorf , Felix Friedrich , Manuel Brack , Patrick Schramowski , Kristian Kersting

Adversarial examples have revealed the vulnerability of deep learning models and raised serious concerns about information security. The transfer-based attack is a hot topic in black-box attacks that are practical to real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Jian-Wei Li , Wen-Ze Shao

The rapid advancement of diffusion-based image generation models has raised serious concerns regarding potential copyright and privacy infringements involving human-created data. Membership inference attacks (MIAs) have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Tao Qi , Huili Wang , Yuanhong Huang , Wendan Wang , Lianchao Zhao , Jinrui Wang , Zichen Qin , Shangguang Wang , Yongfeng Huang

The notion that collaborative machine learning can ensure privacy by just withholding the raw data is widely acknowledged to be flawed. Over the past seven years, the literature has revealed several privacy attacks that enable adversaries…

Cryptography and Security · Computer Science 2024-09-27 Federico Mazzone , Ahmad Al Badawi , Yuriy Polyakov , Maarten Everts , Florian Hahn , Andreas Peter

Membership inference attacks seek to infer membership of individual training instances of a model to which an adversary has black-box access through a machine learning-as-a-service API. In providing an in-depth characterization of…

Cryptography and Security · Computer Science 2019-02-04 Stacey Truex , Ling Liu , Mehmet Emre Gursoy , Lei Yu , Wenqi Wei

Model-based attacks can infer training data information from deep neural network models. These attacks heavily depend on the attacker's knowledge of the application domain, e.g., using it to determine the auxiliary data for model-inversion…

Machine Learning · Computer Science 2022-12-23 Yuechun Gu , Keke Chen

In this paper, we introduce a black-box prompt optimization method that uses an attacker LLM agent to uncover higher levels of memorization in a victim agent, compared to what is revealed by prompting the target model with the training data…

Computation and Language · Computer Science 2025-02-11 Aly M. Kassem , Omar Mahmoud , Niloofar Mireshghallah , Hyunwoo Kim , Yulia Tsvetkov , Yejin Choi , Sherif Saad , Santu Rana

Recent approaches in machine learning often solve a task using a composition of multiple models or agentic architectures. When targeting a composed system with adversarial attacks, it might not be computationally or informationally feasible…

Machine Learning · Computer Science 2024-11-01 Julian Collado , Kevin Stangl

Post-hoc explainability methods are a subset of Machine Learning (ML) that aim to provide a reason for why a model behaves in a certain way. In this paper, we show a new black-box model-agnostic adversarial attack for post-hoc explainable…

Machine Learning · Computer Science 2025-11-14 Leonardo Pesce , Jiawen Wei , Gianmarco Mengaldo

We present a new method for black-box adversarial attack. Unlike previous methods that combined transfer-based and scored-based methods by using the gradient or initialization of a surrogate white-box model, this new method tries to learn a…

Machine Learning · Computer Science 2020-01-07 Zhichao Huang , Tong Zhang

Recently, the vulnerability of deep image classification models to adversarial attacks has been investigated. However, such an issue has not been thoroughly studied for image-to-image tasks that take an input image and generate an output…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Jun-Ho Choi , Huan Zhang , Jun-Hyuk Kim , Cho-Jui Hsieh , Jong-Seok Lee

Adversarial examples have posed a severe threat to deep neural networks due to their transferable nature. Currently, various works have paid great efforts to enhance the cross-model transferability, which mostly assume the substitute model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Qilong Zhang , Xiaodan Li , Yuefeng Chen , Jingkuan Song , Lianli Gao , Yuan He , Hui Xue

Federated learning (FL) has emerged as a privacy-preserving machine learning approach where multiple parties share gradient information rather than original user data. Recent work has demonstrated that gradient inversion attacks can exploit…

Machine Learning · Computer Science 2024-05-07 Jin Qian , Kaimin Wei , Yongdong Wu , Jilian Zhang , Jipeng Chen , Huan Bao

With the rapid advancement of deep learning technology, pre-trained encoder models have demonstrated exceptional feature extraction capabilities, playing a pivotal role in the research and application of deep learning. However, their…

Cryptography and Security · Computer Science 2025-06-09 Ruining Sun , Hongsheng Hu , Wei Luo , Zhaoxi Zhang , Yanjun Zhang , Haizhuan Yuan , Leo Yu Zhang

Masked image modeling (MIM) as pre-training is shown to be effective for numerous vision downstream tasks, but how and where MIM works remain unclear. In this paper, we compare MIM with the long-dominant supervised pre-trained models from…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Zhenda Xie , Zigang Geng , Jingcheng Hu , Zheng Zhang , Han Hu , Yue Cao

Text-to-image (T2I) models based on diffusion and transformer architectures advance rapidly. They are often pretrained on large corpora, and openly shared on a model platform, such as HuggingFace. Users can then build up AI applications,…

Machine Learning · Computer Science 2025-08-18 Basile Lewandowski , Robert Birke , Lydia Y. Chen

Recent advancements in diffusion models trained on large-scale data have enabled the generation of indistinguishable human-level images, yet they often produce harmful content misaligned with human values, e.g., social bias, and offensive…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Xingqi Wang , Xiaoyuan Yi , Xing Xie , Jia Jia

Conventional multi-view re-ranking methods usually perform asymmetrical matching between the region of interest (ROI) in the query image and the whole target image for similarity computation. Due to the inconsistency in the visual…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Jun Li , Chang Xu , Wankou Yang , Changyin Sun , Dacheng Tao , Hong Zhang

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Recent studies have shown that Deep Leaning models are susceptible to adversarial examples, which are data, in general images, intentionally modified to fool a machine learning classifier. In this paper, we present a multi-objective nested…

Machine Learning · Computer Science 2026-02-24 A. E. Baia , G. Di Bari , V. Poggioni