中文
相关论文

相关论文: Prediction Exposes Your Face: Black-box Model Inve…

200 篇论文

The growing demand for customized visual content has led to the rise of personalized text-to-image (T2I) diffusion models. Despite their remarkable potential, they pose significant privacy risk when misused for malicious purposes. In this…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Xide Xu , Muhammad Atif Butt , Sandesh Kamath , Bogdan Raducanu

Recently, a surge of advanced facial editing techniques have been proposed that leverage the generative power of a pre-trained StyleGAN. To successfully edit an image this way, one must first project (or invert) the image into the…

计算机视觉与模式识别 · 计算机科学 2021-06-11 Daniel Roich , Ron Mokady , Amit H. Bermano , Daniel Cohen-Or

Current large language models (LLM) provide a strong foundation for large-scale user-oriented natural language tasks. Many users can easily inject adversarial text or instructions through the user interface, thus causing LLM model security…

计算与语言 · 计算机科学 2024-11-14 Chong Zhang , Mingyu Jin , Dong Shu , Taowen Wang , Dongfang Liu , Xiaobo Jin

Deep Learning (DL) is rapidly maturing to the point that it can be used in safety- and security-crucial applications. However, adversarial samples, which are undetectable to the human eye, pose a serious threat that can cause the model to…

密码学与安全 · 计算机科学 2024-05-06 Firuz Juraev , Mohammed Abuhamad , Eric Chan-Tin , George K. Thiruvathukal , Tamer Abuhmed

Black-box adversarial attack has attracted a lot of research interests for its practical use in AI safety. Compared with the white-box attack, a black-box setting is more difficult for less available information related to the attacked…

机器学习 · 计算机科学 2020-09-02 Linjun Zhou , Peng Cui , Yinan Jiang , Shiqiang Yang

Model Inversion (MI) attacks, which reconstruct the training dataset of neural networks, pose significant privacy concerns in machine learning. Recent MI attacks have managed to reconstruct realistic label-level private data, such as the…

机器学习 · 计算机科学 2025-02-27 Haoyang Li , Li Bai , Qingqing Ye , Haibo Hu , Yaxin Xiao , Huadi Zheng , Jianliang Xu

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

人工智能 · 计算机科学 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang

Membership inference attacks allow a malicious entity to predict whether a sample is used during training of a victim model or not. State-of-the-art membership inference attacks have shown to achieve good accuracy which poses a great…

机器学习 · 计算机科学 2022-03-07 Shahbaz Rezaei , Xin Liu

This paper introduces a novel approach to membership inference attacks (MIA) targeting stable diffusion computer vision models, specifically focusing on the highly sophisticated Stable Diffusion V2 by StabilityAI. MIAs aim to extract…

计算机视觉与模式识别 · 计算机科学 2023-11-17 Thomas Cilloni , Charles Fleming , Charles Walter

Black-box finetuning is an emerging interface for adapting state-of-the-art language models to user needs. However, such access may also let malicious actors undermine model safety. To demonstrate the challenge of defending finetuning…

密码学与安全 · 计算机科学 2024-07-01 Danny Halawi , Alexander Wei , Eric Wallace , Tony T. Wang , Nika Haghtalab , Jacob Steinhardt

Adversarial training was introduced as a way to improve the robustness of deep learning models to adversarial attacks. This training method improves robustness against adversarial attacks, but increases the models vulnerability to privacy…

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to guess if an input sample was used to train the model. In this paper, we show that prior…

密码学与安全 · 计算机科学 2020-12-10 Liwei Song , Prateek Mittal

Multitask learning (MTL) has emerged as a powerful paradigm that leverages similarities among multiple learning tasks, each with insufficient samples to train a standalone model, to solve them simultaneously while minimizing data sharing…

机器学习 · 计算机科学 2025-06-23 John Abascal , Nicolás Berrios , Alina Oprea , Jonathan Ullman , Adam Smith , Matthew Jagielski

Machine learning (ML) models have the potential to transform military battlefields, presenting a large external pressure to rapidly incorporate them into operational settings. However, it is well-established that these ML models are…

密码学与安全 · 计算机科学 2025-09-05 Tyler Shumaker , Jessica Carpenter , David Saranchak , Nathaniel D. Bastian

Learned recommender systems may inadvertently leak information about their training data, leading to privacy violations. We investigate privacy threats faced by recommender systems through the lens of membership inference. In such attacks,…

信息检索 · 计算机科学 2022-06-29 Zihan Wang , Na Huang , Fei Sun , Pengjie Ren , Zhumin Chen , Hengliang Luo , Maarten de Rijke , Zhaochun Ren

Despite our best efforts, deep learning models remain highly vulnerable to even tiny adversarial perturbations applied to the inputs. The ability to extract information from solely the output of a machine learning model to craft adversarial…

机器学习 · 计算机科学 2023-03-27 Viet Quoc Vo , Ehsan Abbasnejad , Damith C. Ranasinghe

Deep models have shown their vulnerability when processing adversarial samples. As for the black-box attack, without access to the architecture and weights of the attacked model, training a substitute model for adversarial attacks has…

计算机视觉与模式识别 · 计算机科学 2021-04-27 Wenxuan Wang , Bangjie Yin , Taiping Yao , Li Zhang , Yanwei Fu , Shouhong Ding , Jilin Li , Feiyue Huang , Xiangyang Xue

The goal of No-Reference Image Quality Assessment (NR-IQA) is to predict the perceptual quality of an image in line with its subjective evaluation. To put the NR-IQA models into practice, it is essential to study their potential loopholes…

计算机视觉与模式识别 · 计算机科学 2024-02-29 Yu Ran , Ao-Xiang Zhang , Mingjie Li , Weixuan Tang , Yuan-Gen Wang

Image-to-image translation has recently achieved remarkable results. But despite current success, it suffers from inferior performance when translations between classes require large shape changes. We attribute this to the high-resolution…

计算机视觉与模式识别 · 计算机科学 2020-11-12 Yaxing Wang , Lu Yu , Joost van de Weijer

Deep learning models are usually black boxes when deployed on machine learning platforms. Prior works have shown that the attributes (e.g., the number of convolutional layers) of a target black-box model can be exposed through a sequence of…

机器学习 · 计算机科学 2024-12-10 Rongqing Li , Jiaqi Yu , Changsheng Li , Wenhan Luo , Ye Yuan , Guoren Wang