English
Related papers

Related papers: Unveiling the Attribute Misbinding Threat in Ident…

200 papers

Recent advances in generative models, such as diffusion models, have raised concerns related to privacy, copyright infringement, and data stewardship. To better understand and control these risks, prior work has introduced techniques and…

Machine Learning · Computer Science 2026-01-08 Sol Yarkoni , Mahmood Sharif , Roi Livni

The generative AI revolution in recent years has been spurred by an expansion in compute power and data quantity, which together enable extensive pre-training of powerful text-to-image (T2I) models. With their greater capabilities to…

Due to the remarkable generative potential of diffusion-based models, numerous researches have investigated jailbreak attacks targeting these frameworks. A particularly concerning threat within image models is the generation of…

Cryptography and Security · Computer Science 2024-12-12 Xin Zhao , Xiaojun Chen , Haoyu Gao

State-of-the-art Text-to-Image models like Stable Diffusion and DALLE$\cdot$2 are revolutionizing how people generate visual content. At the same time, society has serious concerns about how adversaries can exploit such models to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yiting Qu , Xinyue Shen , Xinlei He , Michael Backes , Savvas Zannettou , Yang Zhang

With the development of diffusion-based customization methods like DreamBooth, individuals now have access to train the models that can generate their personalized images. Despite the convenience, malicious users have misused these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yisu Liu , Jinyang An , Wanqian Zhang , Dayan Wu , Jingzi Gu , Zheng Lin , Weiping Wang

Diffusion models show remarkable image generation performance following text prompts, but risk generating sexual contents. Existing approaches, such as prompt filtering, concept removal, and even sexual contents mitigation methods, struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jaesin Ahn , Heechul Jung

The rapid advancement of text-to-image (T2I) models, such as Stable Diffusion, has enhanced their capability to synthesize images from textual prompts. However, this progress also raises significant risks of misuse, including the generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yu Xie , Chengjie Zeng , Lingyun Zhang , Yanwei Fu

Despite their remarkable image generation capabilities, text-to-image diffusion models inadvertently learn inappropriate concepts from vast and unfiltered training data, which leads to various ethical and business risks. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Die Chen , Zhiwen Li , Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yanhao Wang , Yaliang Li

As text-to-image (T2I) models advance and gain widespread adoption, their associated safety concerns are becoming increasingly critical. Malicious users exploit these models to generate Not-Safe-for-Work (NSFW) images using harmful or…

Cryptography and Security · Computer Science 2025-12-10 Yiming Wang , Jiahao Chen , Qingming Li , Tong Zhang , Rui Zeng , Xing Yang , Shouling Ji

Personalized AI applications such as DreamBooth enable the generation of customized content from user images, but also raise significant privacy concerns, particularly the risk of facial identity leakage. Recent defense mechanisms like…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zhen Chen , Yi Zhang , Xiangyu Yin , Chengxuan Qin , Xingyu Zhao , Xiaowei Huang , Wenjie Ruan

For practical automatic speaker verification (ASV) systems, replay attack poses a true risk. By replaying a pre-recorded speech signal of the genuine speaker, ASV systems tend to be easily fooled. An effective replay detection method is…

Sound · Computer Science 2017-06-08 Lantian Li , Yixiang Chen , Dong Wang , Thomas Fang Zheng

The unlearning problem of deep learning models, once primarily an academic concern, has become a prevalent issue in the industry. The significant advances in text-to-image generation techniques have prompted global discussions on privacy,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Eric Zhang , Kai Wang , Xingqian Xu , Zhangyang Wang , Humphrey Shi

With social media growth, users employ stylistic fonts and font-like emoji to express individuality, creating visually appealing text that remains human-readable. However, these fonts introduce hidden vulnerabilities in NLP models: while…

Computation and Language · Computer Science 2025-10-23 Yangshijie Zhang , Xinda Wang , Jialin Liu , Wenqiang Wang , Zhicong Ma , Xingxing Jia

The past few years have witnessed the significant advances of speech synthesis and voice conversion technologies. However, such technologies can undermine the robustness of broadly implemented biometric identification models and can be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-16 Haibin Wu , Heng-Cheng Kuo , Naijun Zheng , Kuo-Hsuan Hung , Hung-Yi Lee , Yu Tsao , Hsin-Min Wang , Helen Meng

In recent years, Text-to-Image (T2I) models have seen remarkable advancements, gaining widespread adoption. However, this progress has inadvertently opened avenues for potential misuse, particularly in generating inappropriate or…

Cryptography and Security · Computer Science 2024-04-02 Yijun Yang , Ruiyuan Gao , Xiaosen Wang , Tsung-Yi Ho , Nan Xu , Qiang Xu

Automatic fingerprint recognition systems are the most extensively used systems for person authentication although they are vulnerable to Presentation attacks. Artificial artifacts created with the help of various materials are used to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Anuj Rai , Somnath Dey , Pradeep Patidar , Prakhar Rai

Advanced text-to-image models such as DALL$\cdot$E 2 and Midjourney possess the capacity to generate highly realistic images, raising significant concerns regarding the potential proliferation of unsafe content. This includes adult,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Zhongjie Ba , Jieming Zhong , Jiachen Lei , Peng Cheng , Qinglong Wang , Zhan Qin , Zhibo Wang , Kui Ren

Automatic speaker verification (ASV) is one of the most natural and convenient means of biometric person recognition. Unfortunately, just like all other biometric systems, ASV is vulnerable to spoofing, also referred to as "presentation…

Federated learning is a common method for privacy-preserving training of machine learning models. In this paper, we analyze the vulnerability of ASR models to attribute inference attacks in the federated setting. We test a non-parametric…

Computation and Language · Computer Science 2025-10-16 Hamdan Al-Ali , Ali Reza Ghavamipour , Tommaso Caselli , Fatih Turkmen , Zeerak Talat , Hanan Aldarmaki

In this work, we propose a profile matching (or deanonymization) attack for unstructured online social networks (OSNs) in which similarity in graphical structure cannot be used for profile matching. We consider different attributes that are…

Cryptography and Security · Computer Science 2017-11-07 Anisa Halimi , Erman Ayday