中文
相关论文

相关论文: No Caption, No Problem: Caption-Free Membership In…

200 篇论文

Membership inference attacks (MIAs) pose a critical privacy threat to fine-tuned large language models (LLMs), especially when models are adapted to domain-specific tasks using sensitive data. While prior black-box MIA techniques rely on…

密码学与安全 · 计算机科学 2025-12-23 Zhexi Lu , Hongliang Chi , Nathalie Baracaldo , Swanand Ravindra Kadhe , Yuseok Jeon , Lei Yu

Large Multimodal Language Models (MLLMs) are emerging as one of the foundational tools in an expanding range of applications. Consequently, understanding training-data leakage in these systems is increasingly critical. Log-probability-based…

密码学与安全 · 计算机科学 2026-05-22 Ziyi Tong , Feifei Sun , Le Minh Nguyen

Diffusion-based generative models have shown great potential for image synthesis, but there is a lack of research on the security and privacy risks they may pose. In this paper, we investigate the vulnerability of diffusion models to…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Jinhao Duan , Fei Kong , Shiqi Wang , Xiaoshuang Shi , Kaidi Xu

Text-to-image diffusion models have achieved tremendous success in the field of controllable image generation, while also coming along with issues of privacy leakage and data copyrights. Membership inference arises in these contexts as a…

密码学与安全 · 计算机科学 2024-10-29 Shengfang Zhai , Huanran Chen , Yinpeng Dong , Jiajun Li , Qingni Shen , Yansong Gao , Hang Su , Yang Liu

Membership inference attacks (MIAs) reveal whether specific data was used to train machine learning models, serving as important tools for privacy auditing and compliance assessment. Recent studies have reported that MIAs perform only…

We present the first systematic Membership Inference Attack (MIA) evaluation of Large Audio Language Models (LALMs). As audio encodes non-semantic information, it induces severe train and test distribution shifts and can lead to spurious…

声音 · 计算机科学 2026-03-31 Jia-Kai Dong , Yu-Xiang Lin , Hung-Yi Lee

Zero-shot image captioning (IC) without well-paired image-text data can be divided into two categories, training-free and text-only-training. Generally, these two types of methods realize zero-shot IC by integrating pretrained…

计算机视觉与模式识别 · 计算机科学 2024-03-07 Zequn Zeng , Yan Xie , Hao Zhang , Chiyu Chen , Zhengjue Wang , Bo Chen

Large vision-language models (VLLMs) exhibit promising capabilities for processing multi-modal tasks across various application scenarios. However, their emergence also raises significant data security concerns, given the potential…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Zhan Li , Yongtao Wu , Yihang Chen , Francesco Tonin , Elias Abad Rocamora , Volkan Cevher

Image Captioning for state-of-the-art VLMs has significantly improved over time; however, this comes at the cost of increased computational complexity, making them less accessible for resource-constrained applications such as mobile devices…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Sania Waheed , Na Min An

Generative audio models, based on diffusion and autoregressive architectures, have advanced rapidly in both quality and expressiveness. This progress, however, raises pressing copyright concerns, as such models are often trained on vast…

Membership inference attacks (MIAs) aim to determine whether a specific example was used to train a given language model. While prior work has explored prompt-based attacks such as ReCALL, these methods rely heavily on the assumption that…

计算与语言 · 计算机科学 2026-01-27 Gyuwan Kim , Yang Li , Evangelia Spiliopoulou , Jie Ma , William Yang Wang

We propose a text-to-image generation algorithm based on deep neural networks when text captions for images are unavailable during training. In this work, instead of simply generating pseudo-ground-truth sentences of training images using…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Minsoo Kang , Doyup Lee , Jiseob Kim , Saehoon Kim , Bohyung Han

Recent advances in tuning-free personalized image generation based on diffusion models are impressive. However, to improve subject fidelity, existing methods either retrain the diffusion model or infuse it with dense visual embeddings, both…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Zhichao Wei , Qingkun Su , Long Qin , Weizhi Wang

Membership inference attacks (MIAs) have been extensively studied in large language models (LLMs) and vision-language models (VLMs), yet their implications for vision-language-action (VLA) models remain largely unexplored. VLA models differ…

密码学与安全 · 计算机科学 2026-05-11 Yuefeng Peng , Mingzhe Li , Kejing Xia , Renhao Zhang , Amir Houmansadr

Deep neural networks have achieved great successes on the image captioning task. However, most of the existing models depend heavily on paired image-sentence datasets, which are very expensive to acquire. In this paper, we make the first…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Yang Feng , Lin Ma , Wei Liu , Jiebo Luo

As a long-term threat to the privacy of training data, membership inference attacks (MIAs) emerge ubiquitously in machine learning models. Existing works evidence strong connection between the distinguishability of the training and testing…

机器学习 · 计算机科学 2022-07-14 Dingfan Chen , Ning Yu , Mario Fritz

The lack of data transparency in Large Language Models (LLMs) has highlighted the importance of Membership Inference Attack (MIA), which differentiates trained (member) and untrained (non-member) data. Though it shows success in previous…

计算与语言 · 计算机科学 2024-12-19 Bowen Chen , Namgi Han , Yusuke Miyao

Vision-Language Models (VLMs), built on pre-trained vision encoders and large language models (LLMs), have shown exceptional multi-modal understanding and dialog capabilities, positioning them as catalysts for the next technological…

密码学与安全 · 计算机科学 2025-02-10 Yuke Hu , Zheng Li , Zhihao Liu , Yang Zhang , Zhan Qin , Kui Ren , Chun Chen

Face recognition systems are increasingly vulnerable to morphing attacks, where a composite image is crafted to match multiple identities, enabling unauthorized access and identity fraud. Existing detection methods identify morphed images…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Nitish Shukla , Arun Ross

Membership inference attacks (MIAs) against machine learning (ML) models aim to determine whether a given data point was part of the model training data. These attacks may pose significant privacy risks to individuals whose sensitive data…

密码学与安全 · 计算机科学 2025-11-24 Mona Khalil , Alberto Blanco-Justicia , Najeeb Jebreel , Josep Domingo-Ferrer