中文
相关论文

相关论文: M^4I: Multi-modal Models Membership Inference

200 篇论文

Membership inference attacks (MIAs) aim to determine whether a specific sample was used to train a predictive model. Knowing this may indeed lead to a privacy breach. Most MIAs, however, make use of the model's prediction scores - the…

机器学习 · 计算机科学 2023-01-25 Dominik Hintersdorf , Lukas Struppek , Kristian Kersting

With the rapid advancement of deep learning technology, pre-trained encoder models have demonstrated exceptional feature extraction capabilities, playing a pivotal role in the research and application of deep learning. However, their…

密码学与安全 · 计算机科学 2025-06-09 Ruining Sun , Hongsheng Hu , Wei Luo , Zhaoxi Zhang , Yanjun Zhang , Haizhuan Yuan , Leo Yu Zhang

Machine learning (ML) models are proving to be vulnerable to a variety of attacks that allow the adversary to learn sensitive information, cause mispredictions, and more. While these attacks have been extensively studied, current research…

密码学与安全 · 计算机科学 2025-06-24 Yugeng Liu , Zheng Li , Hai Huang , Michael Backes , Yang Zhang

Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to…

密码学与安全 · 计算机科学 2018-05-08 Samuel Yeom , Irene Giacomelli , Matt Fredrikson , Somesh Jha

Federated Learning (FL) enables collaborative model training while keeping training data localized, allowing us to preserve privacy in various domains including remote sensing. However, recent studies show that FL models may still leak…

密码学与安全 · 计算机科学 2026-01-13 Anh-Kiet Duong , Petra Gomez-Krämer , Hoàng-Ân Lê , Minh-Tan Pham

Transfer learning has been widely studied and gained increasing popularity to improve the accuracy of machine learning models by transferring some knowledge acquired in different training. However, no prior work has pointed out that…

密码学与安全 · 计算机科学 2023-07-19 Seira Hidano , Takao Murakami , Yusuke Kawamoto

In the age of agentic AI, the growing deployment of multi-modal models (MMs) has introduced new attack vectors that can leak sensitive training data in MMs, causing privacy leakage. This paper investigates a black-box privacy attack, i.e.,…

计算机视觉与模式识别 · 计算机科学 2025-11-27 David Amebley , Sayanton Dibbo

Face recognition (FR) has been applied to nearly every aspect of daily life, but it is always accompanied by the underlying risk of leaking private information. At present, almost all attack models against FR rely heavily on the presence of…

计算机视觉与模式识别 · 计算机科学 2024-01-26 Yuanqing Huang , Huilong Chen , Yinggui Wang , Lei Wang

In the text processing context, most ML models are built on word embeddings. These embeddings are themselves trained on some datasets, potentially containing sensitive data. In some cases this training is done independently, in other cases,…

计算与语言 · 计算机科学 2021-06-23 Saeed Mahloujifar , Huseyin A. Inan , Melissa Chase , Esha Ghosh , Marcello Hasegawa

Membership inference attacks (MIAs) aim to determine whether a specific data point was part of a model's training set, serving as effective tools for evaluating privacy leakage of vision models. However, existing MIAs implicitly assume…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Ruize Gao , Kaiwen Zhou , Yongqiang Chen , Feng Liu

A membership-inference attack gets the output of a learning algorithm, and a target individual, and tries to determine whether this individual is a member of the training data or an independent sample from the same distribution. A…

机器学习 · 计算机科学 2025-08-28 Mahdi Haghifam , Adam Smith , Jonathan Ullman

In this paper, we study a novel problem in egocentric action recognition, which we term as "Multimodal Generalization" (MMG). MMG aims to study how systems can generalize when data from certain modalities is limited or even completely…

计算机视觉与模式识别 · 计算机科学 2023-05-15 Xinyu Gong , Sreyas Mohan , Naina Dhingra , Jean-Charles Bazin , Yilei Li , Zhangyang Wang , Rakesh Ranjan

Federated learning (FL) is an emerging paradigm for facilitating multiple organizations' data collaboration without revealing their private data to each other. Recently, vertical FL, where the participating organizations hold the same set…

机器学习 · 计算机科学 2022-07-15 Xinjian Luo , Yuncheng Wu , Xiaokui Xiao , Beng Chin Ooi

Diffusion models pose risks of privacy breaches and copyright disputes, primarily stemming from the potential utilization of unauthorized data during the training phase. The Training Membership Inference (TMI) task aims to determine whether…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Xiaomeng Fu , Xi Wang , Qiao Li , Jin Liu , Jiao Dai , Jizhong Han

Multitask learning (MTL) has emerged as a powerful paradigm that leverages similarities among multiple learning tasks, each with insufficient samples to train a standalone model, to solve them simultaneously while minimizing data sharing…

机器学习 · 计算机科学 2025-06-23 John Abascal , Nicolás Berrios , Alina Oprea , Jonathan Ullman , Adam Smith , Matthew Jagielski

Membership inference attacks (MIAs) against Diffusion Models (DMs) raise pressing privacy concerns by revealing whether a sample was part of the training set. While existing methods typically rely on measuring reconstruction error across…

机器学习 · 计算机科学 2026-04-27 Mingxing Rao , Bowen Qu , Daniel Moyer

Multimodal retrieval-augmented generation (RAG) systems enhance large vision-language models by integrating cross-modal knowledge, enabling their increasing adoption across real-world multimodal tasks. These knowledge databases may contain…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Peiru Yang , Jinhua Yin , Haoran Zheng , Xueying Bai , Huili Wang , Yufei Sun , Xintian Li , Shangguang Wang , Yongfeng Huang , Tao Qi

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

信号处理 · 电气工程与系统科学 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

In several jurisdictions, the regulatory framework on the release and sharing of personal data is being extended to machine learning (ML). The implicit assumption is that disclosing a trained ML model entails a privacy risk for any personal…

密码学与安全 · 计算机科学 2025-11-14 Josep Domingo-Ferrer

Diffusion-based generative models have shown great potential for image synthesis, but there is a lack of research on the security and privacy risks they may pose. In this paper, we investigate the vulnerability of diffusion models to…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Jinhao Duan , Fei Kong , Shiqi Wang , Xiaoshuang Shi , Kaidi Xu