English
Related papers

Related papers: Vid-SME: Membership Inference Attacks against Larg…

200 papers

Large vision-language models (VLLMs) exhibit promising capabilities for processing multi-modal tasks across various application scenarios. However, their emergence also raises significant data security concerns, given the potential…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Zhan Li , Yongtao Wu , Yihang Chen , Francesco Tonin , Elias Abad Rocamora , Volkan Cevher

Video large language models (VideoLLMs) are increasingly trained or instruction-tuned on large-scale video--text corpora collected from heterogeneous sources, raising an immediate privacy question: can an external auditor determine whether…

Cryptography and Security · Computer Science 2026-05-01 Wei Song , Yuxin Cao , Ziqi Ding , Yi Liu , Gelei Deng , Yuekang Li

Vision-Language Models (VLMs), built on pre-trained vision encoders and large language models (LLMs), have shown exceptional multi-modal understanding and dialog capabilities, positioning them as catalysts for the next technological…

Cryptography and Security · Computer Science 2025-02-10 Yuke Hu , Zheng Li , Zhihao Liu , Yang Zhang , Zhan Qin , Kui Ren , Chun Chen

With the surge of large language models (LLMs), Large Vision-Language Models (VLMs)--which integrate vision encoders with LLMs for accurate visual grounding--have shown great potential in tasks like generalist agents and robotic control.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Hongyu Zhu , Sichu Liang , Wenwen Wang , Boheng Li , Tongxin Yuan , Fangqi Li , ShiLin Wang , Zhuosheng Zhang

Membership inference attacks (MIAs) have been extensively studied in large language models (LLMs) and vision-language models (VLMs), yet their implications for vision-language-action (VLA) models remain largely unexplored. VLA models differ…

Cryptography and Security · Computer Science 2026-05-11 Yuefeng Peng , Mingzhe Li , Kejing Xia , Renhao Zhang , Amir Houmansadr

Large Language Models (LLMs) and Vision-Language Models (VLMs) have made significant advancements in a wide range of natural language processing and vision-language tasks. Access to large web-scale datasets has been a key factor in their…

Machine Learning · Computer Science 2024-10-18 Jie Ren , Kangrui Chen , Chen Chen , Vikash Sehwag , Yue Xing , Jiliang Tang , Lingjuan Lyu

With the burgeoning growth of online video platforms and the escalating volume of video content, the demand for proficient video understanding tools has intensified markedly. Given the remarkable capabilities of large language models (LLMs)…

Large vision-language models (LVLMs) derive their capabilities from extensive training on vast corpora of visual and textual data. Empowered by large-scale parameters, these models often exhibit strong memorization of their training data,…

Cryptography and Security · Computer Science 2025-11-05 Jinhua Yin , Peiru Yang , Chen Yang , Huili Wang , Zhiyang Hu , Shangguang Wang , Yongfeng Huang , Tao Qi

OpenLVLM-MIA is a new benchmark that highlights fundamental challenges in evaluating membership inference attacks (MIA) against large vision-language models (LVLMs). While prior work has reported high attack success rates, our analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Ryoto Miyamoto , Xin Fan , Fuyuko Kido , Tsuneo Matsumoto , Hayato Yamana

Large Multimodal Language Models (MLLMs) are emerging as one of the foundational tools in an expanding range of applications. Consequently, understanding training-data leakage in these systems is increasingly critical. Log-probability-based…

Cryptography and Security · Computer Science 2026-05-22 Ziyi Tong , Feifei Sun , Le Minh Nguyen

With the success of large language models (LLMs), integrating the vision model into LLMs to build vision-language foundation models has gained much more interest recently. However, existing LLM-based large multimodal models (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Bo He , Hengduo Li , Young Kyun Jang , Menglin Jia , Xuefei Cao , Ashish Shah , Abhinav Shrivastava , Ser-Nam Lim

The rapid advancement of Large Vision-Language models (LVLMs) has demonstrated a spectrum of emergent capabilities. Nevertheless, current models only focus on the visual content of a single scenario, while their ability to associate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yatai Ji , Shilong Zhang , Jie Wu , Peize Sun , Weifeng Chen , Xuefeng Xiao , Sidi Yang , Yujiu Yang , Ping Luo

Vision-Language Models (VLMs) have achieved remarkable success, yet their reliance on massive datasets and unintended memorization of training data raise significant data security risk. Membership Inference Attacks (MIAs) aim to assess…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jiaqing Li , Yajuan Lu , Xiaochuan Shi , Gang Wu , ZhongYuan Wang , Chao Liang

The exponential increase in video content poses significant challenges in terms of efficient navigation, search, and retrieval, thus requiring advanced video summarization techniques. Existing video summarization methods, which heavily rely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Min Jung Lee , Dayoung Gong , Minsu Cho

Hateful meme detection presents a significant challenge as a multimodal task due to the complexity of interpreting implicit hate messages and contextual cues within memes. Previous approaches have fine-tuned pre-trained vision-language…

Computation and Language · Computer Science 2025-02-18 Ming Shan Hee , Roy Ka-Wei Lee

Large vision-language models (LVLMs) have demonstrated outstanding performance in many downstream tasks. However, LVLMs are trained on large-scale datasets, which can pose privacy risks if training images contain sensitive information.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Zongyu Wu , Minhua Lin , Zhiwei Zhang , Fali Wang , Xianren Zhang , Xiang Zhang , Suhang Wang

The rapid advancement of Visual Language Models (VLMs) has enabled sophisticated analysis of visual content, leading to concerns about the inference of sensitive user attributes and subsequent privacy risks. While technical capabilities of…

Human-Computer Interaction · Computer Science 2025-08-12 Shuning Zhang , Gengrui Zhang , Yibo Meng , Ziyi Zhang , Hantao Zhao , Xin Yi , Hewu Li

As large-scale models such as Large Language Models (LLMs) and Large Multimodal Models (LMMs) see increasing deployment, their privacy risks remain underexplored. Membership Inference Attacks (MIAs), which reveal whether a data point was…

Machine Learning · Computer Science 2025-09-03 Hengyu Wu , Yang Cao

Membership Inference Attacks (MIAs) aim to determine whether a specific data point was included in the training set of a target model. Although there are have been numerous methods developed for detecting data contamination in large…

Machine Learning · Computer Science 2025-12-03 Anton Emelyanov , Sergei Kudriashov , Alena Fenogenova

Reinforcement Learning with Verifiable Rewards (RLVR) has substantially advanced the video understanding capabilities of Multimodal Large Language Models (MLLMs). However, the rapid progress of MLLMs is outpacing the complexity of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zefeng He , Xiaoye Qu , Yafu Li , Siyuan Huang , Daizong Liu , Yu Cheng
‹ Prev 1 2 3 10 Next ›