中文
相关论文

相关论文: The Pervasive Blind Spot: Benchmarking VLM Inferen…

200 篇论文

As large language models (LLMs) become ubiquitous in our daily tasks and digital interactions, associated privacy risks are increasingly in focus. While LLM privacy research has primarily focused on the leakage of model training data, it…

人工智能 · 计算机科学 2024-11-05 Batuhan Tömekçe , Mark Vero , Robin Staab , Martin Vechev

The rapid advancement of Visual Language Models (VLMs) has enabled sophisticated analysis of visual content, leading to concerns about the inference of sensitive user attributes and subsequent privacy risks. While technical capabilities of…

人机交互 · 计算机科学 2025-08-12 Shuning Zhang , Gengrui Zhang , Yibo Meng , Ziyi Zhang , Hantao Zhao , Xin Yi , Hewu Li

Vision-Language Models (VLMs) combine visual and textual understanding, rendering them well-suited for diverse tasks like generating image captions and answering visual questions across various domains. However, these capabilities are built…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Simone Caldarella , Massimiliano Mancini , Elisa Ricci , Rahaf Aljundi

Current privacy research on large language models (LLMs) primarily focuses on the issue of extracting memorized training data. At the same time, models' inference capabilities have increased drastically. This raises the key question of…

人工智能 · 计算机科学 2024-05-07 Robin Staab , Mark Vero , Mislav Balunović , Martin Vechev

Modern Vision-Language Models (VLMs) pose significant individual-level privacy risks by linking fragmented multimodal data to identifiable individuals through hierarchical chain-of-thought reasoning. However, existing privacy benchmarks…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Xiongtao Sun , Hui Li , Jiaming Zhang , Yujie Yang , Kaili Liu , Ruxin Feng , Wen Jun Tan , Wei Yang Bryan Lim

As Vision-Language Models (VLMs) are increasingly deployed as autonomous cognitive cores for embodied assistants, evaluating their privacy awareness in physical environments becomes critical. Unlike digital chatbots, these agents operate in…

密码学与安全 · 计算机科学 2026-05-11 Junran Wang , Xinjie Shen , Zehao Jin , Pan Li

Recent advancements in multimodal large language models for video understanding (videoLLMs) have enhanced their capacity to process complex spatiotemporal data. However, challenges such as factual inaccuracies, harmful content, biases,…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Youze Wang , Zijun Chen , Ruoyu Chen , Shishen Gu , Wenbo Hu , Jiayang Liu , Yinpeng Dong , Hang Su , Jun Zhu , Meng Wang , Richang Hong

Our research reveals a new privacy risk associated with the vision-language model (VLM) agentic framework: the ability to infer sensitive attributes (e.g., age and health information) and even abstract ones (e.g., personality and social…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Feiran Liu , Yuzhe Zhang , Xinyi Huang , Yinan Peng , Xinfeng Li , Lixu Wang , Yutong Shen , Ranjie Duan , Simeng Qin , Xiaojun Jia , Qingsong Wen , Wei Dong

While specialized learning-based models have historically dominated image privacy prediction, the current literature increasingly favours adopting large Vision-Language Models (VLMs) designed for generic tasks. This trend risks overlooking…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Alina Elena Baia , Alessio Xompero , Andrea Cavallaro

Multimodal large language models (MLLMs) demonstrate remarkable capabilities in handling complex multimodal tasks and are increasingly adopted in video understanding applications. However, their rapid advancement raises serious data privacy…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Qi Li , Runpeng Yu , Xinchao Wang

As vision-language models (VLMs) become widely adopted, VLM-based attribute inference attacks have emerged as a serious privacy concern, enabling adversaries to infer private attributes from images shared on social media. This escalating…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Yucheng Fan , Jiawei Chen , Yu Tian , Zhaoxia Yin

The recent progress in Vision-Language Models (VLMs) has broadened the scope of multimodal applications. However, evaluations often remain limited to functional tasks, neglecting abstract dimensions such as personality traits and human…

计算与语言 · 计算机科学 2025-06-04 Jingxuan Li , Yuning Yang , Shengqi Yang , Linfan Zhang , Ying Nian Wu

As language models achieve increasingly human-like capabilities in conversational text generation, a critical question emerges: to what extent can these systems simulate the characteristics of specific individuals? To evaluate this, we…

计算与语言 · 计算机科学 2025-06-04 Quan Shi , Carlos E. Jimenez , Stephen Dong , Brian Seo , Caden Yao , Adam Kelch , Karthik Narasimhan

Large Vision-Language Models (LVLMs) exhibit impressive potential across various tasks but also face significant privacy risks, limiting their practical applications. Current researches on privacy assessment for LVLMs is limited in scope,…

密码学与安全 · 计算机科学 2026-03-03 Jie Zhang , Xiangkui Cao , Zhouyu Han , Shiguang Shan , Xilin Chen

The widespread use of cameras in our society has created an overwhelming amount of video data, far exceeding the capacity for human monitoring. This presents a critical challenge for public safety and security, as the timely detection of…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Pascal Benschop , Cristian Meo , Justin Dauwels , Jelte P. Mense

Artificial Intelligence have profoundly transformed the technological landscape in recent years. Large Language Models (LLMs) have demonstrated impressive abilities in reasoning, text comprehension, contextual pattern recognition, and…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Efthymios Tsaprazlis , Tiantian Feng , Anil Ramakrishna , Rahul Gupta , Shrikanth Narayanan

Large-scale vision-language models (VLM) have shown impressive results for language-guided search applications. While these models allow category-level queries, they currently struggle with personalized searches for moments in a video where…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Chun-Hsiao Yeh , Bryan Russell , Josef Sivic , Fabian Caba Heilbron , Simon Jenni

The prevalence of Vision-Language Models (VLMs) raises important questions about privacy in an era where visual information is increasingly available. While foundation VLMs demonstrate broad knowledge and learned capabilities, we…

计算机视觉与模式识别 · 计算机科学 2025-02-21 Neel Jay , Hieu Minh Nguyen , Trung Dung Hoang , Jacob Haimes

Understanding human social behavior such as recognizing emotions and the social dynamics causing them is an important and challenging problem. While LLMs have made remarkable advances, they are limited to the textual domain and cannot…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Tania Chakraborty , Eylon Caplan , Dan Goldwasser

Vision-Language Models (VLMs) are trained on vast amounts of data captured by humans emulating our understanding of the world. However, known as visual illusions, human's perception of reality isn't always faithful to the physical world.…

人工智能 · 计算机科学 2023-11-02 Yichi Zhang , Jiayi Pan , Yuchen Zhou , Rui Pan , Joyce Chai
‹ 上一页 1 2 3 10 下一页 ›