English
Related papers

Related papers: MultiPriv: Benchmarking Individual-Level Privacy R…

200 papers

Recent advances in visual-language alignment have endowed vision-language models (VLMs) with fine-grained image understanding capabilities. However, this progress also introduces new privacy risks. This paper first proposes a novel privacy…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Hongyi Miao , Jun Jia , Xincheng Wang , Qianli Ma , Wei Sun , Wangqiu Zhou , Dandan Zhu , Yewen Cao , Zhi Liu , Guangtao Zhai

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

Cryptography and Security · Computer Science 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Recent advances in AI-powered surveillance have intensified concerns over the collection and processing of sensitive personal data. In response, research has increasingly focused on privacy-by-design solutions, raising the need for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Sara Abdulaziz , Giacomo D'Amicantonio , Egor Bondarev

Objectives: The rapid advancement of Multimodal Large Language Models (MLLMs) has significantly enhanced their reasoning capabilities, enabling a wide range of intelligent applications. However, these advancements also raise critical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Xian Zhang , Xiang Cheng

Generative models such as Large Language Models (LLM) and Multimodal Large Language models (MLLMs) trained on massive web corpora can memorize and disclose individuals' confidential and private data, raising legal and ethical concerns.…

Computation and Language · Computer Science 2025-02-18 Zheyuan Liu , Guangyao Dou , Mengzhao Jia , Zhaoxuan Tan , Qingkai Zeng , Yongle Yuan , Meng Jiang

Recent advances in multi-modal large reasoning models (MLRMs) have shown significant ability to interpret complex visual content. While these models enable impressive reasoning capabilities, they also introduce novel and underexplored…

Cryptography and Security · Computer Science 2026-03-04 Weidi Luo , Tianyu Lu , Qiming Zhang , Xiaogeng Liu , Bin Hu , Yue Zhao , Jieyu Zhao , Song Gao , Patrick McDaniel , Zhen Xiang , Chaowei Xiao

Large Language Models (LLMs) have become integral to numerous domains, significantly advancing applications in data management, mining, and analysis. Their profound capabilities in processing and interpreting complex language data, however,…

Cryptography and Security · Computer Science 2024-09-09 Qinbin Li , Junyuan Hong , Chulin Xie , Jeffrey Tan , Rachel Xin , Junyi Hou , Xavier Yin , Zhun Wang , Dan Hendrycks , Zhangyang Wang , Bo Li , Bingsheng He , Dawn Song

Multimodal Large Language Models (LLMs) are pivotal in revolutionizing customer support and operations by integrating multiple modalities such as text, images, and audio. Federated Prompt Learning (FPL) is a recently proposed approach that…

Machine Learning · Computer Science 2025-02-14 Linh Tran , Wei Sun , Stacy Patterson , Ana Milanova

Large language models (LLMs), renowned for their impressive capabilities in various tasks, have significantly advanced artificial intelligence. Yet, these advancements have raised growing concerns about privacy and security implications. To…

Artificial Intelligence · Computer Science 2024-03-28 Yuqi Yang , Xiaowen Huang , Jitao Sang

Large Language Models (LLMs) represent a significant advancement in artificial intelligence, finding applications across various domains. However, their reliance on massive internet-sourced datasets for training brings notable privacy…

Cryptography and Security · Computer Science 2025-02-11 Michele Miranda , Elena Sofia Ruzzetti , Andrea Santilli , Fabio Massimo Zanzotto , Sébastien Bratières , Emanuele Rodolà

As vision-language models (VLMs) become widely adopted, VLM-based attribute inference attacks have emerged as a serious privacy concern, enabling adversaries to infer private attributes from images shared on social media. This escalating…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yucheng Fan , Jiawei Chen , Yu Tian , Zhaoxia Yin

Large Language Models (LLMs) have revolutionized how information are collected, aggregated, and reasoned. However, this enables a novel and accessible vector of privacy intrusion: the automated and in-depth personal profiling; this…

Cryptography and Security · Computer Science 2026-05-08 Jiahao Chen , Qi Zhang , Ruixiao Lin , Chunyi Zhou , Tianyu Du , Qingming Li , Tong Zhang , Junhao Li , Yuwen Pu , Shouling Ji

As visual assistant systems powered by visual language models (VLMs) become more prevalent, concerns over user privacy have grown, particularly for blind and low vision users who may unknowingly capture personal private information in their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jeffri Murrugarra-LLerena , Haoran Niu , K. Suzanne Barber , Hal Daumé , Yang Trista Cao , Paola Cascante-Bonilla

Large Language Models (LLMs) are increasingly being used for automated evaluations and explaining them. However, concerns about explanation quality, consistency, and hallucinations remain open research challenges, particularly in…

Human-Computer Interaction · Computer Science 2025-04-18 Vincent Freiberger , Arthur Fleig , Erik Buchmann

The advancement of large language models (LLMs) has significantly broadened the scope of applications in natural language processing, with multi-modal LLMs extending these capabilities to integrate and interpret visual data. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bingchen Zhao , Yongshuo Zong , Letian Zhang , Timothy Hospedales

Although Large Language Models (LLMs) have become increasingly integral to diverse applications, their capabilities raise significant privacy concerns. This survey offers a comprehensive overview of privacy risks associated with LLMs and…

Cryptography and Security · Computer Science 2025-05-06 Kang Chen , Xiuze Zhou , Yuanguo Lin , Shibo Feng , Li Shen , Pengcheng Wu

Large language models (LLMs) are increasingly used to simulate human behavior, but their ability to simulate $individual$ privacy decisions is not well understood. In this paper, we address the problem of evaluating whether a core set of…

Cryptography and Security · Computer Science 2026-05-13 James Flemings , Murali Annavaram

Large language models (LLMs) have emerged as powerful tools for tackling complex tasks across diverse domains, but they also raise privacy concerns when fine-tuned on sensitive data due to potential memorization. While differential privacy…

Computation and Language · Computer Science 2024-08-19 Lynn Chua , Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Daogao Liu , Pasin Manurangsi , Amer Sinha , Chiyuan Zhang

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in processing and reasoning over diverse modalities, but their advanced abilities also raise significant privacy concerns, particularly regarding Personally…

Cryptography and Security · Computer Science 2025-10-01 Boyang Zhang , Istemi Ekin Akkus , Ruichuan Chen , Alice Dethise , Klaus Satzke , Ivica Rimac , Yang Zhang

Efficient and privacy-preserving multimodal interaction is essential as AR, VR, and modern smartphones with powerful cameras become primary interfaces for human-computer communication. Existing powerful large vision-language models (VLMs)…

Computation and Language · Computer Science 2026-01-28 Abhijit Mishra , Mingda Li , Hsiang Fu , Richard Noh , Minji Kim