English
Related papers

Related papers: Little Data, Big Impact: Privacy-Aware Visual Lang…

200 papers

Large Vision-Language Models (LVLMs) have shown remarkable potential across a wide array of vision-language tasks, leading to their adoption in critical domains such as finance and healthcare. However, their growing deployment also…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Xiangkui Cao , Jie Zhang , Meina Kan , Shiguang Shan , Xilin Chen

Recent studies have revealed the intriguing few-shot learning ability of pretrained language models (PLMs): They can quickly adapt to a new task when fine-tuned on a small amount of labeled data formulated as prompts, without requiring…

Computation and Language · Computer Science 2023-05-15 Yu Meng , Martin Michalski , Jiaxin Huang , Yu Zhang , Tarek Abdelzaher , Jiawei Han

Current LLM-based services typically require users to submit raw text regardless of its sensitivity. While intuitive, such practice introduces substantial privacy risks, as unauthorized access may expose personal, medical, or legal…

Cryptography and Security · Computer Science 2026-04-09 Jeongho Yoon , Chanhee Park , Yongchan Chun , Hyeonseok Moon , Heuiseok Lim

The deployment of Large Language Models (LLMs) in embodied agents creates an urgent need to measure their privacy awareness in the physical world. Existing evaluation methods, however, are confined to natural language based scenarios. To…

Cryptography and Security · Computer Science 2026-02-17 Xinjie Shen , Mufei Li , Pan Li

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding and generation by integrating visual and textual information. While instruction tuning and parameter-efficient fine-tuning methods have…

Machine Learning · Computer Science 2025-06-12 Weiying Zheng , Ziyue Lin , Pengxin Guo , Yuyin Zhou , Feifei Wang , Liangqiong Qu

Visual Language Models (VLMs) are often used for zero-shot detection of visual attributes in the image. We present a zero-shot evaluation of open-source VLMs for privacy-related attribute recognition. We identify the attributes for which…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Olena Hrynenko , Darya Baranouskaya , Alina Elena Baia , Andrea Cavallaro

As language models (LMs) are widely utilized in personalized communication scenarios (e.g., sending emails, writing social media posts) and endowed with a certain level of agency, ensuring they act in accordance with the contextual privacy…

Computation and Language · Computer Science 2025-03-17 Yijia Shao , Tianshi Li , Weiyan Shi , Yanchen Liu , Diyi Yang

Recent advancements in multimodal large language models (MLLMs) have demonstrated significant progress; however, these models exhibit a notable limitation, which we refer to as "face blindness". Specifically, they can engage in general…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Renjie Pi , Jianshu Zhang , Tianyang Han , Jipeng Zhang , Rui Pan , Tong Zhang

Recent advancements in large vision language models (VLMs) tailored for autonomous driving (AD) have shown strong scene understanding and reasoning capabilities, making them undeniable candidates for end-to-end driving systems. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Shuo Xing , Hongyuan Hua , Xiangbo Gao , Shenzhe Zhu , Renjie Li , Kexin Tian , Xiaopeng Li , Heng Huang , Tianbao Yang , Zhangyang Wang , Yang Zhou , Huaxiu Yao , Zhengzhong Tu

Fine-tuning unlocks large language models (LLMs) for specialized applications, but its high computational cost often puts it out of reach for resource-constrained organizations. While cloud platforms could provide the needed resources, data…

Cryptography and Security · Computer Science 2026-04-28 Zihan Liu , Yizhen Wang , Rui Wang , Xiu Tang , Sai Wu

Vision Large Language Models (VLMs) combine visual understanding with natural language processing, enabling tasks like image captioning, visual question answering, and video analysis. While VLMs show impressive capabilities across domains…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Ahmed Sharshar , Latif U. Khan , Waseem Ullah , Mohsen Guizani

Large language models (LLMs) often memorize private information during training, raising serious privacy concerns. While machine unlearning has emerged as a promising solution, its true effectiveness against privacy attacks remains unclear.…

Machine Learning · Computer Science 2026-04-27 Xiaoyi Chen , Haoyuan Wang , Siyuan Tang , Sijia Liu , Liya Su , XiaoFeng Wang , Haixu Tang

Large Language Models (LLMs) are powerful tools for natural language processing, enabling novel applications and user experiences. However, to achieve optimal performance, LLMs often require adaptation with private data, which poses privacy…

Cryptography and Security · Computer Science 2023-10-18 Rui Wen , Tianhao Wang , Michael Backes , Yang Zhang , Ahmed Salem

Large language models (LLMs) are increasingly deployed in privacy-critical and personalization-oriented scenarios, yet the role of context length in shaping privacy leakage and personalization effectiveness remains largely unexplored. We…

Machine Learning · Computer Science 2026-02-17 Shangding Gu

Vision-language models (VLMs) can learn high-quality representations from a large-scale training dataset of image-text pairs. Prompt learning is a popular approach to fine-tuning VLM to adapt them to downstream tasks. Despite the satisfying…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhifang Zhang , Yuwei Niu , Xin Liu , Beibei Li

The rapid deployment of large language models (LLMs) in consumer applications has led to frequent exchanges of personal information. To obtain useful responses, users often share more than necessary, increasing privacy risks via…

Machine Learning · Computer Science 2025-10-07 Jijie Zhou , Niloofar Mireshghallah , Tianshi Li

Recent advancements in Vision-Language Models (VLMs) have sparked interest in their use for autonomous driving, particularly in generating interpretable driving decisions through natural language. However, the assumption that VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Shaoyuan Xie , Lingdong Kong , Yuhao Dong , Chonghao Sima , Wenwei Zhang , Qi Alfred Chen , Ziwei Liu , Liang Pan

Video crime detection is a significant application of computer vision and artificial intelligence. However, existing datasets primarily focus on detecting severe crimes by analyzing entire video clips, often neglecting the precursor…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Ryozo Masukawa , Sanggeon Yun , Yoshiki Yamaguchi , Mohsen Imani

The emergence of Small Language Models (SLMs) as privacy-preserving alternatives for sensitive applications raises a fundamental question about their inherent understanding capabilities compared to Large Language Models (LLMs). This paper…

Computation and Language · Computer Science 2025-07-15 Hong Jia , Shiya Fu , Feng Xia , Vassilis Kostakos , Ting Dang

The ability to distinguish subtle differences between visually similar images is essential for diverse domains such as industrial anomaly detection, medical imaging, and aerial surveillance. While comparative reasoning benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Minkyu Kim , Sangheon Lee , Dongmin Park