English
Related papers

Related papers: Neural Gate: Mitigating Privacy Risks in LVLMs via…

200 papers

This paper addresses the privacy and security concerns associated with deep neural language models, which serve as crucial components in various modern AI-based applications. These models are often used after being pre-trained and…

Cryptography and Security · Computer Science 2024-01-01 Abhijit Mishra , Mingda Li , Soham Deo

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Haoran Chang , Mingzhe Chen , Huaxia Wang , Qianqian Zhang

Large language models (LLMs) are increasingly deployed in enterprise settings where they interact with multiple users and are trained or fine-tuned on sensitive internal data. While fine-tuning enhances performance by internalizing domain…

Large language models (LLMs) are commonly adapted to downstream tasks through fine-tuning, but fine-tuning data often contains sensitive information that may be leaked by the resulting model. Differential privacy (DP) offers formal…

Machine Learning · Computer Science 2026-05-19 Haichao Sha , Zihao Wang , Yuncheng Wu , Hong Chen , Wei Dong

Vision-Language adaptation (VL adaptation) transforms Large Language Models (LLMs) into Large Vision-Language Models (LVLMs) for multimodal tasks, but this process often compromises the inherent safety capabilities embedded in the original…

Computation and Language · Computer Science 2024-11-18 Seongyun Lee , Geewook Kim , Jiyeon Kim , Hyunji Lee , Hoyeon Chang , Sue Hyun Park , Minjoon Seo

Large Vision-Language Models (LVLMs) have shown remarkable capabilities across a wide range of multimodal tasks. However, their integration of visual inputs introduces expanded attack surfaces, thereby exposing them to novel security…

Computation and Language · Computer Science 2025-05-29 Juan Ren , Mark Dras , Usman Naseem

Large Language Models (LLMs) have been shown to be susceptible to jailbreak attacks, or adversarial attacks used to illicit high risk behavior from a model. Jailbreaks have been exploited by cybercriminals and blackhat actors to cause…

Computation and Language · Computer Science 2025-01-07 Joao Fonseca , Andrew Bell , Julia Stoyanovich

With the increasing applications of language models, it has become crucial to protect these models from leaking private information. Previous work has attempted to tackle this challenge by training RNN-based language models with…

Computation and Language · Computer Science 2022-07-19 Weiyan Shi , Aiqi Cui , Evan Li , Ruoxi Jia , Zhou Yu

The advancement of Large Language Models (LLMs) has significantly impacted various domains, including Web search, healthcare, and software development. However, as these models scale, they become more vulnerable to cybersecurity risks,…

Cryptography and Security · Computer Science 2024-10-01 Qin Liu , Wenjie Mo , Terry Tong , Jiashu Xu , Fei Wang , Chaowei Xiao , Muhao Chen

To develop effective and efficient graph similarity learning (GSL) models, a series of data-driven neural algorithms have been proposed in recent years. Although GSL models are frequently deployed in privacy-sensitive scenarios, the user…

Machine Learning · Computer Science 2022-10-24 Yupeng Hou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen

Large language models (LLMs) often develop learned mechanisms specialized to specific datasets, such as reliance on domain-specific correlations, which yield high-confidence predictions without generalizable reasoning. While beneficial in…

Computation and Language · Computer Science 2025-07-15 Ameen Ali , Shahar Katz , Lior Wolf , Ivan Titov

The integration of additional modalities increases the susceptibility of large vision-language models (LVLMs) to safety risks, such as jailbreak attacks, compared to their language-only counterparts. While existing research primarily…

Computation and Language · Computer Science 2025-06-24 Yilei Jiang , Xinyan Gao , Tianshuo Peng , Yingshui Tan , Xiaoyong Zhu , Bo Zheng , Xiangyu Yue

Large language models (LLMs) have demonstrated immense utility across various industries. However, as LLMs advance, the risk of harmful outputs increases due to incorrect or malicious instruction prompts. While current methods effectively…

Computation and Language · Computer Science 2025-06-19 Xinyi Zeng , Yuying Shang , Jiawei Chen , Jingyuan Zhang , Yu Tian

The widespread deployment of LLM-based agents is likely to introduce a critical privacy threat: malicious agents that proactively engage others in multi-turn interactions to extract sensitive information. However, the evolving nature of…

Cryptography and Security · Computer Science 2026-05-11 Yanzhe Zhang , Diyi Yang

Large Language Models (LLMs) excel in various domains but pose inherent privacy risks. Existing methods to evaluate privacy leakage in LLMs often use memorized prefixes or simple instructions to extract data, both of which well-alignment…

Cryptography and Security · Computer Science 2025-05-19 Yidan Wang , Yanan Cao , Yubing Ren , Fang Fang , Zheng Lin , Binxing Fang

Large Language Models (LLMs), now a foundation in advancing natural language processing, power applications such as text generation, machine translation, and conversational systems. Despite their transformative potential, these models…

Cryptography and Security · Computer Science 2025-08-05 Kang Chen , Xiuze Zhou , Yuanguo Lin , Jinhe Su , Yuanhui Yu , Li Shen , Fan Lin

Large Visual Language Models (LVLMs) now pose a serious yet overlooked privacy threat, as they can infer a social media user's geolocation directly from shared images, leading to unintended privacy leakage. While adversarial image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jiayi Zhu , Yihao Huang , Yue Cao , Xiaojun Jia , Qing Guo , Felix Juefei-Xu , Geguang Pu , Bin Wang

With the widespread application of Large Language Models (LLMs), their associated security issues have become increasingly prominent, severely constraining their trustworthy deployment in critical domains. This paper proposes a novel safety…

Artificial Intelligence · Computer Science 2025-11-18 Qi Li , Jianjun Xu , Pingtao Wei , Jiu Li , Peiqiang Zhao , Jiwei Shi , Xuan Zhang , Yanhui Yang , Xiaodong Hui , Peng Xu , Wenqin Shao

Federated learning (FL) has become a key component in various language modeling applications such as machine translation, next-word prediction, and medical record analysis. These applications are trained on datasets from many FL…

Cryptography and Security · Computer Science 2025-12-11 Md Rafi Ur Rashid , Vishnu Asutosh Dasu , Kang Gu , Najrin Sultana , Shagufta Mehnaz

Recent advancements in Large Language Models (LLMs), such as ChatGPT and LLaMA, have significantly transformed Natural Language Processing (NLP) with their outstanding abilities in text generation, summarization, and classification.…

Computation and Language · Computer Science 2024-08-12 Md Nazmus Sakib , Md Athikul Islam , Royal Pathak , Md Mashrur Arifin