English
Related papers

Related papers: How does Watermarking Affect Visual Language Model…

200 papers

Watermarking has emerged as a pivotal solution for content traceability and intellectual property protection in Large Vision-Language Models (LVLMs). However, vision-agnostic watermarks may introduce visually irrelevant tokens and disrupt…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yue Li , Xin Yi , Dongsheng Shi , Yongyi Cui , Gerard de Melo , Linlin Wang

LLMs now exhibit human-like skills in various fields, leading to worries about misuse. Thus, detecting generated text is crucial. However, passive detection methods are stuck in domain specificity and limited adversarial robustness. To…

Computation and Language · Computer Science 2023-05-17 Xi Yang , Kejiang Chen , Weiming Zhang , Chang Liu , Yuang Qi , Jie Zhang , Han Fang , Nenghai Yu

We consider the emerging problem of identifying the presence and use of watermarking schemes in widely used, publicly hosted, closed source large language models (LLMs). We introduce a suite of baseline algorithms for identifying watermarks…

Machine Learning · Computer Science 2023-05-31 Leonard Tang , Gavin Uberti , Tom Shlomi

With the application of vertical domain pre-trained language models (VPLMs) in specialized fields such as medical, finance, and law, model parameters and inference capabilities have become important digital assets. Achieving traceable…

Cryptography and Security · Computer Science 2026-05-05 Cong Kong , Xin Cheng , Zhaoxia Yin , Shuai Li , Jie Zhang , Weiming Zhang

The advent of video-based Large Language Models (LLMs) has significantly enhanced video understanding. However, it has also raised some safety concerns regarding data protection, as videos can be more easily annotated, even without…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Jinmin Li , Kuofeng Gao , Yang Bai , Jingyun Zhang , Shu-Tao Xia

Aligning visual features with language embeddings is a key challenge in vision-language models (VLMs). The performance of such models hinges on having a good connector that maps visual features generated by a vision encoder to a shared…

Reasoning Large Language Models (RLLMs) excelling in complex tasks present unique challenges for digital watermarking, as existing methods often disrupt logical coherence or incur high computational costs. Token-based watermarking…

Artificial Intelligence · Computer Science 2026-04-02 Shuliang Liu , Xingyu Li , Hongyi Liu , Dong Fang , Yibo Yan , Bingchen Duan , Qi Zheng , Lingfeng Su , Xuming Hu

Detecting whether copyright holders' works were used in LLM pretraining is poised to be an important problem. This work proposes using data watermarks to enable principled detection with only black-box model access, provided that the…

Cryptography and Security · Computer Science 2024-08-20 Johnny Tian-Zheng Wei , Ryan Yixiang Wang , Robin Jia

Vision-Language Models (VLMs) excel in integrating visual and textual information for vision-centric tasks, but their handling of inconsistencies between modalities is underexplored. We investigate VLMs' modality preferences when faced with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ailin Deng , Tri Cao , Zhirui Chen , Bryan Hooi

The indistinguishability of large language model (LLM) output from human-authored content poses significant challenges, raising concerns about potential misuse of AI-generated text and its influence on future model training. Watermarking…

Cryptography and Security · Computer Science 2026-04-16 Alexander Nemecek , Yuzhou Jiang , Erman Ayday

The task of discerning between generated and natural texts is increasingly challenging. In this context, watermarking emerges as a promising technique for ascribing generated text to a specific model. It alters the sampling generation…

Computation and Language · Computer Science 2023-11-09 Pierre Fernandez , Antoine Chaffin , Karim Tit , Vivien Chappelier , Teddy Furon

Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for safe semantic reasoning and decision-making. While recent VLMs demonstrate strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Guo Cheng

Detecting machine-generated text is essential for transparency and accountability when deploying large language models (LLMs). Among detection approaches, watermarking is a statistically reliable method by design -- it embeds detectable…

Computation and Language · Computer Science 2026-05-05 Koshiro Saito , Ryuto Koike , Masahiro Kaneko , Naoaki Okazaki

LLM watermarks stand out as a promising way to attribute ownership of LLM-generated text. One threat to watermark credibility comes from spoofing attacks, where an unauthorized third party forges the watermark, enabling it to falsely…

Cryptography and Security · Computer Science 2025-05-23 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

Large Language Models (LLMs) are increasingly integrated into diverse industries, posing substantial security risks due to unauthorized replication and misuse. To mitigate these concerns, robust identification mechanisms are widely…

Cryptography and Security · Computer Science 2024-07-25 Xuhong Wang , Haoyu Jiang , Yi Yu , Jingru Yu , Yilun Lin , Ping Yi , Yingchun Wang , Yu Qiao , Li Li , Fei-Yue Wang

Watermarking has emerged as a promising technique for detecting texts generated by LLMs. Current research has primarily focused on three design criteria: high quality of the watermarked text, high detectability, and robustness against…

Cryptography and Security · Computer Science 2025-04-11 Li An , Yujian Liu , Yepeng Liu , Yang Zhang , Yuheng Bu , Shiyu Chang

Despite significant progress in multimodal language models (LMs), it remains unclear whether visual grounding enhances their understanding of embodied knowledge compared to text-only models. To address this question, we propose a novel…

Computation and Language · Computer Science 2025-10-21 Zhihui Yang , Yupei Wang , Kaijie Mo , Zhe Zhao , Renfen Hu

Recent research on Vision Language Models (VLMs) suggests that they rely on inherent biases learned during training to respond to questions about visual properties of an image. These biases are exacerbated when VLMs are asked highly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Saurav Sengupta , Nazanin Moradinasab , Jiebei Liu , Donald E. Brown

Protecting intellectual property (IP) of text such as articles and code is increasingly important, especially as sophisticated attacks become possible, such as paraphrasing by large language models (LLMs) or even unauthorized training of…

Cryptography and Security · Computer Science 2024-10-30 Gregory Kang Ruey Lau , Xinyuan Niu , Hieu Dao , Jiangwei Chen , Chuan-Sheng Foo , Bryan Kian Hsiang Low

Modern Vision-Language Models (VLMs) exhibit remarkable visual and linguistic capabilities, achieving impressive performance in various tasks such as image recognition and object localization. However, their effectiveness in fine-grained…

Computation and Language · Computer Science 2025-09-29 Zhecheng Li , Guoxian Song , Yujun Cai , Zhen Xiong , Junsong Yuan , Yiwei Wang