English
Related papers

Related papers: MOLM: Mixture of LoRA Markers

200 papers

Latent generative models (e.g., Stable Diffusion) have become more and more popular, but concerns have arisen regarding potential misuse related to images generated by these models. It is, therefore, necessary to analyze the origin of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhenting Wang , Vikash Sehwag , Chen Chen , Lingjuan Lyu , Dimitris N. Metaxas , Shiqing Ma

We study the problem of multi-bit watermarking for large language models (LLMs). We introduce a block-autoregressive model inspired by multi-token prediction, in which the encoder has limited non-causal access to token distributions within…

Information Theory · Computer Science 2026-05-19 Sidong Guo , Tyler Kann , Teodora Baluta , Matthieu R. Bloch

Recent advances in generative AI have enabled the creation of highly realistic digital content, raising concerns around authenticity, ownership, and misuse. While watermarking has become an increasingly important mechanism to trace and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Maria Bulychev , Neil G. Marchant , Benjamin I. P. Rubinstein

Modern generative diffusion models rely on vast training datasets, often including images with uncertain ownership or usage rights. Radioactive watermarks -- marks that transfer to a model's outputs -- can help detect when such unauthorized…

Cryptography and Security · Computer Science 2025-12-02 Kexin Li , Guozhen Ding , Ilya Grishchenko , David Lie

The capabilities of large language models have grown significantly in recent years and so too have concerns about their misuse. It is important to be able to distinguish machine-generated text from human-authored content. Prior works have…

Cryptography and Security · Computer Science 2024-10-15 Julien Piet , Chawin Sitawarin , Vivian Fang , Norman Mu , David Wagner

Current Vision-Language-Action (VLA) models predominantly rely on end-to-end fine-tuning. While effective, this paradigm compromises the inherent generalization capabilities of Vision-Language Models (VLMs) and incurs catastrophic…

The rapid advancement of generative technologies has made synthetic images nearly indistinguishable from real ones, thereby creating an urgent need for robust detectors to counter misinformation. However, existing methods mainly rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yutong Xiao , Ran Ran , Jiwei Wei , Shuchang Zhou , Ke Liu , Zheng Ziqiang , Caiyan Qin

Continual learning for vision-language models has achieved remarkable performance through synthetic replay, where samples are generated using Stable Diffusion to regularize during finetuning and retain knowledge. However, real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Kaihong Wang , Donghyun Kim , Margrit Betke

To mitigate the potential harms of Large Language Models (LLMs)generated text, researchers have proposed watermarking, a process of embedding detectable signals within text. With watermarking, we can always accurately detect LLM-generated…

Computation and Language · Computer Science 2025-11-19 William Guo , Adaku Uchendu , Ana Smith

Text watermarks in large language models (LLMs) are increasingly used to detect synthetic text, mitigating misuse cases like fake news and academic dishonesty. While existing watermarking detection techniques primarily focus on classifying…

Computation and Language · Computer Science 2025-06-13 Xuandong Zhao , Chenwen Liao , Yu-Xiang Wang , Lei Li

We consider multiple transmitters aiming to communicate their source signals (e.g., images) over a multiple access channel (MAC). Conventional communication systems minimize interference by orthogonally allocating resources (time and/or…

Networking and Internet Architecture · Computer Science 2025-04-08 Selim F. Yilmaz , Can Karamanli , Deniz Gunduz

Watermarking language models is essential for distinguishing between human and machine-generated text and thus maintaining the integrity and trustworthiness of digital communication. We present a novel green/red list watermarking approach…

Machine Learning · Statistics 2025-06-13 Yangxinyu Xie , Xiang Li , Tanwi Mallick , Weijie J. Su , Ruixun Zhang

Flow matching has emerged as a promising generative approach that addresses the lengthy sampling times associated with state-of-the-art diffusion models and enables a more flexible trajectory design, while maintaining high-quality image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Arnela Hadzic , Franz Thaler , Lea Bogensperger , Simon Johannes Joham , Martin Urschler

Low-Rank Adaptation (LoRA) drives research to align its performance with full fine-tuning. However, significant challenges remain: (1) Simply increasing the rank size of LoRA does not effectively capture high-rank information, which leads…

Machine Learning · Computer Science 2024-10-21 Chuanyu Tang , Yilong Chen , Zhenyu Zhang , Junyuan Shang , Wenyuan Zhang , Yong Huang , Tingwen Liu

In this paper, we introduce \emph{Luminark}, a training-free and probabilistically-certified watermarking method for general vision generative models. Our approach is built upon a novel watermark definition that leverages patch-level…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jiayi Xu , Zhang Zhang , Yuanrui Zhang , Ruitao Chen , Yixian Xu , Tianyu He , Di He

Effectively integrating molecular graph structures with Large Language Models (LLMs) is a key challenge in drug discovery. Most existing multi-modal alignment methods typically process these structures by fine-tuning the LLM or adding a…

Machine Learning · Computer Science 2025-10-15 Tao Yin , Xiaohong Zhang , Jiacheng Zhang , Li Huang , Zhibin Zhang , Yuansong Zeng , Jin Xie , Meng Yan

The proliferation of Large Language Models (LLMs) necessitates efficient mechanisms to distinguish machine-generated content from human text. While statistical watermarking has emerged as a promising solution, existing methods suffer from…

Machine Learning · Computer Science 2026-02-20 Baihe Huang , Eric Xu , Kannan Ramchandran , Jiantao Jiao , Michael I. Jordan

Code Large Language Models (Code LLMs) have revolutionized software development but raised critical concerns regarding code provenance, copyright protection, and security. Existing code watermarking approaches suffer from two fundamental…

Cryptography and Security · Computer Science 2026-04-20 Yuqing Nie , Chong Wang , Guosheng Xu , Guoai Xu , Chenyu Wang , Haoyu Wang , Kailong Wang

The most effective techniques to detect LLM-generated text rely on inserting a detectable signature -- or watermark -- during the model's decoding process. Most existing watermarking methods require access to the underlying LLM's logits,…

Machine Learning · Computer Science 2024-10-14 Yapei Chang , Kalpesh Krishna , Amir Houmansadr , John Wieting , Mohit Iyyer

Watermarking techniques offer a promising way to identify machine-generated content via embedding covert information into the contents generated from language models (LMs). However, the robustness of the watermarking schemes has not been…

Computation and Language · Computer Science 2025-07-04 Ruibo Chen , Yihan Wu , Junfeng Guo , Heng Huang