English

TriniMark: A Robust Generative Speech Watermarking Method for Trinity-Level Traceability

Multimedia 2026-02-17 v2 Cryptography and Security Sound Audio and Speech Processing

Abstract

Diffusion-based speech generation has achieved remarkable fidelity, increasing the risk of misuse and unauthorized redistribution. However, most existing generative speech watermarking methods are developed for GAN-based pipelines, and watermarking for diffusion-based speech generation remains comparatively underexplored. In addition, prior work often focuses on content-level provenance, while support for model-level and user-level attribution is less mature. We propose \textbf{TriniMark}, a diffusion-based generative speech watermarking framework that targets trinity-level traceability, i.e., the ability to associate a generated speech sample with (i) the embedded watermark message (content-level provenance), (ii) the source generative model (model-level attribution), and (iii) the end user who requested generation (user-level traceability). TriniMark uses a lightweight encoder to embed watermark bits into time-domain speech features and reconstruct the waveform, and a temporal-aware gated convolutional decoder for reliable bit recovery. We further introduce a waveform-guided fine-tuning strategy to transfer watermarking capability into a diffusion model. Finally, we incorporate variable-watermark training so that a single trained model can embed different watermark messages at inference time, enabling scalable user-level traceability. Experiments on speech datasets indicate that TriniMark maintains speech quality while improving robustness to common single and compound signal-processing attacks, and it supports high-capacity watermarking for large-scale traceability.

Keywords

Cite

@article{arxiv.2504.20532,
  title  = {TriniMark: A Robust Generative Speech Watermarking Method for Trinity-Level Traceability},
  author = {Yue Li and Weizhi Liu and Kaiqing Lin and Dongdong Lin and Kassem Kallas},
  journal= {arXiv preprint arXiv:2504.20532},
  year   = {2026}
}
R2 v1 2026-06-28T23:14:56.957Z