English
Related papers

Related papers: SOLIDO: A Robust Watermarking Method for Speech Sy…

200 papers

Large Language Models (LLMs) excel in various applications, including text generation and complex tasks. However, the misuse of LLMs raises concerns about the authenticity and ethical implications of the content they produce, such as…

Cryptography and Security · Computer Science 2024-12-02 Zesen Liu , Tianshuo Cong , Xinlei He , Qi Li

Multi-bit watermarking has emerged as a promising solution for embedding imperceptible binary messages into Large Language Model (LLM)-generated text, enabling reliable attribution and tracing of malicious usage of LLMs. Despite recent…

Computation and Language · Computer Science 2026-04-17 Jiahao Xu , Rui Hu , Olivera Kotevska , Zikai Zhang

The indistinguishability of AI-generated content from human text raises challenges in transparency and accountability. While several methods exist to watermark models behind APIs, embedding watermark strategies directly into model weights…

Machine Learning · Computer Science 2025-04-10 Fay Elhassan , Niccolò Ajroldi , Antonio Orvieto , Jonas Geiping

With the advancement of AI-based speech synthesis technologies such as Deep Voice, there is an increasing risk of voice spoofing attacks, including voice phishing and fake news, through unauthorized use of others' voices. Existing defenses…

Machine Learning · Computer Science 2025-05-20 Seungmin Kim , Sohee Park , Donghyun Kim , Jisu Lee , Daeseon Choi

The dominant approach to generating from language models subject to some constraint is locally constrained decoding (LCD), incrementally sampling tokens at each time step such that the constraint is never violated. Typically, this is…

Large Language Models (LLMs) can be misused to spread unwanted content at scale. Content watermarking deters misuse by hiding messages in content, enabling its detection using a secret watermarking key. Robustness is a core security…

Cryptography and Security · Computer Science 2025-05-22 Abdulrahman Diaa , Toluwani Aremu , Nils Lukas

The most effective techniques to detect LLM-generated text rely on inserting a detectable signature -- or watermark -- during the model's decoding process. Most existing watermarking methods require access to the underlying LLM's logits,…

Machine Learning · Computer Science 2024-10-14 Yapei Chang , Kalpesh Krishna , Amir Houmansadr , John Wieting , Mohit Iyyer

Robust watermarking is critical for intellectual property protection, whereas existing methods face a severe vulnerability against regeneration-based AIGC attacks. We identify that existing methods fail because they entangle the watermark…

Machine Learning · Computer Science 2026-02-26 Haoyuan He , Yu Zheng , Jie Zhou , Jiwen Lu

As deep learning technology continues to advance, image generation models, especially models like Stable Diffusion, are finding increasingly widespread application in visual arts creation. However, these models often face challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Chengcheng Feng , Mu He , Qiuyu Tian , Haojie Yin , Xiaofang Zhao , Hongwei Tang , Xingqiang Wei

With the significant advances in deep generative models for image and video synthesis, Deepfakes and manipulated media have raised severe societal concerns. Conventional machine learning classifiers for deepfake detection often fail to cope…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Aakash Varma Nadimpalli , Ajita Rattani

Balancing exploration and exploitation during reinforcement learning fine-tuning of generative models presents a critical challenge, as existing approaches rely on fixed divergence regularization that creates an inherent dilemma: strong…

Machine Learning · Computer Science 2025-10-22 Jiajun Fan , Tong Wei , Chaoran Cheng , Yuxin Chen , Ge Liu

Recent research has delved into speech enhancement (SE) approaches that leverage audio embeddings from pre-trained models, diverging from time-frequency masking or signal prediction techniques. This paper introduces an efficient and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Xingwei Sun , Heinrich Dinkel , Yadong Niu , Linzhang Wang , Junbo Zhang , Jian Luan

Recent advances in large-scale text-to-image (T2I) diffusion models have enabled a variety of downstream applications, including style customization, subject-driven personalization, and conditional generation. As T2I models require…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zilan Wang , Junfeng Guo , Jiacheng Zhu , Yiming Li , Heng Huang , Muhao Chen , Zhengzhong Tu

To ensure that text generated by large language models (LLMs) is in an expected format, constrained decoding proposes to enforce strict formal language constraints during generation. However, as we show in this work, not only do such…

Machine Learning · Computer Science 2024-03-13 Luca Beurer-Kellner , Marc Fischer , Martin Vechev

Recent advances in speech spoofing necessitate stronger verification mechanisms in neural speech codecs to ensure authenticity. Current methods embed numerical watermarks before compression and extract them from reconstructed speech for…

Sound · Computer Science 2024-12-30 Junzuo Zhou , Jiangyan Yi , Yong Ren , Jianhua Tao , Tao Wang , Chu Yuan Zhang

As diffusion models (DMs) enable photorealistic image generation at unprecedented scale, watermarking techniques have become essential for provenance establishment and accountability. Existing methods face challenges: sampling-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hong-Hanh Nguyen-Le , Van-Tuan Tran , Thuc D. Nguyen , Nhien-An Le-Khac

The proliferation of AI-generated content brings significant concerns on the forensic and security issues such as source tracing, copyright protection, etc, highlighting the need for effective watermarking technologies. Font-based text…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Kahim Wong , Jicheng Zhou , Kemou Li , Yain-Whar Si , Xiaowei Wu , Jiantao Zhou

This paper proposes a generative pretraining foundation model for high-quality speech restoration tasks. By directly operating on complex-valued short-time Fourier transform coefficients, our model does not rely on any vocoders for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Pin-Jui Ku , Alexander H. Liu , Roman Korostik , Sung-Feng Huang , Szu-Wei Fu , Ante Jukić

Watermarking is a commonly used strategy to protect creators' rights to digital images, videos and audio. Recently, watermarking methods have been extended to deep learning models -- in principle, the watermark should be preserved when an…

The use of low-rank adaptation (LoRA) with frozen pretrained language models (PLMs) has become increasing popular as a mainstream, resource-efficient modeling approach for memory-constrained hardware. In this study, we first explore how to…