English
Related papers

Related papers: Smark: A Watermark for Text-to-Speech Diffusion Mo…

200 papers

Text-to-speech(TTS) has undergone remarkable improvements in performance, particularly with the advent of Denoising Diffusion Probabilistic Models (DDPMs). However, the perceived quality of audio depends not solely on its content, pitch,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-23 Huadai Liu , Rongjie Huang , Xuan Lin , Wenqiang Xu , Maozong Zheng , Hong Chen , Jinzheng He , Zhou Zhao

Unified architectures in multimodal large language models (MLLM) have shown promise in handling diverse tasks within a single framework. In the text-to-speech (TTS) task, current MLLM-based approaches rely on discrete token representations,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-27 Xinlu He , Swayambhu Nath Ray , Harish Mallidi , Jia-Hong Huang , Ashwin Bellur , Chander Chandak , M. Maruf , Venkatesh Ravichandran

In recent years, speech diffusion models have advanced rapidly. Alongside the widely used U-Net architecture, transformer-based models such as the Diffusion Transformer (DiT) have also gained attention. However, current DiT speech models…

Watermarking diffusion-generated images is crucial for copyright protection and user tracking. However, current diffusion watermarking methods face significant limitations: zero-bit watermarking systems lack the capacity for large-scale…

Cryptography and Security · Computer Science 2025-09-01 Jiazheng Xing , Hai Ci , Hongbin Xu , Hangjie Yuan , Yong Liu , Mike Zheng Shou

The availability and accessibility of diffusion models (DMs) have significantly increased in recent years, making them a popular tool for analyzing and predicting the spread of information, behaviors, or phenomena through a population.…

Cryptography and Security · Computer Science 2023-05-23 Yugeng Liu , Zheng Li , Michael Backes , Yun Shen , Yang Zhang

Embedding watermarks into the output of generative models is essential for establishing copyright and verifiable ownership over the generated content. Emerging diffusion model watermarking methods either embed watermarks in the frequency…

Image and Video Processing · Electrical Eng. & Systems 2025-02-18 Yunzhuo Chen , Jordan Vice , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

This paper proposes a zero-shot text-to-speech (TTS) conditioned by a self-supervised speech-representation model acquired through self-supervised learning (SSL). Conventional methods with embedding vectors from x-vector or global style…

Sound · Computer Science 2023-12-19 Kenichi Fujita , Takanori Ashihara , Hiroki Kanagawa , Takafumi Moriya , Yusuke Ijima

Due to the wide distribution and usage of digital media, an important issue is protection of the digital content. There is a number of algorithms and techniques developed for the digital watermarking.In this paper, the invisible image…

Multimedia · Computer Science 2015-02-09 Jelena Music , Ivan Knezevic , Edis Franca

Watermarking is a tool for actively identifying and attributing the images generated by latent diffusion models. Existing methods face the dilemma of image quality and watermark robustness. Watermarks with superior image quality usually…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zheling Meng , Bo Peng , Jing Dong

In this paper, a new approach to Spread Spectrum (SS) watermarking technique is introduced. This problem is particularly interesting in the field of modern multimedia applications like internet when copyright protection of digital image is…

Cryptography and Security · Computer Science 2012-07-12 T. S. Das , V. H. Mankar , S. K. Sarkar

As Large Language Models (LLMs) become increasingly sophisticated, they raise significant security concerns, including the creation of fake news and academic misuse. Most detectors for identifying model-generated text are limited by their…

Cryptography and Security · Computer Science 2024-10-10 Zhenyu Xu , Victor S. Sheng

The increasing realism of synthetic speech, driven by advancements in text-to-speech models, raises ethical concerns regarding impersonation and disinformation. Audio watermarking offers a promising solution via embedding…

Machine Learning · Computer Science 2024-11-14 Hongbin Liu , Moyang Guo , Zhengyuan Jiang , Lun Wang , Neil Zhenqiang Gong

We introduce a text-to-speech(TTS) framework based on a neural transducer. We use discretized semantic tokens acquired from wav2vec2.0 embeddings, which makes it easy to adopt a neural transducer for the TTS framework enjoying its monotonic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-09 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Dongjune Lee , Nam Soo Kim

With the demand for autonomous control and personalized speech generation, the style control and transfer in Text-to-Speech (TTS) is becoming more and more important. In this paper, we propose a new TTS system that can perform style…

Sound · Computer Science 2023-07-12 Wenhao Guan , Tao Li , Yishuang Li , Hukai Huang , Qingyang Hong , Lin Li

In recent years, discrete wavelet transform (DWT) provides an useful platform for digital information hiding and copyright protection. Many DWT-based algorithms for this aim are proposed. The performance of these algorithms is in term of…

Cryptography and Security · Computer Science 2011-04-04 S. -T. Chen , H. -N. Huang , S. -Y. Tu

We propose a novel audio watermarking system that is robust to the distortion due to the indoor acoustic propagation channel between the loudspeaker and the receiving microphone. The system utilizes a set of new algorithms that effectively…

Multimedia · Computer Science 2019-03-21 Yuan-Yen Tai , Mohamed F. Mansour

Recently, there has been a growing interest in text-to-speech (TTS) methods that can be trained with minimal supervision by combining two types of discrete speech representations and using two sequence-to-sequence tasks to decouple TTS.…

Sound · Computer Science 2023-12-19 Chunyu Qiang , Hao Li , Hao Ni , He Qu , Ruibo Fu , Tao Wang , Longbiao Wang , Jianwu Dang

A novel digital watermarking for ownership verification and image authentication applications using discrete wavelet transform (DWT) is proposed in this paper. Most previous proposed watermarking algorithms embed sequences of random numbers…

Cryptography and Security · Computer Science 2012-06-21 Mehdi Khalili

In this work, we present DiffVoice, a novel text-to-speech model based on latent diffusion. We propose to first encode speech signals into a phoneme-rate latent representation with a variational autoencoder enhanced by adversarial training,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-25 Zhijun Liu , Yiwei Guo , Kai Yu

Watermarking embeds information into digital content like images, audio, or text, imperceptible to humans but robustly detectable by specific algorithms. This technology has important applications in many challenges of the industry such as…

Cryptography and Security · Computer Science 2025-02-11 Pierre Fernandez