English
Related papers

Related papers: mAVE: A Watermark for Joint Audio-Visual Generatio…

200 papers

The widespread use of Large Language Models (LLMs) in text generation has raised increasing concerns about intellectual property disputes. Watermarking techniques, which embed meta information into AI-generated content (AIGC), have the…

Cryptography and Security · Computer Science 2026-04-15 Shangkun Che , Silin Du , Ge Gao

Deepfakes are synthetic media generated using deep generative algorithms and have posed a severe societal and political threat. Apart from facial manipulation and synthetic voice, recently, a novel kind of deepfakes has emerged with either…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Vinaya Sree Katamneni , Ajita Rattani

In real-world applications, it is challenging to build a speaker verification system that is simultaneously robust against common threats, including spoofing attacks, channel mismatch, and domain mismatch. Traditional automatic speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-11 Chang Zeng , Xiaoxiao Miao , Xin Wang , Erica Cooper , Junichi Yamagishi

Voice cloning (VC)-resistant watermarking is an emerging technique for tracing and preventing unauthorized cloning. Existing methods effectively trace traditional VC models by training them on watermarked audio but fail in zero-shot VC…

Sound · Computer Science 2025-06-02 Haiyun Li , Zhiyong Wu , Xiaofeng Xie , Jingran Xie , Yaoxun Xu , Hanyang Peng

Federated learning (FL) allows multiple participants to collaboratively build deep learning (DL) models without directly sharing data. Consequently, the issue of copyright protection in FL becomes important since unreliable participants may…

Cryptography and Security · Computer Science 2023-03-06 Wenyuan Yang , Shuo Shao , Yue Yang , Xiyao Liu , Ximeng Liu , Zhihua Xia , Gerald Schaefer , Hui Fang

Music streaming fraud, where bad actors artificially inflate stream counts to manipulate chart rankings and royalty payments, poses a significant threat to streaming services and legitimate content creators. Traditional fraud detection…

Machine Learning · Computer Science 2026-05-20 Sudheer Tubati , Amit Goyal

Advances in computer vision and deep learning have blurred the line between deepfakes and authentic media, undermining multimedia credibility through audio-visual forgery. Current multimodal detection methods remain limited by unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zihan Xiong , Xiaohua Wu , Lei Chen , Fangqi Lou

Audio-visual speech recognition (AVSR) has become critical for enhancing speech recognition in noisy environments by integrating both auditory and visual modalities. However, existing AVSR systems struggle to scale up without compromising…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-22 Sungnyun Kim , Kangwook Jang , Sangmin Bae , Sungwoo Cho , Se-Young Yun

Invisible watermarking has become a critical mechanism for authenticating AI-generated image content, with major platforms deploying watermarking schemes at scale. However, evaluating the vulnerability of these schemes against sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Fahad Shamshad , Nils Lukas , Karthik Nandakumar

To accommodate heterogeneous tasks in Internet of Things (IoT), a new communication and computing paradigm termed mobile edge computing emerges that extends computing services from the cloud to edge, but at the same time exposes new…

Machine Learning · Computer Science 2020-01-08 Bingcong Li , Tianyi Chen , Georgios B. Giannakis

The proliferation of AI-generated content and sophisticated video editing tools has made it both important and challenging to moderate digital platforms. Video watermarking addresses these challenges by embedding imperceptible signals into…

Multimedia · Computer Science 2024-12-13 Pierre Fernandez , Hady Elsahar , I. Zeki Yalniz , Alexandre Mourachko

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

Underwater video pairs are fairly difficult to obtain due to the complex underwater imaging. In this case, most existing video underwater enhancement methods are performed by directly applying the single-image enhancement model frame by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Qi Zhu , Jingyi Zhang , Naishan Zheng , Wei Yu , Jinghao Zhang , Deyi Ji , Feng Zhao

Learning aligned multimodal embeddings from weakly paired, label-free corpora is challenging: pipelines often provide only pre-extracted features, clips contain multiple events, and spurious co-occurrences. We propose HSC-MAE (Hierarchical…

Multimedia · Computer Science 2026-04-07 Donghuo Zeng , Hao Niu , Masato Taya

Audio-Visual Video Parsing (AVVP) task aims to detect and temporally locate events within audio and visual modalities. Multiple events can overlap in the timeline, making identification challenging. While traditional methods usually focus…

Artificial Intelligence · Computer Science 2024-07-12 Jinxing Zhou , Dan Guo , Yuxin Mao , Yiran Zhong , Xiaojun Chang , Meng Wang

Reversible visible watermarking (RVW) is an active copyright protection mechanism. It not only transparently superimposes copyright patterns on specific positions of digital images or video frames to declare the copyright ownership…

Multimedia · Computer Science 2022-01-12 Wenfa Qi , Sirui Guo , Wei Hu

Generative models that can produce realistic images have improved significantly in recent years. The quality of the generated content has increased drastically, so sometimes it is very difficult to distinguish between the real images and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Mikhail Pautov , Danil Ivanov , Andrey V. Galichin , Oleg Rogov , Ivan Oseledets

As machine- and AI-generated content proliferates, protecting the intellectual property of generative models has become imperative, yet verifying data ownership poses formidable challenges, particularly in cases of unauthorized reuse of…

Machine Learning · Computer Science 2024-02-28 Aditya Desu , Xuanli He , Qiongkai Xu , Wei Lu

The increasing realism of synthetic speech, driven by advancements in text-to-speech models, raises ethical concerns regarding impersonation and disinformation. Audio watermarking offers a promising solution via embedding…

Machine Learning · Computer Science 2024-11-14 Hongbin Liu , Moyang Guo , Zhengyuan Jiang , Lun Wang , Neil Zhenqiang Gong

Audio-Visual Navigation (AVN) requires an embodied agent to navigate toward a sound source by utilizing both vision and binaural audio. A core challenge arises in complex acoustic environments, where binaural cues become intermittently…

Sound · Computer Science 2026-04-06 Teng Liu , Yinfeng Yu