中文
相关论文

相关论文: TalkingHeadBench: A Multi-Modal Benchmark & Analys…

200 篇论文

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

声音 · 计算机科学 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable. Thus, benchmarking and advancing techniques detecting…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Yaning Zhang , Zitong Yu , Tianyi Wang , Xiaobin Huang , Linlin Shen , Zan Gao , Jianfeng Ren

The rapid progress in deep generative models has led to the creation of incredibly realistic synthetic images that are becoming increasingly difficult to distinguish from real-world data. The widespread use of Variational Models, Diffusion…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Anant Mehta , Bryant McArthur , Nagarjuna Kolloju , Zhengzhong Tu

The rapid advancement of deepfake technology poses a significant threat to digital media integrity. Deepfakes, synthetic media created using AI, can convincingly alter videos and audio to misrepresent reality. This creates risks of…

计算机视觉与模式识别 · 计算机科学 2024-10-21 Kashish Gandhi , Prutha Kulkarni , Taran Shah , Piyush Chaudhari , Meera Narvekar , Kranti Ghag

Deepfakes, leveraging advanced AIGC (Artificial Intelligence-Generated Content) techniques, create hyper-realistic synthetic images and videos of human faces, posing a significant threat to the authenticity of social media. While this…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Junyu Shi , Minghui Li , Junguo Zuo , Zhifei Yu , Yipeng Lin , Shengshan Hu , Ziqi Zhou , Yechao Zhang , Wei Wan , Yinzhe Xu , Leo Yu Zhang

When people deliver a speech, they naturally move heads, and this rhythmic head motion conveys prosodic information. However, generating a lip-synced video while moving head naturally is challenging. While remarkably successful, existing…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Lele Chen , Guofeng Cui , Celong Liu , Zhong Li , Ziyi Kou , Yi Xu , Chenliang Xu

Easy access to audio-visual content on social media, combined with the availability of modern tools such as Tensorflow or Keras, open-source trained models, and economical computing infrastructure, and the rapid evolution of deep-learning…

密码学与安全 · 计算机科学 2021-11-24 Momina Masood , Marriam Nawaz , Khalid Mahmood Malik , Ali Javed , Aun Irtaza

The rapid advancement in deep learning makes the differentiation of authentic and manipulated facial images and video clips unprecedentedly harder. The underlying technology of manipulating facial appearances through deep generative…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Sm Zobaed , Md Fazle Rabby , Md Istiaq Hossain , Ekram Hossain , Sazib Hasan , Asif Karim , Khan Md. Hasib

With the rapid integration of advanced reasoning capabilities into spoken dialogue models, the field urgently demands benchmarks that transcend simple interactions to address real-world complexity. However, current evaluations predominantly…

计算与语言 · 计算机科学 2026-02-16 Yangzhuo Li , Shengpeng Ji , Yifu Chen , Tianle Liang , Haorong Ying , Yule Wang , Junbo Li , Jun Fang , Zhou Zhao

The surging demand for large-scale datasets in deep learning has heightened the need for effective copyright protection, given the risks of unauthorized use to data owners. Although the dataset watermark technique holds promise for auditing…

密码学与安全 · 计算机科学 2026-02-17 Xiao Ren , Xinyi Yu , Linkang Du , Min Chen , Yuanchao Shu , Zhou Su , Yunjun Gao , Zhikun Zhang

Talking head video generation aims to generate a realistic talking head video that preserves the person's identity from a source image and the motion from a driving video. Despite the promising progress made in the field, it remains a…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Shuling Zhao , Fa-Ting Hong , Xiaoshui Huang , Dan Xu

All current benchmarks for multimodal deepfake detection manipulate entire frames using various generation techniques, resulting in oversaturated detection accuracies exceeding 94% at the video-level classification. However, these…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Juho Jung , Sangyoun Lee , Jooeon Kang , Yunjin Na

The rise of deepfake images, especially of well-known personalities, poses a serious threat to the dissemination of authentic information. To tackle this, we present a thorough investigation into how deepfakes are produced and how they can…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Haixu Song , Shiyu Huang , Yinpeng Dong , Wei-Wei Tu

Recent advances in speech generation have enabled high-fidelity synthesis, yet systematic evaluation of models under long-context conditions remains largely underexplored. A comprehensive evaluation benchmark for long-form speech is…

音频与语音处理 · 电气工程与系统科学 2026-05-28 Changhao Pan , Rui Yang , Han Wang , Zhuan Zhou , Xuming He , Wenxiang Guo , Ziyue Jiang , Ruiqi Li , Yu Zhang , Chenyuhao Wen , Ke Lei , Xiang Yin , Jingyu Lu , Zhiyuan Zhu , Zhou Zhao

Recent advances in text-to-audio-video (T2AV) generation have enabled models to synthesize audio-visual videos with multi-participant dialogues. However, existing evaluation benchmarks remain largely designed for human-recorded videos or…

The increasing realism of AI-generated images has raised serious concerns about misinformation and privacy violations, highlighting the urgent need for accurate and interpretable detection methods. While existing approaches have made…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Tai-Ming Huang , Wei-Tung Lin , Kai-Lung Hua , Wen-Huang Cheng , Junichi Yamagishi , Jun-Cheng Chen

Large Language Models (LLMs) hold significant potential for advancing fact-checking by leveraging their capabilities in reasoning, evidence retrieval, and explanation generation. However, existing benchmarks fail to comprehensively evaluate…

计算与语言 · 计算机科学 2025-06-17 Shuo Yang , Yuqin Dai , Guoqing Wang , Xinran Zheng , Jinfeng Xu , Jinze Li , Zhenzhe Ying , Weiqiang Wang , Edith C. H. Ngai

The rapid advancement of Generative Artificial Intelligence has fueled deepfake proliferation-synthetic media encompassing fully generated content and subtly edited authentic material-posing challenges to digital security, misinformation…

密码学与安全 · 计算机科学 2025-07-30 Naseem Khan , Tuan Nguyen , Amine Bermak , Issa Khalil

The increasing use of synthetic media, particularly deepfakes, is an emerging challenge for digital content verification. Although recent studies use both audio and visual information, most integrate these cues within a single model, which…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Sayeem Been Zaman , Wasimul Karim , Arefin Ittesafun Abian , Reem E. Mohamed , Md Rafiqul Islam , Asif Karim , Sami Azam

The availability of smart devices leads to an exponential increase in multimedia content. However, advancements in deep learning have also enabled the creation of highly sophisticated Deepfake content, including speech Deepfakes, which pose…

声音 · 计算机科学 2025-07-16 Menglu Li , Yasaman Ahmadiadli , Xiao-Ping Zhang