中文
相关论文

相关论文: Exposing Lip-syncing Deepfakes from Mouth Inconsis…

200 篇论文

Deepfake is a generative deep learning algorithm that creates or changes facial features in a very realistic way making it hard to differentiate the real from the fake features It can be used to make movies look better as well as to spread…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Nadeem Jabbar CH , Aqib Saghir , Ayaz Ahmad Meer , Salman Ahmad Sahi , Bilal Hassan , Siddiqui Muhammad Yasir

Existing methods on audio-visual deepfake detection mainly focus on high-level features for modeling inconsistencies between audio and visual data. As a result, these approaches usually overlook finer audio-visual artifacts, which are…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

In today's era of digital misinformation, we are increasingly faced with new threats posed by video falsification techniques. Such falsifications range from cheapfakes (e.g., lookalikes or audio dubbing) to deepfakes (e.g., sophisticated AI…

计算机视觉与模式识别 · 计算机科学 2022-12-05 Shruti Agarwal , Liwen Hu , Evonne Ng , Trevor Darrell , Hao Li , Anna Rohrbach

Detecting forgery videos is highly desirable due to the abuse of deepfake. Existing detection approaches contribute to exploring the specific artifacts in deepfake videos and fit well on certain data. However, the growing technique on these…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Harry Cheng , Yangyang Guo , Tianyi Wang , Qi Li , Xiaojun Chang , Liqiang Nie

Deepfake is content or material that is synthetically generated or manipulated using artificial intelligence (AI) methods, to be passed off as real and can include audio, video, image, and text synthesis. This survey has been conducted with…

声音 · 计算机科学 2021-11-30 Zahra Khanjani , Gabrielle Watson , Vandana P. Janeja

Deepfakes are computer manipulated videos where the face of an individual has been replaced with that of another. Software for creating such forgeries is easy to use and ever more popular, causing serious threats to personal reputation and…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Samuele Pino , Mark James Carman , Paolo Bestagini

Lip sync has emerged as a promising technique for generating mouth movements from audio signals. However, synthesizing a high-resolution and photorealistic virtual news anchor is still challenging. Lack of natural appearance, visual…

计算机视觉与模式识别 · 计算机科学 2021-05-06 Ruobing Zheng , Zhou Zhu , Bo Song , Changjiang Ji

The task of lip synchronization (lip-sync) seeks to match the lips of human faces with different audio. It has various applications in the film industry as well as for creating virtual avatars and for video conferencing. This is a…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Soumik Mukhopadhyay , Saksham Suri , Ravi Teja Gadde , Abhinav Shrivastava

Lip sync is a fundamental audio-visual task. However, existing lip sync methods fall short of being robust in the wild. One important cause could be distracting factors on the visual input side, making extracting lip motion information…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Chun Wang

A deepfake is a photo or video of a person whose image has been digitally altered or partially replaced with an image of someone else. Deepfakes have the potential to cause a variety of problems and are often used maliciously. A common…

人工智能 · 计算机科学 2024-09-01 Natalie Krueger , Mounika Vanamala , Rushit Dave

In this paper, we present StyleLipSync, a style-based personalized lip-sync video generative model that can generate identity-agnostic lip-synchronizing video from arbitrary audio. To generate a video of arbitrary identities, we leverage…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Taekyung Ki , Dongchan Min

With the rise in manipulated media, deepfake detection has become an imperative task for preserving the authenticity of digital content. In this paper, we present a novel multi-modal audio-video framework designed to concurrently process…

计算机视觉与模式识别 · 计算机科学 2023-09-14 Aaditya Kharel , Manas Paranjape , Aniket Bera

Deepfake videos present an increasing threat to society with potentially negative impact on criminal justice, democracy, and personal safety and privacy. Meanwhile, detecting deepfakes, at scale, remains a very challenging task that often…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Mulin Tian , Mahyar Khayatkhoei , Joe Mathai , Wael AbdAlmageed

The fast evolution and widespread of deepfake techniques in real-world scenarios require stronger generalization abilities of face forgery detectors. Some works capture the features that are unrelated to method-specific artifacts, such as…

计算机视觉与模式识别 · 计算机科学 2022-03-03 Hanqing Zhao , Wenbo Zhou , Dongdong Chen , Weiming Zhang , Nenghai Yu

In this paper, we propose a new method to expose AI-generated fake face images or videos (commonly known as the Deep Fakes). Our method is based on the observations that Deep Fakes are created by splicing synthesized face region into the…

计算机视觉与模式识别 · 计算机科学 2018-11-15 Xin Yang , Yuezun Li , Siwei Lyu

We propose detection of deepfake videos based on the dissimilarity between the audio and visual modalities, termed as the Modality Dissonance Score (MDS). We hypothesize that manipulation of either modality will lead to dis-harmony between…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Komal Chugh , Parul Gupta , Abhinav Dhall , Ramanathan Subramanian

Real-time deepfake, a type of generative AI, is capable of "creating" non-existing contents (e.g., swapping one's face with another) in a video. It has been, very unfortunately, misused to produce deepfake videos (during web conferences,…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Zhixin Xie , Jun Luo

Synthetically-generated audios and videos -- so-called deep fakes -- continue to capture the imagination of the computer-graphics and computer-vision communities. At the same time, the democratization of access to technology that can create…

计算机视觉与模式识别 · 计算机科学 2021-01-29 Shruti Agarwal , Tarek El-Gaaly , Hany Farid , Ser-Nam Lim

In the domain of photorealistic avatar generation, the fidelity of audio-driven lip motion synthesis is essential for realistic virtual interactions. Existing methods face two key challenges: a lack of vivacity due to limited diversity in…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Deng Junli , Luo Yihao , Yang Xueting , Li Siyou , Wang Wei , Guo Jinyang , Shi Ping

Under the aegis of computer vision and deep learning technology, a new emerging techniques has introduced that anyone can make highly realistic but fake videos, images even can manipulates the voices. This technology is widely known as…

机器学习 · 计算机科学 2023-02-15 Bahar Uddin Mahmud , Afsana Sharmin