English
Related papers

Related papers: Face Consistency Benchmark for GenAI Video

200 papers

Detecting forgery videos is highly desirable due to the abuse of deepfake. Existing detection approaches contribute to exploring the specific artifacts in deepfake videos and fit well on certain data. However, the growing technique on these…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Harry Cheng , Yangyang Guo , Tianyi Wang , Qi Li , Xiaojun Chang , Liqiang Nie

The advance of Generative Adversarial Networks (GANs) enables realistic face image synthesis. However, synthesizing face images that preserve facial identity as well as have high diversity within each identity remains challenging. To…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Yujun Shen , Bolei Zhou , Ping Luo , Xiaoou Tang

Facial expression captioning has found widespread application across various domains. Recently, the emergence of video Multimodal Large Language Models (MLLMs) has shown promise in general video understanding tasks. However, describing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Jiaxing Zhao , Boyuan Sun , Xiang Chen , Xihan Wei

Generative AI is reshaping art, gaming, and most notably animation. Recent breakthroughs in foundation and diffusion models have reduced the time and cost of producing animated content. Characters are central animation components, involving…

We present a versatile model, FaceAnime, for various video generation tasks from still images. Video generation from a single face image is an interesting problem and usually tackled by utilizing Generative Adversarial Networks (GANs) to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Xiaoguang Tu , Yingtian Zou , Jian Zhao , Wenjie Ai , Jian Dong , Yuan Yao , Zhikang Wang , Guodong Guo , Zhifeng Li , Wei Liu , Jiashi Feng

Image-to-video (I2V) generation aims to use the initial frame (alongside a text prompt) to create a video sequence. A grand challenge in I2V generation is to maintain visual consistency throughout the video: existing methods often struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Weiming Ren , Huan Yang , Ge Zhang , Cong Wei , Xinrun Du , Wenhao Huang , Wenhu Chen

The rapid advancement of AIGC-based video generation has underscored the critical need for comprehensive evaluation frameworks that go beyond traditional generation quality metrics to encompass aesthetic appeal. However, existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Longteng Jiang , DanDan Zheng , Qianqian Qiao , Heng Huang , Huaye Wang , Yihang Bo , Bao Peng , Jingdong Chen , Jun Zhou , Xin Jin

AI character platforms, which allow users to engage in conversations with AI personas, are a rapidly growing application domain. However, their immersive and personalized nature, combined with technical vulnerabilities, raises significant…

Cryptography and Security · Computer Science 2025-12-02 Yiluo Wei , Peixian Zhang , Gareth Tyson

The real world is dynamic, yet most image fusion methods process static frames independently, ignoring temporal correlations in videos and leading to flickering and temporal inconsistency. To address this, we propose Unified Video Fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Zixiang Zhao , Haowen Bai , Bingxin Ke , Yukun Cui , Lilun Deng , Yulun Zhang , Kai Zhang , Konrad Schindler

In recent years, artificial intelligence (AI)-driven video generation has gained significant attention. Consequently, there is a growing need for accurate video quality assessment (VQA) metrics to evaluate the perceptual quality of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zhichao Zhang , Wei Sun , Xinyue Li , Jun Jia , Xiongkuo Min , Zicheng Zhang , Chunyi Li , Zijian Chen , Puyi Wang , Fengyu Sun , Shangling Jui , Guangtao Zhai

The development of face recognition algorithms by academic and commercial organizations is growing rapidly due to the onset of deep learning and the widespread availability of training data. Though tests of face recognition algorithm…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 John J. Howard , Eli J. Laird , Yevgeniy B. Sirotin , Rebecca E. Rubin , Jerry L. Tipton , Arun R. Vemury

Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jinsong Zhou , Yihua Du , Xinli Xu , Luozhou Wang , Zijie Zhuang , Yehang Zhang , Shuaibo Li , Xiaojun Hu , Bolan Su , Ying-cong Chen

Recent studies in speech-driven talking face generation achieve promising results, but their reliance on fixed-driven speech limits further applications (e.g., face-voice mismatch). Thus, we extend the task to a more challenging setting:…

Sound · Computer Science 2025-07-28 Fang Kang , Yin Cao , Haoyu Chen

The ability of Generative Adversarial Networks to encode rich semantics within their latent space has been widely adopted for facial image editing. However, replicating their success with videos has proven challenging. Sets of high-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Rotem Tzaban , Ron Mokady , Rinon Gal , Amit H. Bermano , Daniel Cohen-Or

Generalizing deepfake detection to unseen manipulations remains a key challenge. A recent approach to tackle this issue is to train a network with pristine face images that have been manipulated with hand-crafted artifacts to extract more…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Alejandro Cobo , Roberto Valle , José Miguel Buenaposada , Luis Baumela

Face synthesis has been a fascinating yet challenging problem in computer vision and machine learning. Its main research effort is to design algorithms to generate photo-realistic face images via given semantic domain. It has been a crucial…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Zhihe Lu , Zhihang Li , Jie Cao , Ran He , Zhenan Sun

Face recognition research is one of the most active topics in computer vision (CV), and deep neural networks (DNN) are now filling the gap between human-level and computer-driven performance levels in face verification algorithms. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-25 Ryota Natsume , Kazuki Inoue , Yoshihiro Fukuhara , Shintaro Yamamoto , Shigeo Morishima , Hirokatsu Kataoka

Recent advances in model architectures, compute, and data scale have driven rapid progress in video generation, producing increasingly realistic content. Yet, no prior method systematically measures how faithfully these systems render human…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yusu Fang , Tiange Xiang , Tian Tan , Narayan Schuetz , Scott Delp , Li Fei-Fei , Ehsan Adeli

Recently, facial landmark detection algorithms have achieved remarkable performance on static images. However, these algorithms are neither accurate nor stable in motion-blurred videos. The missing of structure information makes it…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Keqiang Sun , Wayne Wu , Tinghao Liu , Shuo Yang , Quan Wang , Qiang Zhou , Zuochang Ye , Chen Qian

Digital characters are central to modern media, yet generating character videos with long-duration, consistent multi-view appearance and expressive identity remains challenging. Existing approaches either provide insufficient context to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yuhang Yang , Fan Zhang , Huaijin Pi , Shuai Guo , Guowei Xu , Wei Zhai , Yang Cao , Zheng-Jun Zha