English
Related papers

Related papers: Intuitive Facial Animation Editing Based On A Gene…

200 papers

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

Graphics · Computer Science 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

Face animation, one of the hottest topics in computer vision, has achieved a promising performance with the help of generative models. However, it remains a critical challenge to generate identity preserving and photo-realistic images due…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Bohan Zeng , Boyu Liu , Hong Li , Xuhui Liu , Jianzhuang Liu , Dapeng Chen , Wei Peng , Baochang Zhang

User-friendly 3D object editing is a challenging task that has attracted significant attention recently. The limitations of direct 3D object editing without 2D prior knowledge have prompted increased attention towards utilizing 2D…

Graphics · Computer Science 2024-05-10 Sitian Shen , Jing Xu , Yuheng Yuan , Xingyi Yang , Qiuhong Shen , Xinchao Wang

While recent advances in image editing have enabled impressive visual synthesis capabilities, current methods remain constrained by explicit textual instructions and limited editing operations, lacking deep comprehension of implicit user…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dong Zhang , Lingfeng He , Rui Yan , Fei Shen , Jinhui Tang

Methods for generating synthetic data have become of increasing importance to build large datasets required for Convolution Neural Networks (CNN) based deep learning techniques for a wide range of computer vision applications. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Muhammad Ali Farooq , Peter Corcoran

Consumer-grade 3D printers have made it easier to fabricate aesthetic objects and static assemblies, opening the door to automated design of such objects. However, while static designs are easily produced with 3D printing, functional…

Neural and Evolutionary Computing · Computer Science 2019-03-26 Cameron R. Wolfe , Cem C. Tutum , Risto Miikkulainen

Recent neural talking radiance field methods have shown great success in photorealistic audio-driven talking face synthesis. In this paper, we propose a novel interactive framework that utilizes human instructions to edit such implicit…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yuqi Sun , Ruian He , Weimin Tan , Bo Yan

In NeRF-aided editing tasks, object movement presents difficulties in supervision generation due to the introduction of variability in object positions. Moreover, the removal operations of certain scene objects often lead to empty regions,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhenyang Li , Zilong Chen , Feifan Qu , Mingqing Wang , Yizhou Zhao , Kai Zhang , Yifan Peng

The ability to edit facial expressions has a wide range of applications in computer graphics. The ideal facial expression editing algorithm needs to satisfy two important criteria. First, it should allow precise and targeted editing of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Alara Zindancıoğlu , T. Metin Sezgin

Instruction-guided 3D editing is a rapidly emerging field with the potential to broaden access to 3D content creation. However, existing methods face critical limitations: optimization-based approaches are prohibitively slow, while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Weiwei Cai , Shuangkang Fang , Weicai Ye , Xin Dong , Yunhan Yang , Xuanyang Zhang , Wei Cheng , Yanpei Cao , Gang Yu , Tao Chen

Unsupervised face animation aims to generate a human face video based on the appearance of a source image, mimicking the motion from a driving video. Existing methods typically adopted a prior-based motion model (e.g., the local affine…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Jiale Tao , Shuhang Gu , Wen Li , Lixin Duan

Digitally retouching images has become a popular trend, with people posting altered images on social media and even magazines posting flawless facial images of celebrities. Further, with advancements in Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Anubhav Jain , Richa Singh , Mayank Vatsa

Talking-head video editing aims to efficiently insert, delete, and substitute the word of a pre-recorded video through a text transcript editor. The key challenge for this task is obtaining an editing model that generates new talking-head…

Multimedia · Computer Science 2023-09-21 Songlin Yang , Wei Wang , Jun Ling , Bo Peng , Xu Tan , Jing Dong

Generative AI assistants have been widely used in front-end programming. However, besides code writing, developers often encounter the need to generate animation effects. As novices in creative design without the assistance of professional…

Human-Computer Interaction · Computer Science 2025-06-30 Tianrun Qiu , Yuxin Ma

Audio-driven 3D facial animation has several virtual humans applications for content creation and editing. While several existing methods provide solutions for speech-driven animation, precise control over content (what) and style (how) of…

Sound · Computer Science 2024-08-15 Qingju Liu , Hyeongwoo Kim , Gaurav Bharaj

We introduce PortraitGen, a powerful portrait video editing method that achieves consistent and expressive stylization with multimodal prompts. Traditional portrait video editing methods often struggle with 3D and temporal consistency, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Xuan Gao , Haiyao Xiao , Chenglai Zhong , Shimin Hu , Yudong Guo , Juyong Zhang

Social interactions incorporate nonverbal signals to convey emotions alongside speech, including facial expressions and body gestures. Generative models have demonstrated promising results in creating full-body nonverbal animations…

Human-Computer Interaction · Computer Science 2026-04-01 Kiran Chhatre , Renan Guarese , Andrii Matviienko , Christopher Peters

3D rendering of dynamic face captures is a challenging problem, and it demands improvements on several fronts$\unicode{x2014}$photorealism, efficiency, compatibility, and configurability. We present a novel representation that enables…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Safa C. Medin , Gengyan Li , Ruofei Du , Stephan Garbin , Philip Davidson , Gregory W. Wornell , Thabo Beeler , Abhimitra Meka

The use of beauty filters on social media, which enhance the appearance of individuals in images, is a well-researched area, with existing methods proving to be highly effective. Traditionally, such enhancements are performed using…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Erik Nguyen , Spencer Htin

Speech-driven facial animation is the process which uses speech signals to automatically synthesize a talking character. The majority of work in this domain creates a mapping from audio features to visual features. This often requires…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-20 Konstantinos Vougioukas , Stavros Petridis , Maja Pantic