English
Related papers

Related papers: Collaborative Neural Rendering using Anime Charact…

200 papers

While NeRF-based human representations have shown impressive novel view synthesis results, most methods still rely on a large number of images / views for training. In this work, we propose a novel animatable NeRF called ActorsNeRF. It is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Jiteng Mu , Shen Sang , Nuno Vasconcelos , Xiaolong Wang

Despite the effectiveness of Convolutional Neural Networks (CNNs) for image classification, our understanding of the relationship between shape of convolution kernels and learned representations is limited. In this work, we explore and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Zhun Sun , Mete Ozay , Takayuki Okatani

Creating high-quality controllable 3D human models from multi-view RGB videos poses a significant challenge. Neural radiance fields (NeRFs) have demonstrated remarkable quality in reconstructing and free-viewpoint rendering of static as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Paul Knoll , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Due to the limits of bandwidth and storage space, digital images are usually down-scaled and compressed when transmitted over networks, resulting in loss of details and jarring artifacts that can lower the performance of high-level visual…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Xiaoyu Xiang , Qian Lin , Jan P. Allebach

Rendering photorealistic and dynamically moving human heads is crucial for ensuring a pleasant and immersive experience in AR/VR and video conferencing applications. However, existing methods often struggle to model challenging facial…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Cong Wang , Di Kang , Yan-Pei Cao , Linchao Bao , Ying Shan , Song-Hai Zhang

Neural Radiance Fields (NeRF) have demonstrated impressive potential in synthesizing novel views from dense input, however, their effectiveness is challenged when dealing with sparse input. Existing approaches that incorporate additional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Zhangkai Ni , Peiqi Yang , Wenhan Yang , Hanli Wang , Lin Ma , Sam Kwong

Image colourisation is an ill-posed problem, with multiple correct solutions which depend on the context and object instances present in the input datum. Previous approaches attacked the problem either by requiring intense user interactions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Rita Pucci , Christian Micheloni , Niki Martinel

Recent interest in on-orbit servicing and Active Debris Removal (ADR) missions have driven the need for technologies to enable non-cooperative rendezvous manoeuvres. Such manoeuvres put heavy burden on the perception capabilities of a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Maxwell Hogan , Duarte Rondao , Nabil Aouf , Olivier Dubois-Matra

Recent advances in Generative Adversarial Networks GANs applications continue to attract the attention of researchers in different fields. In such a framework, two neural networks compete adversely to generate new visual contents…

Artificial Intelligence · Computer Science 2023-11-27 Mohammad Lataifeh , Xavier A Carrascoa , Ashraf M Elnagara , Naveed Ahmeda , Imran Junejo

We introduce a framework that automates the transformation of static anime illustrations into manipulatable 2.5D models. Current professional workflows require tedious manual segmentation and the artistic ``hallucination'' of occluded…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Jian Lin , Chengze Li , Haoyun Qin , Kwun Wang Chan , Yanghua Jin , Hanyuan Liu , Stephen Chun Wang Choy , Xueting Liu

We have recently seen tremendous progress in the neural advances for photo-real human modeling and rendering. However, it's still challenging to integrate them into an existing mesh-based pipeline for downstream applications. In this paper,…

Generating high-fidelity garment animations through traditional workflows, from modeling to rendering, is both tedious and expensive. These workflows often require repetitive steps in response to updates in character motion, rendering…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Renke Wang , Meng Zhang , Jun Li , Jian Yan

This paper proposes a new end-to-end neural rendering architecture to transfer appearance and reenact human actors. Our method leverages a carefully designed graph convolutional network (GCN) to model the human body manifold structure,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Thiago L. Gomes , Thiago M. Coutinho , Rafael Azevedo , Renato Martins , Erickson R. Nascimento

This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as inputs and skirting per-case fine-tuning. The large variation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Wei Cheng , Su Xu , Jingtan Piao , Chen Qian , Wayne Wu , Kwan-Yee Lin , Hongsheng Li

We propose a new type of full-body human avatars, which combines parametric mesh-based body model with a neural texture. We show that with the help of neural textures, such avatars can successfully model clothing and hair, which usually…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Artur Grigorev , Karim Iskakov , Anastasia Ianina , Renat Bashirov , Ilya Zakharkin , Alexander Vakhitov , Victor Lempitsky

Convolutional neural networks (CNNs) are one of the most popular models of Artificial Neural Networks (ANN)s in Computer Vision (CV). A variety of CNN-based structures were developed by researchers to solve problems like image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Bowen Qiu , Daniela Raicu , Jacob Furst , Roselyne Tchoua

Combining human body models with differentiable rendering has recently enabled animatable avatars of clothed humans from sparse sets of multi-view RGB videos. While state-of-the-art approaches achieve realistic appearance with neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Shaofei Wang , Katja Schwarz , Andreas Geiger , Siyu Tang

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

Synthesizing realistic videos of humans using neural networks has been a popular alternative to the conventional graphics-based rendering pipeline due to its high efficiency. Existing works typically formulate this as an image-to-image…

Automatic generation of facial images has been well studied after the Generative Adversarial Network (GAN) came out. There exists some attempts applying the GAN model to the problem of generating facial images of anime characters, but none…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Yanghua Jin , Jiakai Zhang , Minjun Li , Yingtao Tian , Huachun Zhu , Zhihao Fang