English
Related papers

Related papers: ANR: Articulated Neural Rendering for Virtual Avat…

200 papers

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

Error detection in procedural activities is essential for consistent and correct outcomes in AR-assisted and robotic systems. Existing methods often focus on temporal ordering errors or rely on static prototypes to represent normal actions.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Wei-Jin Huang , Yuan-Ming Li , Zhi-Wei Xia , Yu-Ming Tang , Kun-Yu Lin , Jian-Fang Hu , Wei-Shi Zheng

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

Automatic speech recognition (ASR) is improving ever more at mimicking human speech processing. The functioning of ASR, however, remains to a large extent obfuscated by the complex structure of the deep neural networks (DNNs) they are based…

Machine Learning · Computer Science 2022-02-03 Karla Markert , Romain Parracone , Mykhailo Kulakov , Philip Sperl , Ching-Yu Kao , Konstantin Böttinger

Acquisition and rendering of photo-realistic human heads is a highly challenging research problem of particular importance for virtual telepresence. Currently, the highest quality is achieved by volumetric approaches trained in a person…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Amit Raj , Michael Zollhoefer , Tomas Simon , Jason Saragih , Shunsuke Saito , James Hays , Stephen Lombardi

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Zhang Chen , Anpei Chen , Guli Zhang , Chengyuan Wang , Yu Ji , Kiriakos N. Kutulakos , Jingyi Yu

The field of machine learning has taken a dramatic twist in recent times, with the rise of the Artificial Neural Network (ANN). These biologically inspired computational models are able to far exceed the performance of previous forms of…

Neural and Evolutionary Computing · Computer Science 2015-12-03 Keiron O'Shea , Ryan Nash

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

Real-time rendering of photorealistic and controllable human avatars stands as a cornerstone in Computer Vision and Graphics. While recent advances in neural implicit rendering have unlocked unprecedented photorealism for digital avatars,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haokai Pang , Heming Zhu , Adam Kortylewski , Christian Theobalt , Marc Habermann

Generating high-fidelity garment animations through traditional workflows, from modeling to rendering, is both tedious and expensive. These workflows often require repetitive steps in response to updates in character motion, rendering…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Renke Wang , Meng Zhang , Jun Li , Jian Yan

Synthetic data is a scalable alternative to manual supervision, but it requires overcoming the sim-to-real domain gap. This discrepancy between virtual and real worlds is addressed by two seemingly opposed approaches: improving the realism…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Sergey Zakharov , Rares Ambrus , Vitor Guizilini , Wadim Kehl , Adrien Gaidon

Most chemical processes, such as distillation, absorption, extraction, and catalytic reactions, are extremely complex processes that are affected by multiple factors. The relationships between their input variables and output variables are…

Systems and Control · Electrical Eng. & Systems 2021-10-19 Li Sun , Fei Liang , Wutai Cui

To make 3D human avatars widely available, we must be able to generate a variety of 3D virtual humans with varied identities and shapes in arbitrary poses. This task is challenging due to the diversity of clothed body shapes, their complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Xu Chen , Tianjian Jiang , Jie Song , Jinlong Yang , Michael J. Black , Andreas Geiger , Otmar Hilliges

Deep Neural Networks (DNNs) are rapidly being applied to safety-critical domains such as drone and airplane control, motivating techniques for verifying the safety of their behavior. Unfortunately, DNN verification is NP-hard, with current…

Machine Learning · Computer Science 2020-09-15 Matthew Sotoudeh , Aditya V. Thakur

Modeling relightable and animatable human avatars from monocular video is a long-standing and challenging task. Recently, Neural Radiance Field (NeRF) and 3D Gaussian Splatting (3DGS) methods have been employed to reconstruct the avatars.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Seonghwa Choi , Moonkyeong Choi , Mingyu Jang , Jaekyung Kim , Jianfei Cai , Wen-Huang Cheng , Sanghoon Lee

Facial Expression Recognition (FER) is an active research domain that has shown great progress recently, notably thanks to the use of large deep learning models. However, such approaches are particularly energy intensive, which makes their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Sami Barchid , Benjamin Allaert , Amel Aissaoui , José Mennesson , Chaabane Djéraba

Artificial Neural Networks (ANNs) have demonstrated remarkable utility in various challenging machine learning applications. While formally verified properties of their behaviors are highly desired, they have proven notoriously difficult to…

Machine Learning · Computer Science 2020-10-05 Xuankang Lin , He Zhu , Roopsha Samanta , Suresh Jagannathan

Neural Radiance Field (NeRF) is a popular method in representing 3D scenes by optimising a continuous volumetric scene function. Its large success which lies in applying volumetric rendering (VR) is also its Achilles' heel in producing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Zhe Jun Tang , Tat-Jen Cham , Haiyu Zhao

Named-entity recognition (NER) aims at identifying entities of interest in a text. Artificial neural networks (ANNs) have recently been shown to outperform existing NER systems. However, ANNs remain challenging to use for non-expert users.…

Computation and Language · Computer Science 2017-05-17 Franck Dernoncourt , Ji Young Lee , Peter Szolovits