English
Related papers

Related papers: RNA: Relightable Neural Assets

200 papers

Neural radiance fields (NeRF) methods have demonstrated impressive novel view synthesis performance. The core approach is to render individual rays by querying a neural network at points sampled along the ray to obtain the density and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Relja Arandjelović , Andrew Zisserman

A variety of Neural Radiance Fields (NeRF) methods have recently achieved remarkable success in high render speed. However, current accelerating methods are specialized and incompatible with various implicit methods, preventing real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyu Gao , Ziyi Yang , Yunlu Zhao , Yuxiang Sun , Xiaogang Jin , Changqing Zou

Decomposing geometry, materials and lighting from a set of images, namely inverse rendering, has been a long-standing problem in computer vision and graphics. Recent advances in neural rendering enable photo-realistic and plausible inverse…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Silong Yong , Venkata Nagarjun Pudureddiyur Manivannan , Bernhard Kerbl , Zifu Wan , Simon Stepputtis , Katia Sycara , Yaqi Xie

The estimation of the optical properties of a material from RGB-images is an important but extremely ill-posed problem in Computer Graphics. While recent works have successfully approached this problem even from just a single photograph,…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Raquel Vidaurre , Dan Casas , Elena Garces , Jorge Lopez-Moreno

Reconstructing the geometry and appearance of objects from photographs taken in different environments is difficult as the illumination and therefore the object appearance vary across captured images. This is particularly challenging for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Hadi Alzayer , Philipp Henzler , Jonathan T. Barron , Jia-Bin Huang , Pratul P. Srinivasan , Dor Verbin

We present a method that takes as input a set of images of a scene illuminated by unconstrained known lighting, and produces as output a 3D representation that can be rendered from novel viewpoints under arbitrary lighting conditions. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Pratul P. Srinivasan , Boyang Deng , Xiuming Zhang , Matthew Tancik , Ben Mildenhall , Jonathan T. Barron

Indoor scenes typically exhibit complex, spatially-varying appearance from global illumination, making inverse rendering a challenging ill-posed problem. This work presents an end-to-end, learning-based inverse rendering framework…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jingsen Zhu , Fujun Luan , Yuchi Huo , Zihao Lin , Zhihua Zhong , Dianbing Xi , Jiaxiang Zheng , Rui Tang , Hujun Bao , Rui Wang

This paper presents a high discriminative texture analysis method based on the fusion of complex networks and randomized neural networks. In this approach, the input image is modeled as a complex networks and its topological properties as…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Lucas C. Ribas , Jarbas J. M. Sa Junior , Leonardo F. S. Scabini , Odemir M. Bruno

We present a deep neural network for removing undesirable shading features from an unconstrained portrait image, recovering the underlying texture. Our training scheme incorporates three regularization strategies: masked loss, to emphasize…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Joshua Weir , Junhong Zhao , Andrew Chalmers , Taehyun Rhee

Creating an appearance-preserving level-of-detail (LoD) representation for arbitrary 3D scenes is a challenging problem. The appearance of a scene is an intricate combination of both geometry and material models, and is further complicated…

Graphics · Computer Science 2024-10-01 Yang Zhou , Tao Huang , Ravi Ramamoorthi , Pradeep Sen , Ling-Qi Yan

We consider the non-Lambertian object intrinsic problem of recovering diffuse albedo, shading, and specular highlights from a single image of an object. We build a large-scale object intrinsics database based on existing 3D models in the…

Computer Vision and Pattern Recognition · Computer Science 2016-12-28 Jian Shi , Yue Dong , Hao Su , Stella X. Yu

We present Meta 3D AssetGen (AssetGen), a significant advancement in text-to-3D generation which produces faithful, high-quality meshes with texture and material control. Compared to works that bake shading in the 3D object's appearance,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Yawar Siddiqui , Tom Monnier , Filippos Kokkinos , Mahendra Kariya , Yanir Kleiman , Emilien Garreau , Oran Gafni , Natalia Neverova , Andrea Vedaldi , Roman Shapovalov , David Novotny

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

Imaging through scattering media is encountered in many disciplines or sciences, ranging from biology, mesescopic physics and astronomy. But it is still a big challenge because light suffers from multiple scattering is such media and can be…

Neural and Evolutionary Computing · Computer Science 2017-08-29 Meng Lyu , Hao Wang , Guowei Li , Guohai Situ

The accurate characterisation of the 3D deformations of slender fibres and thin sheets in flow, is a key experimental challenge in the study of particle-laden flows. We propose a high-resolution, single-camera method to visualise…

Fluid Dynamics · Physics 2026-03-18 Tymoteusz Miara , Draga Pihler-Puzović , Matthias Heil , Anne Juel

Direct illumination with many lights is an inherent component of physically-based rendering, remaining challenging, especially in real-time scenarios. We propose an online-trained neural cache that stores visibility between lights and 3D…

Graphics · Computer Science 2025-09-01 Jakub Bokšanský , Daniel Meister

Coherent imaging techniques such as ptychography offer powerful capabilities for 3D resolution of nanoscale structures. By application in grazing incidence, such techniques may achieve exceptional surface sensitivity as demonstrated by…

Shaded relief is an effective method for visualising terrain on topographic maps, especially when the direction of illumination is adapted locally to emphasise individual terrain features. However, digital shading algorithms are unable to…

Neural radiance fields (NeRFs) have recently emerged as a promising approach for 3D reconstruction and novel view synthesis. However, NeRF-based methods encode shape, reflectance, and illumination implicitly and this makes it challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ruofan Liang , Jiahao Zhang , Haoda Li , Chen Yang , Yushi Guan , Nandita Vijaykumar

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang