English
Related papers

Related papers: Intrinsic Autoencoders for Joint Neural Rendering …

200 papers

Deep learning based rendering has achieved major improvements in photo-realistic image synthesis, with potential applications including visual effects in movies and photo-realistic scene building in video games. However, a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zhuo He , Paul Henderson , Nicolas Pugeault

We propose a novel approach to synthesizing images that are effective for training object detectors. Starting from a small set of real images, our algorithm estimates the rendering parameters required to synthesize similar images given a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-30 Artem Rozantsev , Vincent Lepetit , Pascal Fua

Robotic learning in simulation environments provides a faster, more scalable, and safer training methodology than learning directly with physical robots. Also, synthesizing images in a simulation environment for collecting large-scale image…

Robotics · Computer Science 2017-09-21 Tadanobu Inoue , Subhajit Chaudhury , Giovanni De Magistris , Sakyasingha Dasgupta

Non-photorealistic rendering techniques work on image features and often manipulate a set of characteristics such as edges and texture to achieve a desired depiction of the scene. Most computational photography methods decompose an image…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Akshay Gadi Patil , Shanmuganathan Raman

Image compression and reconstruction are crucial for various digital applications. While contemporary neural compression methods achieve impressive compression rates, the adoption of such technology has been largely hindered by the…

Machine Learning · Computer Science 2025-10-06 Ethan G. Rogers , Cheng Wang

Autoencoders have achieved great success in various computer vision applications. The autoencoder learns appropriate low dimensional image representations through the self-supervised paradigm, i.e., reconstruction. Existing studies mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianzhang Zheng , Hao Shen , Jian Yang , Xuan Tang , Mingsong Chen , Hui Yu , Jielong Guo , Xian Wei

We present Intrinsic Image Diffusion, a generative model for appearance decomposition of indoor scenes. Given a single input view, we sample multiple possible material explanations represented as albedo, roughness, and metallic maps.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Peter Kocsis , Vincent Sitzmann , Matthias Nießner

In this paper, we propose a generic neural-based hair rendering pipeline that can synthesize photo-realistic images from virtual 3D hair models. Unlike existing supervised translation methods that require model-level similarity to preserve…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Menglei Chai , Jian Ren , Sergey Tulyakov

In recent years, Generative Adversarial Networks have achieved impressive results in photorealistic image synthesis. This progress nurtures hopes that one day the classical rendering pipeline can be replaced by efficient models that are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Yiyi Liao , Katja Schwarz , Lars Mescheder , Andreas Geiger

Deep learning has emerged as a powerful artificial intelligence tool to interpret medical images for a growing variety of applications. However, the paucity of medical imaging data with high-quality annotations that is necessary for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Faisal Mahmood , Richard Chen , Sandra Sudarsky , Daphne Yu , Nicholas J. Durr

Compositing is one of the most common operations in photo editing. To generate realistic composites, the appearances of foreground and background need to be adjusted to make them compatible. Previous approaches to harmonize composites have…

Computer Vision and Pattern Recognition · Computer Science 2017-03-02 Yi-Hsuan Tsai , Xiaohui Shen , Zhe Lin , Kalyan Sunkavalli , Xin Lu , Ming-Hsuan Yang

Inverse rendering aims to estimate physical attributes of a scene, e.g., reflectance, geometry, and lighting, from image(s). Inverse rendering has been studied primarily for single objects or with methods that solve for only one of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Soumyadip Sengupta , Jinwei Gu , Kihwan Kim , Guilin Liu , David W. Jacobs , Jan Kautz

We introduce a new approach to intrinsic image decomposition, the task of decomposing a single image into albedo and shading components. Our strategy, which we term direct intrinsics, is to learn a convolutional neural network (CNN) that…

Computer Vision and Pattern Recognition · Computer Science 2015-12-09 Takuya Narihira , Michael Maire , Stella X. Yu

Capturing and labeling camera images in the real world is an expensive task, whereas synthesizing labeled images in a simulation environment is easy for collecting large-scale image data. However, learning from only synthetic images may not…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Tadanobu Inoue , Subhajit Chaudhury , Giovanni De Magistris , Sakyasingha Dasgupta

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

The task of generating natural images from 3D scenes has been a long standing goal in computer graphics. On the other hand, recent developments in deep neural networks allow for trainable models that can produce natural-looking images with…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Hassan Abu Alhaija , Siva Karthik Mustikovela , Andreas Geiger , Carsten Rother

In recent years, deep generative models have gained significance due to their ability to synthesize natural-looking images with applications ranging from virtual reality to data augmentation for training computer vision models. While…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Paul Sanzenbacher , Lars Mescheder , Andreas Geiger

We propose a systematic learning-based approach to the generation of massive quantities of synthetic 3D scenes and arbitrary numbers of photorealistic 2D images thereof, with associated ground truth information, for the purposes of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-21 Chenfanfu Jiang , Siyuan Qi , Yixin Zhu , Siyuan Huang , Jenny Lin , Lap-Fai Yu , Demetri Terzopoulos , Song-Chun Zhu

Infrared and visible image fusion, as a hot topic in image processing and image enhancement, aims to produce fused images retaining the detail texture information in visible images and the thermal radiation information in infrared images. A…

Image and Video Processing · Electrical Eng. & Systems 2021-04-15 Zixiang Zhao , Jiangshe Zhang , Shuang Xu , Kai Sun , Chunxia Zhang , Junmin Liu

Inverse rendering is the problem of decomposing an image into its intrinsic components, i.e. albedo, normal and lighting. To solve this ill-posed problem from single image, state-of-the-art methods in shape from shading mostly resort to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Mona Zehni , Shaona Ghosh , Krishna Sridhar , Sethu Raman