English
Related papers

Related papers: Learning Effective NeRFs and SDFs Representations …

200 papers

Generative Adversarial Networks (GANs) are shown to be successful at generating new and realistic samples including 3D object models. Conditional GAN, a variant of GANs, allows generating samples in given conditions. However, objects…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Cihan Öngün , Alptekin Temizel

Generative Adversarial Networks (GANs) in supervised settings can generate photo-realistic corresponding output from low-definition input (SRGAN). Using the architecture presented in the SRGAN original paper [2], we explore how selecting a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Nao Takano , Gita Alaghband

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen

Generative adversarial networks (GANs) can be trained to generate 3D image data, which is useful for design optimisation. However, this conventionally requires 3D training data, which is challenging to obtain. 2D imaging techniques tend to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Steve Kench , Samuel J. Cooper

Access to high-quality and diverse 3D articulated digital human assets is crucial in various applications, ranging from virtual reality to social platforms. Generative approaches, such as 3D generative adversarial networks (GANs), are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yinghao Xu , Wang Yifan , Alexander W. Bergman , Menglei Chai , Bolei Zhou , Gordon Wetzstein

Generating multi-view images from a single-view input is an essential yet challenging problem. It has broad applications in vision, graphics, and robotics. Our study indicates that the widely-used generative adversarial network (GAN) may…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Yu Tian , Xi Peng , Long Zhao , Shaoting Zhang , Dimitris N. Metaxas

Deep generative models have demonstrated effectiveness in learning compact and expressive design representations that significantly improve geometric design optimization. However, these models do not consider the uncertainty introduced by…

Machine Learning · Computer Science 2022-03-10 Wei Wayne Chen , Doksoo Lee , Wei Chen

Among the major remaining challenges for single image super resolution (SISR) is the capacity to recover coherent images with global shapes and local details conforming to human vision system. Recent generative adversarial network (GAN)…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Yuanzhuo Li , Yunan Zheng , Jie Chen , Zhenyu Xu , Yiguang Liu

Advances in image diffusion models have recently led to notable improvements in the generation of high-quality images. In combination with Neural Radiance Fields (NeRFs), they enabled new opportunities in 3D generation. However, most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jan-Niklas Dihlmann , Andreas Engelhardt , Hendrik Lensch

Deep neural networks (DNNs) are widely applied for nowadays 3D surface reconstruction tasks and such methods can be further divided into two categories, which respectively warp templates explicitly by moving vertices or represent 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Zhenghao Chen , Luping Zhou

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities, which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Ganlin Yang , Guoqiang Wei , Zhizheng Zhang , Yan Lu , Dong Liu

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge…

Machine Learning · Computer Science 2016-01-11 Alec Radford , Luke Metz , Soumith Chintala

Despite the breakthroughs in accuracy and speed of single image super-resolution using faster and deeper convolutional neural networks, one central problem remains largely unsolved: how do we recover the finer texture details when we…

Computer Vision and Pattern Recognition · Computer Science 2017-05-26 Christian Ledig , Lucas Theis , Ferenc Huszar , Jose Caballero , Andrew Cunningham , Alejandro Acosta , Andrew Aitken , Alykhan Tejani , Johannes Totz , Zehan Wang , Wenzhe Shi

We propose a neural inverse rendering pipeline called IRON that operates on photometric images and outputs high-quality 3D content in the format of triangle meshes and material textures readily deployable in existing graphics pipelines. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Kai Zhang , Fujun Luan , Zhengqi Li , Noah Snavely

In many applications, including surveillance, entertainment, and restoration, there is a need to increase both the spatial resolution and the frame rate of a video sequence. The aim is to improve visual quality, refine details, and create a…

Image and Video Processing · Electrical Eng. & Systems 2024-07-25 Congrui Fu , Hui Yuan , Liquan Shen , Raouf Hamzaoui , Hao Zhang

Single image super-resolution (SISR) has played an important role in the field of image processing. Recent generative adversarial networks (GANs) can achieve excellent results on low-resolution images. However, there are little literatures…

Image and Video Processing · Electrical Eng. & Systems 2026-01-14 Ziang Wu , Xuanyu Zhang , Yinbo Yu , Qi Zhu , Jerry Chun-Wei Lin , Chunwei Tian

Recent advances in generative visual models and neural radiance fields have greatly boosted 3D-aware image synthesis and stylization tasks. However, previous NeRF-based work is limited to single scene stylization, training a model to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Zichen Tang , Hongyu Yang

Recent advances in 3D-aware generative models (3D-aware GANs) combined with Neural Radiance Fields (NeRF) have achieved impressive results. However no prior works investigate 3D-aware GANs for 3D consistent multi-class image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Senmao Li , Joost van de Weijer , Yaxing Wang , Fahad Shahbaz Khan , Meiqin Liu , Jian Yang

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint