English
Related papers

Related papers: Scene Representation Networks: Continuous 3D-Struc…

200 papers

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

Deep learning techniques have led to remarkable breakthroughs in the field of generic object detection and have spawned a lot of scene-understanding tasks in recent years. Scene graph has been the focus of research because of its powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Guangming Zhu , Liang Zhang , Youliang Jiang , Yixuan Dang , Haoran Hou , Peiyi Shen , Mingtao Feng , Xia Zhao , Qiguang Miao , Syed Afaq Ali Shah , Mohammed Bennamoun

Neural Radiance Field (NeRF) approaches learn the underlying 3D representation of a scene and generate photo-realistic novel views with high fidelity. However, most proposed settings concentrate on modelling a single object or a single…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ankit Dhiman , Srinath R , Harsh Rangwani , Rishubh Parihar , Lokesh R Boregowda , Srinath Sridhar , R Venkatesh Babu

Modern 3D computer vision leverages learning to boost geometric reasoning, mapping image data to classical structures such as cost volumes or epipolar constraints to improve matching. These architectures are specialized according to the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Vitor Guizilini , Igor Vasiljevic , Jiading Fang , Rares Ambrus , Greg Shakhnarovich , Matthew Walter , Adrien Gaidon

Recognizing objects and scenes are two challenging but essential tasks in image understanding. In particular, the use of RGB-D sensors in handling these tasks has emerged as an important area of focus for better visual understanding.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Ali Caglayan , Nevrez Imamoglu , Ahmet Burak Can , Ryosuke Nakamura

Scene recognition, particularly for aerial and underwater images, often suffers from various types of degradation, such as blurring or overexposure. Previous works that focus on convolutional neural networks have been shown to be able to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jianqi Zhang , Mengxuan Wang , Jingyao Wang , Lingyu Si , Changwen Zheng , Fanjiang Xu

Semantic labelling is highly correlated with geometry and radiance reconstruction, as scene entities with similar shape and appearance are more likely to come from similar classes. Recent implicit neural reconstruction techniques are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Shuaifeng Zhi , Tristan Laidlow , Stefan Leutenegger , Andrew J. Davison

As part of human core knowledge, the representation of objects is the building block of mental representation that supports high-level concepts and symbolic reasoning. While humans develop the ability of perceiving objects situated in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 John Day , Tushar Arora , Jirui Liu , Li Erran Li , Ming Bo Cai

The use of deep learning techniques has exploded during the last few years, resulting in a direct contribution to the field of artificial intelligence. This work aims to be a review of the state-of-the-art in scene recognition with deep…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Alina Matei , Andreea Glavan , Estefania Talavera

We introduce a deep appearance model for rendering the human face. Inspired by Active Appearance Models, we develop a data-driven rendering pipeline that learns a joint representation of facial geometry and appearance from a multiview…

Graphics · Computer Science 2018-08-02 Stephen Lombardi , Jason Saragih , Tomas Simon , Yaser Sheikh

In this paper, we address the "dual problem" of multi-view scene reconstruction in which we utilize single-view images captured under different point lights to learn a neural scene representation. Different from existing single-view methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

Latent scene representation plays a significant role in training reinforcement learning (RL) agents. To obtain good latent vectors describing the scenes, recent works incorporate the 3D-aware latent-conditioned NeRF pipeline into scene…

Robotics · Computer Science 2024-09-30 Jiaxu Wang , Ziyi Zhang , Qiang Zhang , Jia Li , Jingkai Sun , Mingyuan Sun , Junhao He , Renjing Xu

6-DoF pose estimation is an essential component of robotic manipulation pipelines. However, it usually suffers from a lack of generalization to new instances and object types. Most widely used methods learn to infer the object pose in a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Vaibhav Saxena , Kamal Rahimi Malekshan , Linh Tran , Yotto Koga

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge…

Machine Learning · Computer Science 2016-01-11 Alec Radford , Luke Metz , Soumith Chintala

In video super-resolution, the spatio-temporal coherence between, and among the frames must be exploited appropriately for accurate prediction of the high resolution frames. Although 2D convolutional neural networks (CNNs) are powerful in…

Computer Vision and Pattern Recognition · Computer Science 2019-06-21 Soo Ye Kim , Jeongyeon Lim , Taeyoung Na , Munchurl Kim

We present a new point-based approach for modeling the appearance of real scenes. The approach uses a raw point cloud as the geometric representation of a scene, and augments each point with a learnable neural descriptor that encodes local…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Kara-Ali Aliev , Artem Sevastopolsky , Maria Kolos , Dmitry Ulyanov , Victor Lempitsky

Despite the recent success of Neural Radiance Field (NeRF), it is still challenging to render large-scale driving scenes with long trajectories, particularly when the rendering quality and efficiency are in high demand. Existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhuopeng Li , Chenming Wu , Liangjun Zhang , Jianke Zhu

Kernel methods are powerful tools to capture nonlinear patterns behind data. They implicitly learn high (even infinite) dimensional nonlinear features in the Reproducing Kernel Hilbert Space (RKHS) while making the computation tractable by…

Machine Learning · Statistics 2017-11-28 Shuai Zhang , Jianxin Li , Pengtao Xie , Yingchun Zhang , Minglai Shao , Haoyi Zhou , Mengyi Yan

Neural rendering is a new image and video generation method based on deep learning. It combines the deep learning model with the physical knowledge of computer graphics, to obtain a controllable and realistic scene model, and realize the…

Graphics · Computer Science 2024-02-02 Xinkai Yan , Jieting Xu , Yuchi Huo , Hujun Bao