English
Related papers

Related papers: Semantic See-Through Rendering on Light Fields

200 papers

Camera arrays provide spatial and angular information within a single snapshot. With refocusing methods, focal planes can be altered after exposure. In this letter, we propose a light field refocusing method to improve the imaging quality…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Yingqian Wang , Jungang Yang , Yulan Guo , Chao Xiao , Wei An

We present Panoptic Neural Fields (PNF), an object-aware neural scene representation that decomposes a scene into a set of objects (things) and background (stuff). Each object is represented by an oriented 3D bounding box and a multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Abhijit Kundu , Kyle Genova , Xiaoqi Yin , Alireza Fathi , Caroline Pantofaru , Leonidas Guibas , Andrea Tagliasacchi , Frank Dellaert , Thomas Funkhouser

Recent techniques for real-time view synthesis have rapidly advanced in fidelity and speed, and modern methods are capable of rendering near-photorealistic scenes at interactive frame rates. At the same time, a tension has arisen between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Daniel Duckworth , Peter Hedman , Christian Reiser , Peter Zhizhin , Jean-François Thibert , Mario Lučić , Richard Szeliski , Jonathan T. Barron

Stereo matching is one of the widely used techniques for inferring depth from stereo images owing to its robustness and speed. It has become one of the major topics of research since it finds its applications in autonomous driving, robotic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Viny Saajan Victor , Peter Neigel

Semantic image parsing, which refers to the process of decomposing images into semantic regions and constructing the structure representation of the input, has recently aroused widespread interest in the field of computer vision. The recent…

Computer Vision and Pattern Recognition · Computer Science 2018-10-11 Lili Huang , Jiefeng Peng , Ruimao Zhang , Guanbin Li , Liang Lin

Our goal is to develop stable, accurate, and robust semantic scene understanding methods for wide-area scene perception and understanding, especially in challenging outdoor environments. To achieve this, we are exploring and evaluating a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Jiesi Hu , Ganning Zhao , Suya You , C. C. Jay Kuo

We present NeSF, a method for producing 3D semantic fields from posed RGB images alone. In place of classical 3D representations, our method builds on recent work in implicit neural scene representations wherein 3D structure is captured by…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Suhani Vora , Noha Radwan , Klaus Greff , Henning Meyer , Kyle Genova , Mehdi S. M. Sajjadi , Etienne Pot , Andrea Tagliasacchi , Daniel Duckworth

Multi-scale architecture, including hierarchical vision transformer, has been commonly applied to high-resolution semantic segmentation to deal with computational complexity with minimum performance loss. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiwon Yoo , Jangwon Lee , Gyeonghwan Kim

Continuous sign language recognition (SLR) aims to translate a signing sequence into a sentence. It is very challenging as sign language is rich in vocabulary, while many among them contain similar gestures and motions. Moreover, it is…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Zhaoyang Yang , Zhenmei Shi , Xiaoyong Shen , Yu-Wing Tai

This paper proposes PreSem-Surf, an optimized method based on the Neural Radiance Field (NeRF) framework, capable of reconstructing high-quality scene surfaces from RGB-D sequences in a short time. The method integrates RGB, depth, and…

Graphics · Computer Science 2025-08-20 Yuyan Ye , Hang Xu , Yanghang Huang , Jiali Huang , Qian Weng

Large-scale LiDAR-based point cloud semantic segmentation is a critical task in autonomous driving perception. Almost all of the previous state-of-the-art LiDAR semantic segmentation methods are variants of sparse 3D convolution. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chuanyu Luo , Nuo Cheng , Sikun Ma , Han Li , Xiaohan Li , Shengguang Lei , Pu Li

As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Bin Zhang , Shengjie Zhao , Rongqing Zhang

Sign Language Translation (SLT) is a promising technology to bridge the communication gap between the deaf and the hearing people. Recently, researchers have adopted Neural Machine Translation (NMT) methods, which usually require…

Computation and Language · Computer Science 2023-03-22 Biao Fu , Peigen Ye , Liang Zhang , Pei Yu , Cong Hu , Yidong Chen , Xiaodong Shi

Semantic segmentation necessitates approaches that learn high-level characteristics while dealing with enormous amounts of data. Convolutional neural networks (CNNs) can learn unique and adaptive features to achieve this aim. However, due…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Hasan AlMarzouqi , Lyes Saad Saoud

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

We present an approach for interactively scanning highly reflective objects with a commodity RGBD sensor. In addition to shape, our approach models the surface light field, encoding scene appearance from all directions. By factoring the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Jeong Joon Park , Richard Newcombe , Steve Seitz

Homography estimation is the task of determining the transformation from an image pair. Our approach focuses on employing detector-free feature matching methods to address this issue. Previous work has underscored the importance of…

Information Retrieval · Computer Science 2024-10-15 Yuhan Liu , Qianxin Huang , Siqi Hui , Jingwen Fu , Sanping Zhou , Kangyi Wu , Pengna Li , Jinjun Wang

Comprehensive scene understanding is a critical enabler of robot autonomy. Semantic segmentation is one of the key scene understanding tasks which is pivotal for several robotics applications including autonomous driving, domestic service…

Robotics · Computer Science 2024-01-17 Juana Valeria Hurtado , Abhinav Valada

Semantic segmentation is a fundamental task in multimedia processing, which can be used for analyzing, understanding, editing contents of images and videos, among others. To accelerate the analysis of multimedia data, existing segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zhiyan Wang , Deyin Liu , Lin Yuanbo Wu , Song Wang , Xin Guo , Lin Qi

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Huan Wang , Jian Ren , Zeng Huang , Kyle Olszewski , Menglei Chai , Yun Fu , Sergey Tulyakov