English
Related papers

Related papers: Exploiting Radiance Fields for Grasp Generation on…

200 papers

3D Gaussian Splatting (3DGS) has shown remarkable success in synthesizing novel views given multiple views of a static scene. Yet, 3DGS faces challenges when applied to dynamic scenes because 3D Gaussian parameters need to be updated per…

Graphics · Computer Science 2024-07-08 Kai Katsumata , Duc Minh Vo , Hideki Nakayama

Grasp detection with consideration of the affiliations between grasps and their owner in object overlapping scenes is a necessary and challenging task for the practical use of the robotic grasping approach. In this paper, a robotic grasp…

Robotics · Computer Science 2019-03-15 Hanbo Zhang , Xuguang Lan , Site Bai , Xinwen Zhou , Zhiqiang Tian , Nanning Zheng

It is desirable to create 3D object models and 3D maps from 2D input images for applications such as navigation, virtual tourism, and urban planning. The traditional methods of creating 3D maps, (such as photogrammetry), require a large…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sai Tarun Sathyan , Thomas B. Kinsman

The vast majority of visual animals actively control their eyes, heads, and/or bodies to direct their gaze toward different parts of their environment. In contrast, recent applications of reinforcement learning in robotic manipulation…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Youssef Zaky , Gaurav Paruthi , Bryan Tripp , James Bergstra

Robots operating in human-centric environments require the integration of visual grounding and grasping capabilities to effectively manipulate objects based on user instructions. This work focuses on the task of referring grasp synthesis,…

Robotics · Computer Science 2023-11-13 Georgios Tziafas , Yucheng Xu , Arushi Goel , Mohammadreza Kasaei , Zhibin Li , Hamidreza Kasaei

Vision foundation models trained on massive amounts of visual data have shown unprecedented reasoning and planning skills in open-world settings. A key challenge in applying them to robotic tasks is the modality gap between visual data and…

Robotics · Computer Science 2024-10-18 Ruoshi Liu , Alper Canberk , Shuran Song , Carl Vondrick

Novel View Synthesis (NVS) from unconstrained photo collections is challenging in computer graphics. Recently, 3D Gaussian Splatting (3DGS) has shown promise for photorealistic and real-time NVS of static scenes. Building on 3DGS, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yuze Wang , Junyi Wang , Yue Qi

Novel view synthesis from a sparse set of input images is a challenging problem of great practical interest, especially when camera poses are absent or inaccurate. Direct optimization of camera poses and usage of estimated depths in neural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Kaiwen Jiang , Yang Fu , Mukund Varma T , Yash Belhe , Xiaolong Wang , Hao Su , Ravi Ramamoorthi

In advanced mission concepts with high levels of autonomy, spacecraft need to internally model the pose and shape of nearby orbiting objects. Recent works in neural scene representations show promising results for inferring generic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Anne Mergy , Gurvan Lecuyer , Dawa Derksen , Dario Izzo

Novel view synthesis has seen major advances in recent years, with 3D Gaussian splatting offering an excellent level of visual quality, fast training and real-time rendering. However, the resources needed for training and rendering…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bernhard Kerbl , Andréas Meuleman , Georgios Kopanas , Michael Wimmer , Alexandre Lanvin , George Drettakis

Photo-realistic novel view synthesis from multi-view images, such as neural radiance field (NeRF) and 3D Gaussian Splatting (3DGS), has gained significant attention for its superior performance. However, most existing methods rely on low…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Shucheng Gong , Lingzhe Zhao , Wenpu Li , Hong Xie , Yin Zhang , Shiyu Zhao , Peidong Liu

In this paper the argument is made that for true novel view synthesis of objects, where the object can be synthesized from any viewpoint, an explicit 3D shape representation isdesired. Our method estimates point clouds to capture the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Hoang-An Le , Thomas Mensink , Partha Das , Theo Gevers

This paper proposes a neural radiance field (NeRF) approach for novel view synthesis of dynamic scenes using forward warping. Existing methods often adopt a static NeRF to represent the canonical space, and render dynamic images at other…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiang Guo , Jiadai Sun , Yuchao Dai , Guanying Chen , Xiaoqing Ye , Xiao Tan , Errui Ding , Yumeng Zhang , Jingdong Wang

The field of novel view synthesis has made significant strides thanks to the development of radiance field methods. However, most radiance field techniques are far better at novel view interpolation than novel view extrapolation where the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Kunhao Liu , Ling Shao , Shijian Lu

Rendering photo-realistic novel-view images of complex scenes has been a long-standing challenge in computer graphics. In recent years, great research progress has been made on enhancing rendering quality and accelerating rendering speed in…

Graphics · Computer Science 2024-02-21 Tiansong Zhou , Yebin Liu , Xuangeng Chu , Chengkun Cao , Changyin Zhou , Fei Yu , Yu Li

Robotic grasping plays an important role in the field of robotics. The current state-of-the-art robotic grasping detection systems are usually built on the conventional vision, such as RGB-D camera. Compared to traditional frame-based…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Bin Li , Hu Cao , Zhongnan Qu , Yingbai Hu , Zhenke Wang , Zichen Liang

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yilun Du , Cameron Smith , Ayush Tewari , Vincent Sitzmann

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

Robust grasping in cluttered environments remains an open challenge in robotics. While benchmark datasets have significantly advanced deep learning methods, they mainly focus on simplistic scenes with light occlusion and insufficient…

Grasping of novel objects in pick and place applications is a fundamental and challenging problem in robotics, specifically for complex-shaped objects. It is observed that the well-known strategies like \textit{i}) grasping from the…

Robotics · Computer Science 2020-01-08 Mohit Vohra , Ravi Prakash , Laxmidhar Behera