English
Related papers

Related papers: Learning Dynamic Scene Reconstruction with Sinusoi…

200 papers

We introduce a method that can learn to predict scene-level implicit functions for 3D reconstruction from posed RGBD data. At test time, our system maps a previously unseen RGB image to a 3D reconstruction of a scene via implicit functions.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Nilesh Kulkarni , Linyi Jin , Justin Johnson , David F. Fouhey

This paper introduces key machine learning operations that allow the realization of robust, joint 6D pose estimation of multiple instances of objects either densely packed or in unstructured piles from RGB-D data. The first objective is to…

Robotics · Computer Science 2019-10-14 Chaitanya Mitash , Bowen Wen , Kostas Bekris , Abdeslam Boularias

Recent advances in 3D perception have shown impressive progress in understanding geometric structures of 3Dshapes and even scenes. Inspired by these advances in geometric understanding, we aim to imbue image-based perception with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Ji Hou , Saining Xie , Benjamin Graham , Angela Dai , Matthias Nießner

We propose a new loss function that we call Laplacian loss, based on spatio-temporal Laplacian representation of the motion as a graph. This loss function is intended to be used in training models for motion reconstruction through 3D human…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Mansour Tchenegnon , Sylvie Gibet , Thibaut Le Naour

We present Tensor4D, an efficient yet effective approach to dynamic scene modeling. The key of our solution is an efficient 4D tensor decomposition method so that the dynamic scene can be directly represented as a 4D spatio-temporal tensor.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Ruizhi Shao , Zerong Zheng , Hanzhang Tu , Boning Liu , Hongwen Zhang , Yebin Liu

Accurately estimating the 6D pose of objects is crucial for many applications, such as robotic grasping, autonomous driving, and augmented reality. However, this task becomes more challenging in poor lighting conditions or when dealing with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Zhujun Li , Ioannis Stamos

In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Geometric information within this process is usually depending on the system setting only, i. e., the scanner…

Image and Video Processing · Electrical Eng. & Systems 2020-06-19 Alexander Preuhs , Michael Manhart , Philipp Roser , Elisabeth Hoppe , Yixing Huang , Marios Psychogios , Markus Kowarschik , Andreas Maier

This paper addresses the problem of preference learning, which aims to align robot behaviors through learning user specific preferences (e.g. "good pull-over location") from visual demonstrations. Despite its similarity to learning factual…

Robotics · Computer Science 2025-01-16 Sadanand Modak , Noah Patton , Isil Dillig , Joydeep Biswas

Predicting human motion from historical pose sequence is crucial for a machine to succeed in intelligent interactions with humans. One aspect that has been obviated so far, is the fact that how we represent the skeletal pose has a critical…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Zhenguang Liu , Shuang Wu , Shuyuan Jin , Shouling Ji , Qi Liu , Shijian Lu , Li Cheng

Two-view pose estimation is essential for map-free visual relocalization and object pose tracking tasks. However, traditional matching methods suffer from time-consuming robust estimators, while deep learning-based pose regressors only…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Rui Yin , Yulun Zhang , Zherong Pan , Jianjun Zhu , Cheng Wang , Biao Jia

We present a new approach to instill 4D dynamic object priors into learned 3D representations by unsupervised pre-training. We observe that dynamic movement of an object through an environment provides important cues about its objectness,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Yujin Chen , Matthias Nießner , Angela Dai

Accurate 6D object pose estimation from images is a key problem in object-centric scene understanding, enabling applications in robotics, augmented reality, and scene reconstruction. Despite recent advances, existing methods often produce…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Martin Malenický , Martin Cífka , Médéric Fourmy , Louis Montaut , Justin Carpentier , Josef Sivic , Vladimir Petrik

Estimating geometry from dynamic scenes, where objects move and deform over time, remains a core challenge in computer vision. Current approaches often rely on multi-stage pipelines or global optimizations that decompose the problem into…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Junyi Zhang , Charles Herrmann , Junhwa Hur , Varun Jampani , Trevor Darrell , Forrester Cole , Deqing Sun , Ming-Hsuan Yang

Object pose estimation is a core computer vision problem and often an essential component in robotics. Pose estimation is usually approached by seeking the single best estimate of an object's pose, but this approach is ill-suited for tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Rasmus Laurvig Haugaard , Frederik Hagelskjær , Thorbjørn Mosekjær Iversen

The recent neural surface reconstruction by volume rendering approaches have made much progress by achieving impressive surface reconstruction quality, but are still limited to dense and highly accurate posed views. To overcome such…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Shi-Sheng Huang , Zi-Xin Zou , Yi-Chi Zhang , Hua Huang

This paper proposes the first self-supervised 6D object pose prediction from multimodal RGB+polarimetric images. The novel training paradigm comprises 1) a physical model to extract geometric information of polarized light, 2) a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Patrick Ruhkamp , Daoyi Gao , Nassir Navab , Benjamin Busam

We propose a method SPGNet for 3D human pose estimation that mixes multi-dimensional re-projection into supervised learning. In this method, the 2D-to-3D-lifting network predicts the global position and coordinates of the 3D human pose.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Zihan Wang , Ruimin Chen , Mengxuan Liu , Guanfang Dong , Anup Basu

Pose estimation is the task of determining the 6D position of an object in a scene. Pose estimation aid the abilities and flexibility of robotic set-ups. However, the system must be configured towards the use case to perform adequately.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Frederik Hagelskjaer , Anders Glent Buch

Camera pose estimation is a key step in standard 3D reconstruction pipelines that operate on a dense set of images of a single object or scene. However, methods for pose estimation often fail when only a few images are available because…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Samarth Sinha , Jason Y. Zhang , Andrea Tagliasacchi , Igor Gilitschenski , David B. Lindell

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu