English
Related papers

Related papers: From Points to Multi-Object 3D Reconstruction

200 papers

Much of the focus in the object detection literature has been on the problem of identifying the bounding box of a particular class of object in an image. Yet, in contexts such as robotics and augmented reality, it is often necessary to find…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Jean-Philippe Mercier , Mathieu Garon , Philippe Giguère , Jean-François Lalonde

We propose a novel online, point-based 3D reconstruction method from posed monocular RGB videos. Our model maintains a global point cloud representation of the scene, continuously updating the features and 3D locations of points as new…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Chen Ziwen , Zexiang Xu , Li Fuxin

Recovering high-quality 3D scenes from a single RGB image is a challenging task in computer graphics. Current methods often struggle with domain-specific limitations or low-quality object generation. To address these, we propose CAST…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Kaixin Yao , Longwen Zhang , Xinhao Yan , Yan Zeng , Qixuan Zhang , Wei Yang , Lan Xu , Jiayuan Gu , Jingyi Yu

Humans perceive the 3D world as a set of distinct objects that are characterized by various low-level (geometry, reflectance) and high-level (connectivity, adjacency, symmetry) properties. Recent methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Despoina Paschalidou , Luc van Gool , Andreas Geiger

Solving the challenging problem of 3D object reconstruction from a single image appropriately gives existing technologies the ability to perform with a single monocular camera rather than requiring depth sensors. In recent years, thanks to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Guiju Ping , Mahdi Abolfazli Esfahani , Han Wang

In this paper, we propose an advanced methodology for the detection of 3D objects and precise estimation of their spatial positions from a single image. Unlike conventional frameworks that rely solely on center-point and dimension…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dhyey Manish Rajani , Surya Pratap Singh , Rahul Kashyap Swayampakula

Due to inevitable noises introduced during scanning and quantization, 3D reconstruction via RGB-D sensors suffers from errors both in geometry and texture, leading to artifacts such as camera drifting, mesh distortion, texture ghosting, and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Jingbo Zhang , Ziyu Wan , Jing Liao

Three-dimensional objects are commonly represented as 3D boxes in a point-cloud. This representation mimics the well-studied image-based 2D bounding-box detection but comes with additional challenges. Objects in a 3D world do not follow any…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

Detection identifies objects as axis-aligned boxes in an image. Most successful object detectors enumerate a nearly exhaustive list of potential object locations and classify each. This is wasteful, inefficient, and requires additional…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Xingyi Zhou , Dequan Wang , Philipp Krähenbühl

Active object reconstruction is crucial for many robotic applications. A key aspect in these scenarios is generating object-specific view configurations to obtain informative measurements for reconstruction. One-shot view planning enables…

Robotics · Computer Science 2025-04-17 Sicong Pan , Liren Jin , Xuying Huang , Cyrill Stachniss , Marija Popović , Maren Bennewitz

We present a novel learned keypoint detection method designed to maximize the number of correct matches for the task of non-rigid image correspondence. Our training framework uses true correspondences, obtained by matching annotated image…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Welerson Melo , Guilherme Potje , Felipe Cadar , Renato Martins , Erickson R. Nascimento

Reconstructing a 3D object from a 2D image is a well-researched vision problem, with many kinds of deep learning techniques having been tried. Most commonly, 3D convolutional approaches are used, though previous work has shown…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Rohan Agarwal , Wei Zhou , Xiaofeng Wu , Yuhan Li

Inferring 3D structure of a generic object from a 2D image is a long-standing objective of computer vision. Conventional approaches either learn completely from CAD-generated synthetic data, which have difficulty in inference from real…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Feng Liu , Luan Tran , Xiaoming Liu

In this paper, we study the representation of the shape and pose of objects using their keypoints. Therefore, we propose an end-to-end method that simultaneously detects 2D keypoints from an image and lifts them to 3D. The proposed method…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Yigit Baran Can , Alexander Liniger , Danda Pani Paudel , Luc Van Gool

In this paper, we propose an approach to address the problem of 3D reconstruction of scenes from a single image captured by a light-field camera equipped with a rolling shutter sensor. Our method leverages the 3D information cues present in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hermes McGriff , Renato Martins , Nicolas Andreff , Cédric Demonceaux

Applications in the field of augmented reality or robotics often require joint localisation and 6D pose estimation of multiple objects. However, most algorithms need one network per object class to be trained in order to provide the best…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Niklas Gard , Anna Hilsmann , Peter Eisert

We present a novel object detection pipeline for localization and recognition in three dimensional environments. Our approach makes use of an RGB-D sensor and combines state-of-the-art techniques from the robotics and computer vision…

Robotics · Computer Science 2017-03-16 Alexander Broad , Brenna Argall

We present a deep learning-based multitask framework for joint 3D human pose estimation and action recognition from RGB video sequences. Our approach proceeds along two stages. In the first, we run a real-time 2D pose detector to determine…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Huy Hieu Pham , Houssam Salmane , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A Velastin

Partial-view 3D recognition -- reconstructing 3D geometry and identifying object instances from a few sparse RGB images -- is an exceptionally challenging yet practically essential task, particularly in cluttered, occluded real-world…

Robotics · Computer Science 2025-07-09 Young Hun Kim , Seungyeon Kim , Yonghyeon Lee , Frank Chongwoo Park

In this work, we propose a novel single-shot and keypoints-based framework for monocular 3D objects detection using only RGB images, called KM3D-Net. We design a fully convolutional model to predict object keypoints, dimension, and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Peixuan Li