English
Related papers

Related papers: PointSt3R: Point Tracking through 3D Grounded Corr…

200 papers

We propose a novel approach for joint 3D multi-object tracking and reconstruction from RGB-D sequences in indoor environments. To this end, we detect and reconstruct objects in each frame while predicting dense correspondences mappings into…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Dominik Schmauser , Zeju Qiu , Norman Müller , Matthias Nießner

Estimating geometry from dynamic scenes, where objects move and deform over time, remains a core challenge in computer vision. Current approaches often rely on multi-stage pipelines or global optimizations that decompose the problem into…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Junyi Zhang , Charles Herrmann , Junhwa Hur , Varun Jampani , Trevor Darrell , Forrester Cole , Deqing Sun , Ming-Hsuan Yang

In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in the current search point cloud given a template point cloud. Motivated by the success of transformers, we propose Point Tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Changqing Zhou , Zhipeng Luo , Yueru Luo , Tianrui Liu , Liang Pan , Zhongang Cai , Haiyu Zhao , Shijian Lu

Dense 3D tracking from monocular video is fundamental to dynamic scene understanding. While recent 3D foundation models provide reliable per-frame geometry, recovering object motion in this geometry remains challenging and benefits from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Jisu Nam , Jahyeok Koo , Soowon Son , Jaewoo Jung , Honggyu An , Junhwa Hur , Seungryong Kim

We present STream3R, a novel approach to 3D reconstruction that reformulates pointmap prediction as a decoder-only Transformer problem. Existing state-of-the-art methods for multi-view reconstruction either depend on expensive global…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yushi Lan , Yihang Luo , Fangzhou Hong , Shangchen Zhou , Honghua Chen , Zhaoyang Lyu , Shuai Yang , Bo Dai , Chen Change Loy , Xingang Pan

Relative pose estimation provides a promising way for achieving object-agnostic pose estimation. Despite the success of existing 3D correspondence-based methods, the reliance on explicit feature matching suffers from small overlaps in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yihan Chen , Wenfei Yang , Huan Ren , Shifeng Zhang , Tianzhu Zhang , Feng Wu

Point tracking aims to localize corresponding points across video frames, serving as a fundamental task for 4D reconstruction, robotics, and video editing. Existing methods commonly rely on shallow convolutional backbones such as ResNet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Soowon Son , Honggyu An , Chaehyun Kim , Hyunah Ko , Jisu Nam , Dahyun Chung , Siyoon Jin , Jung Yi , Jaewon Min , Junhwa Hur , Seungryong Kim

We present To The Point (TTP), a method for reconstructing 3D objects from a single image using 2D to 3D correspondences learned from weak supervision. We recover a 3D shape from a 2D image by first regressing the 2D positions corresponding…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Filippos Kokkinos , Iasonas Kokkinos

Photomechanics is a crucial branch of solid mechanics. The localization of point targets constitutes a fundamental problem in optical experimental mechanics, with extensive applications in various missions of UAVs. Localizing moving targets…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Huayu Huang , Banglei Guan , Yang Shang , Qifeng Yu

Augmented reality assembly guidance is essential for intelligent manufacturing and medical applications, requiring continuous measurement of the 6DoF poses of manipulated objects. Although current tracking methods have made significant…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Jixiang Chen , Jing Chen , Kai Liu , Haochen Chang , Shanfeng Fu , Jian Yang

Multi-view 3D reconstruction remains a core challenge in computer vision, particularly in applications requiring accurate and scalable representations across diverse perspectives. Current leading methods such as DUSt3R employ a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jianing Yang , Alexander Sax , Kevin J. Liang , Mikael Henaff , Hao Tang , Ang Cao , Joyce Chai , Franziska Meier , Matt Feiszli

Novel view synthesis from monocular videos of dynamic scenes with unknown camera poses remains a fundamental challenge in computer vision and graphics. While recent advances in 3D representations such as Neural Radiance Fields (NeRF) and 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Mengqi Guo , Bo Xu , Yanyan Li , Gim Hee Lee

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

Prior ReLoc3R achieves breakthrough performance with fast 25ms inference and state-of-the-art regression accuracy, yet our analysis reveals subtle geometric inconsistencies in its internal representations that prevent reaching the precision…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jingxing Li , Yongjae Lee , Deliang Fan

Recovering the 3D geometry of a scene from a sparse set of uncalibrated images is a long-standing problem in computer vision. While recent learning-based approaches such as DUSt3R and MASt3R have demonstrated impressive results by directly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Sara Rojas , Matthieu Armando , Bernard Ghamen , Philippe Weinzaepfel , Vincent Leroy , Gregory Rogez

We investigate a variation of the 3D registration problem, named multi-model 3D registration. In the multi-model registration problem, we are given two point clouds picturing a set of objects at different poses (and possibly including…

Robotics · Computer Science 2024-02-19 David Jin , Sushrut Karmalkar , Harry Zhang , Luca Carlone

3D Gaussian Splatting techniques have enabled efficient photo-realistic rendering of static scenes. Recent works have extended these approaches to support surface reconstruction and tracking. However, tracking dynamic surfaces with 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Chengwei Zheng , Lixin Xue , Juan Zarate , Jie Song

Long-term point tracking is essential to understand non-rigid motion in the physical world better. Deep learning approaches have recently been incorporated into long-term point tracking, but most prior work predominantly functions in 2D.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Hung Nguyen , Chanho Kim , Rigved Naukarkar , Li Fuxin

Segment matching is an important intermediate task in computer vision that establishes correspondences between semantically or geometrically coherent regions across images. Unlike keypoint matching, which focuses on localized features,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Rohit Jayanti , Swayam Agrawal , Vansh Garg , Siddharth Tourani , Muhammad Haris Khan , Sourav Garg , Madhava Krishna

Room layout estimation from multiple-perspective images is poorly investigated due to the complexities that emerge from multi-view geometry, which requires muti-step solutions such as camera intrinsic and extrinsic estimation, image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Yaxuan Huang , Xili Dai , Jianan Wang , Xianbiao Qi , Yixing Yuan , Xiangyu Yue