English
Related papers

Related papers: KitchenTwin: Semantically and Geometrically Ground…

200 papers

Zero-shot 3D point cloud understanding can be achieved via 2D Vision-Language Models (VLMs). Existing strategies directly map Vision-Language Models from 2D pixels of rendered or captured views to 3D points, overlooking the inherent and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Guofeng Mei , Luigi Riz , Yiming Wang , Fabio Poiesi

3D scene understanding from point clouds plays a vital role for various robotic applications. Unfortunately, current state-of-the-art methods use separate neural networks for different tasks like object detection or room layout estimation.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Xiaoxue Chen , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Acquiring accurate three-dimensional depth information conventionally requires expensive multibeam LiDAR devices. Recently, researchers have developed a less expensive option by predicting depth information from two-dimensional color…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Peng Yin , Jianing Qian , Yibo Cao , David Held , Howie Choset

In order to improve the task execution capability of home service robot, and to cope with the problem that purely physical robot platforms cannot sense the environment and make decisions online, a method for building digital twin system for…

Robotics · Computer Science 2023-09-13 Zhengsong Jiang , Guohui Tian , Yongcheng Cui , Tiantian Liu , Yu Gu , Yifei Wang

Developing high-fidelity, interactive digital twins is crucial for enabling closed-loop motion planning and reliable real-world robot execution, which are essential to advancing sim-to-real transfer. However, existing approaches often…

Robotics · Computer Science 2026-05-05 Ziyang Sun , Lingfan Bao , Tianhu Peng , Jingcheng Sun , Chengxu Zhou

Scene graphs have been recently introduced into 3D spatial understanding as a comprehensive representation of the scene. The alignment between 3D scene graphs is the first step of many downstream tasks such as scene graph aided point cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yaxu Xie , Alain Pagani , Didier Stricker

Depth imaging has largely focused on sensor and intrinsics properties. However, the accuracy of acquire pixel is largely dependent on the capture. We propose a new depth estimation and approximation algorithm which takes an arbitrary 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Rajer Sindhu , Jayesh Ananya

Vision-Language Models (VLMs) still lack robustness in spatial intelligence, demonstrating poor performance on spatial understanding and reasoning tasks. We attribute this gap to the absence of a visual geometry learning process capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Wenbo Hu , Jingli Lin , Yilin Long , Yunlong Ran , Lihan Jiang , Yifan Wang , Chenming Zhu , Runsen Xu , Tai Wang , Jiangmiao Pang

Existing 3D foundation models typically align point clouds to frozen vision-language spaces like CLIP, which achieve strong cross-modal retrieval by compressing 3D shape into a global vector. However, this global-only alignment cannot…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Zebin He , Mingxin Yang , Shuhui Yang , Hanxiao Sun , Xintong Han , Chunchao Guo , Wenhan Luo

Digital twin (DT) offers significant opportunities for enhancing facility management (FM) in campus environments. However, existing research often focuses narrowly on isolated domains, such as point-cloud geometry or energy analytics,…

Systems and Control · Electrical Eng. & Systems 2025-12-16 Thyda Siv

As digital twins become central to the transformation of modern cities, accurate and structured 3D building models emerge as a key enabler of high-fidelity, updatable urban representations. These models underpin diverse applications…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Shangfeng Huang , Ruisheng Wang , Xin Wang

We present Implicit-Scale 3D Reconstruction from Monocular Multi-Food Images, a benchmark dataset designed to advance geometry-based food portion estimation in realistic dining scenarios. Existing dietary assessment methods largely rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Yuhao Chen , Gautham Vinod , Siddeshwar Raghavan , Talha Ibn Mahmud , Bruce Coburn , Jinge Ma , Fengqing Zhu , Jiangpeng He

Point cloud registration is the task of estimating the rigid transformation that aligns a pair of point cloud fragments. We present an efficient and robust framework for pairwise registration of real-world 3D scans, leveraging Hough voting…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Junha Lee , Seungwook Kim , Minsu Cho , Jaesik Park

In addition to color and textural information, geometry provides important cues for 3D scene reconstruction. However, current reconstruction methods only include geometry at the feature level thus not fully exploiting the geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Ruihong Yin , Sezer Karaoglu , Theo Gevers

Dense and accurate 3D mapping from a monocular sequence is a key technology for several applications and still an open research area. This paper leverages recent results on single-view CNN-based depth estimation and fuses them with…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 José M. Fácil , Alejo Concha , Luis Montesano , Javier Civera

This work is interested in digital twins, and the development of a simplified framework for them, in the context of dynamical systems. Digital twin is an ingenious concept that helps on organizing different areas of expertise aiming at…

Signal Processing · Electrical Eng. & Systems 2021-01-29 TG Ritto , FA Rochinha

The integration of geometric reconstruction and generative modeling remains a critical challenge in developing AI systems capable of human-like spatial reasoning. This paper proposes Aether, a unified framework that enables geometry-aware…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Aether Team , Haoyi Zhu , Yifan Wang , Jianjun Zhou , Wenzheng Chang , Yang Zhou , Zizun Li , Junyi Chen , Chunhua Shen , Jiangmiao Pang , Tong He

Panoramic cameras, capable of capturing a 360-degree field of view, are crucial in robotic vision, particularly in environments with sparse features. However, non-upright panoramas due to unstable robot postures hinder downstream tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yuhao Shan , Qianyi Yuan , Jingguo Liu , Shigang Li , Jianfeng Li , Tong Chen

Combining LiDAR and Camera-view data has become a common approach for 3D Object Detection. However, previous approaches combine the two input streams at a point-level, throwing away semantic information derived from camera features. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Pranav Gupta , Rishabh Rengarajan , Viren Bankapur , Vedansh Mannem , Lakshit Ahuja , Surya Vijay , Kevin Wang

Fully harvesting the gain of multiple-input and multiple-output (MIMO) requires accurate channel information. However, conventional channel acquisition methods mainly rely on pilot training signals, resulting in significant training…

Information Theory · Computer Science 2024-09-26 Shuaifeng Jiang , Qi Qu , Xiaqing Pan , Abhishek Agrawal , Richard Newcombe , Ahmed Alkhateeb