English
Related papers

Related papers: Foundational Models for 3D Point Clouds: A Survey …

200 papers

In recent years, point cloud representation has become one of the research hotspots in the field of computer vision, and has been widely used in many fields, such as autonomous driving, virtual reality, robotics, etc. Although deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Huang Zhang , Changshuo Wang , Shengwei Tian , Baoli Lu , Liping Zhang , Xin Ning , Xiao Bai

Three dimensional (3D) object recognition is becoming a key desired capability for many computer vision systems such as autonomous vehicles, service robots and surveillance drones to operate more effectively in unstructured environments.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Chenxi Xiao , Juan Wachs

Multimodal remote sensing data, including spectral and lidar or photogrammetry, is crucial for achieving satisfactory land-use / land-cover classification results in urban scenes. So far, most studies have been conducted in a 2D context.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Aldino Rizaldy , Richard Gloaguen , Fabian Ewald Fassnacht , Pedram Ghamisi

Deep learning within the context of point clouds has gained much research interest in recent years mostly due to the promising results that have been achieved on a number of challenging benchmarks, such as 3D shape recognition and scene…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Ye Zhu , Sven Ewan Shepstone , Pablo Martínez-Nuevo , Miklas Strøm Kristoffersen , Fabien Moutarde , Zhuang Fu

During the last years, many advances have been made in tasks like3D model retrieval, 3D model classification, and 3D model segmentation.The typical 3D representations such as point clouds, voxels, and poly-gon meshes are mostly suitable for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Arniel Labrada , Benjamin Bustos , Ivan Sipiran

Following its success in natural language processing and computer vision, foundation models that are pre-trained on large-scale multi-task datasets have also shown great potential in robotics. However, most existing robot foundation models…

Robotics · Computer Science 2025-03-13 Rujia Yang , Geng Chen , Chuan Wen , Yang Gao

With the rapid advancement of technology, 3D data acquisition and utilization have become increasingly prevalent across various fields, including computer vision, robotics, and geospatial analysis. 3D data, captured through methods such as…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siming Yan

Foundation models have indeed made a profound impact on various fields, emerging as pivotal components that significantly shape the capabilities of intelligent systems. In the context of intelligent vehicles, leveraging the power of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sheng Luo , Wei Chen , Wanxin Tian , Rui Liu , Luanxuan Hou , Xiubao Zhang , Haifeng Shen , Ruiqi Wu , Shuyi Geng , Yi Zhou , Ling Shao , Yi Yang , Bojun Gao , Qun Li , Guobin Wu

Foundation models (FM) have shown immense human-like capabilities for generating digital media. However, foundation models that can freely sense, interact, and actuate the physical domain is far from being realized. This is due to 1)…

Robotics · Computer Science 2025-03-07 Minghui Zhao , Junxi Xia , Kaiyuan Hou , Yanchen Liu , Stephen Xia , Xiaofan Jiang

Building 3D maps of the environment is central to robot navigation, planning, and interaction with objects in a scene. Most existing approaches that integrate semantic concepts with 3D maps largely remain confined to the closed-set setting:…

Given the prominence of current 3D sensors, a fine-grained analysis on the basic point cloud data is worthy of further investigation. Particularly, real point cloud scenes can intuitively capture complex surroundings in the real world, but…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Shi Qiu , Saeed Anwar , Nick Barnes

Recent advancements in machine learning (ML) and deep learning (DL), particularly through the introduction of Foundation Models (FMs), have significantly enhanced surgical scene understanding within minimally invasive surgery (MIS). This…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Ufaq Khan , Umair Nawaz , Adnan Qayyum , Shazad Ashraf , Yutong Xie , Muhammad Haris Khan , Muhammad Bilal , Junaid Qadir

3D medical image classification is essential for modern clinical workflows. Medical foundation models (FMs) have emerged as a promising approach for scaling to new tasks, yet current research suffers from three critical pitfalls:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Han Liu , Bogdan Georgescu , Yanbo Zhang , Youngjin Yoo , Michael Baumgartner , Riqiang Gao , Jianing Wang , Gengyan Zhao , Eli Gibson , Dorin Comaniciu , Sasa Grbic

To endow machines with the ability to perceive the real-world in a three dimensional representation as we do as humans is a fundamental and long-standing topic in Artificial Intelligence. Given different types of visual inputs such as…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Bo Yang

Recent advances in self-supervised learning (SSL) for point clouds have substantially improved 3D scene understanding without human annotations. Existing approaches emphasize semantic awareness by enforcing feature consistency across…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Bin Yang , Mohamed Abdelsamad , Miao Zhang , Alexandru Paul Condurache

3D world models (i.e., learning-based 3D dynamics models) offer a promising approach to generalizable robotic manipulation by capturing the underlying physics of environment evolution conditioned on robot actions. However, existing 3D world…

Robotics · Computer Science 2025-08-27 Suning Huang , Qianzhong Chen , Xiaohan Zhang , Jiankai Sun , Mac Schwager

Point cloud segmentation is a fundamental task in 3D scene understanding. Its progress is constrained by the high cost and time required for dense 3D annotations, making labeled samples difficult to obtain. Beyond annotation scarcity,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Thenukan Pathmanathan , Kanchan Keisham , Thangarajah Akilan

Qualifying the discrepancy between 3D geometric models, which could be represented with either point clouds or triangle meshes, is a pivotal issue with board applications. Existing methods mainly focus on directly establishing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Siyu Ren , Junhui Hou , Xiaodong Chen , Hongkai Xiong , Wenping Wang

3D dense captioning, as an emerging vision-language task, aims to identify and locate each object from a set of point clouds and generate a distinctive natural language sentence for describing each located object. However, the existing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yufeng Zhong , Long Xu , Jiebo Luo , Lin Ma

The development of 2D foundation models for image segmentation has been significantly advanced by the Segment Anything Model (SAM). However, achieving similar success in 3D models remains a challenge due to issues such as non-unified data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Yuchen Zhou , Jiayuan Gu , Tung Yen Chiang , Fanbo Xiang , Hao Su