中文
相关论文

相关论文: Foundational Models for 3D Point Clouds: A Survey …

200 篇论文

Recent advances in Large Multimodal Models (LMM) have made it possible for various applications in human-machine interactions. However, developing LMMs that can comprehend, reason, and plan in complex and diverse 3D environments remains a…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Sijin Chen , Xin Chen , Chi Zhang , Mingsheng Li , Gang Yu , Hao Fei , Hongyuan Zhu , Jiayuan Fan , Tao Chen

3D point-clouds and 2D images are different visual representations of the physical world. While human vision can understand both representations, computer vision models designed for 2D image and 3D point-cloud understanding are quite…

计算机视觉与模式识别 · 计算机科学 2022-04-26 Chenfeng Xu , Shijia Yang , Tomer Galanti , Bichen Wu , Xiangyu Yue , Bohan Zhai , Wei Zhan , Peter Vajda , Kurt Keutzer , Masayoshi Tomizuka

Foundation models (FMs) are recognized as a transformative breakthrough that has started to reshape the future of artificial intelligence (AI) across both academia and industry. The integration of FMs into wireless networks is expected to…

网络与互联网体系结构 · 计算机科学 2026-01-07 Han Zhang , Mohammad Farzanullah , Mohammad Ghassemi , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Three-dimensional geometric data offer an excellent domain for studying representation learning and generative modeling. In this paper, we look at geometric data represented as point clouds. We introduce a deep AutoEncoder (AE) network with…

计算机视觉与模式识别 · 计算机科学 2018-06-13 Panos Achlioptas , Olga Diamanti , Ioannis Mitliagkas , Leonidas Guibas

Point clouds have become an increasingly important representation for 3D medical imaging, offering a compact, surface-preserving alternative to traditional voxel or mesh-based approaches. Recent advances in deep learning have enabled rapid…

图像与视频处理 · 电气工程与系统科学 2026-02-04 Tongxu Zhang , Zhiming Liang , Bei Wang

Object detection from 3D point clouds remains a challenging task, though recent studies pushed the envelope with the deep learning techniques. Owing to the severe spatial occlusion and inherent variance of point density with the distance to…

计算机视觉与模式识别 · 计算机科学 2020-06-09 Liang Du , Xiaoqing Ye , Xiao Tan , Jianfeng Feng , Zhenbo Xu , Errui Ding , Shilei Wen

The rising importance of 3D understanding, pivotal in computer vision, autonomous driving, and robotics, is evident. However, a prevailing trend, which straightforwardly resorted to transferring 2D alignment strategies to the 3D domain,…

计算机视觉与模式识别 · 计算机科学 2024-01-26 Jiayi Ji , Haowei Wang , Changli Wu , Yiwei Ma , Xiaoshuai Sun , Rongrong Ji

3D object segmentation with Large Language Models (LLMs) has become a prevailing paradigm due to its broad semantics, task flexibility, and strong generalization. However, this paradigm is hindered by representation misalignment: LLMs…

计算机视觉与模式识别 · 计算机科学 2026-02-20 Zhuoxu Huang , Mingqi Gao , Jungong Han

Depth estimation is a fundamental task in 3D computer vision, crucial for applications such as 3D reconstruction, free-viewpoint rendering, robotics, autonomous driving, and AR/VR technologies. Traditional methods relying on hardware…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Zhen Xu , Hongyu Zhou , Sida Peng , Haotong Lin , Haoyu Guo , Jiahao Shao , Peishan Yang , Qinglin Yang , Sheng Miao , Xingyi He , Yifan Wang , Yue Wang , Ruizhen Hu , Yiyi Liao , Xiaowei Zhou , Hujun Bao

In this paper, we address the challenging problem of 3D concept grounding (i.e. segmenting and learning visual concepts) by looking at RGBD images and reasoning about paired questions and answers. Existing visual reasoning approaches…

计算机视觉与模式识别 · 计算机科学 2022-07-14 Yining Hong , Yilun Du , Chunru Lin , Joshua B. Tenenbaum , Chuang Gan

SpatialLM is a large language model designed to process 3D point cloud data and generate structured 3D scene understanding outputs. These outputs include architectural elements like walls, doors, windows, and oriented object boxes with…

计算机视觉与模式识别 · 计算机科学 2025-11-06 Yongsen Mao , Junhao Zhong , Chuan Fang , Jia Zheng , Rui Tang , Hao Zhu , Ping Tan , Zihan Zhou

3D semantic segmentation is a critical task in many real-world applications, such as autonomous driving, robotics, and mixed reality. However, the task is extremely challenging due to ambiguities coming from the unstructured, sparse, and…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Adriano Cardace , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Bioinformatics has witnessed a paradigm shift with the increasing integration of artificial intelligence (AI), particularly through the adoption of foundation models (FMs). These AI techniques have rapidly advanced, addressing historical…

定量方法 · 定量生物学 2024-02-08 Qing Li , Zhihang Hu , Yixuan Wang , Lei Li , Yimin Fan , Irwin King , Le Song , Yu Li

Foundation models are deep neural networks (such as GPT-5, Gemini~3, and Opus~4) trained on large datasets that can perform diverse downstream tasks -- text and code generation, question answering, summarization, image classification, and…

机器学习 · 计算机科学 2026-05-01 Logan G Wright , Tianyu Wang , Tatsuhiro Onodera , Peter L. McMahon

Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. When such models are deployed in real world environments, they inevitably interface with other…

人工智能 · 计算机科学 2023-03-08 Sherry Yang , Ofir Nachum , Yilun Du , Jason Wei , Pieter Abbeel , Dale Schuurmans

With the rapid progress of deep convolutional neural networks, in almost all robotic applications, the availability of 3D point clouds improves the accuracy of 3D semantic segmentation methods. Rendering of these irregular, unstructured,…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Mobina Mahdavi , Fahimeh Fooladgar , Shohreh Kasaei

Robot vision has greatly benefited from advancements in multimodal fusion techniques and vision-language models (VLMs). We adopt a task-oriented perspective to systematically review the applications and advancements of multimodal fusion…

Multi-view projection methods have demonstrated promising performance on 3D understanding tasks like 3D classification and segmentation. However, it remains unclear how to combine such multi-view methods with the widely available 3D point…

计算机视觉与模式识别 · 计算机科学 2023-01-26 Abdullah Hamdi , Silvio Giancola , Bernard Ghanem