English
Related papers

Related papers: 3D Point Cloud Pre-training with Knowledge Distill…

200 papers

Leveraging pre-trained 2D image representations in behavior cloning policies has achieved great success and has become a standard approach for robotic manipulation. However, such representations fail to capture the 3D spatial information…

Robotics · Computer Science 2026-05-07 I-Chun Arthur Liu , Krzysztof Choromanski , Sandy Huang , Connor Schenck

LiDAR point cloud segmentation is one of the most fundamental tasks for autonomous driving scene understanding. However, it is difficult for existing models to achieve both high inference speed and accuracy simultaneously. For example,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Feng Jiang , Heng Gao , Shoumeng Qiu , Haiqiang Zhang , Ru Wan , Jian Pu

Test-Time Training (TTT) proposes to adapt a pre-trained network to changing data distributions on-the-fly. In this work, we propose the first TTT method for 3D semantic segmentation, TTT-KD, which models Knowledge Distillation (KD) from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Lisa Weijler , Muhammad Jehanzeb Mirza , Leon Sick , Can Ekkazan , Pedro Hermosilla

Semantic segmentation of 3D point clouds is a challenging problem with numerous real-world applications. While deep learning has revolutionized the field of image semantic segmentation, its impact on point cloud data has been limited so…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Felix Järemo Lawin , Martin Danelljan , Patrik Tosteberg , Goutam Bhat , Fahad Shahbaz Khan , Michael Felsberg

Accurate estimation of wheat spike volume is important for yield component analysis and stress resilience assessment, yet field-based measurement remains challenging. Active 3D sensing methods such as Light Detection and Ranging (LiDAR) or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Olivia Zumsteg , Jannis Widmer , Yann Bourdé , Norbert Kirchgessner , Andreas Hund , Lukas Roth , Paraskevi Nousi

The scale diversity of point cloud data presents significant challenges in developing unified representation learning techniques for 3D vision. Currently, there are few unified 3D models, and no existing pre-training method is equally…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Ziyi Wang , Yanran Zhang , Jie Zhou , Jiwen Lu

Learning and analyzing 3D point clouds with deep networks is challenging due to the sparseness and irregularity of the data. In this paper, we present a data-driven point cloud upsampling technique. The key idea is to learn multi-level…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Lequan Yu , Xianzhi Li , Chi-Wing Fu , Daniel Cohen-Or , Pheng-Ann Heng

The scarcity of large-scale 3D-text paired data poses a great challenge on open vocabulary 3D scene understanding, and hence it is popular to leverage internet-scale 2D data and transfer their open vocabulary capabilities to 3D models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Pengfei Wang , Yuxi Wang , Shuai Li , Zhaoxiang Zhang , Zhen Lei , Lei Zhang

Point cloud completion is a generation and estimation issue derived from the partial point clouds, which plays a vital role in the applications in 3D computer vision. The progress of deep learning (DL) has impressively improved the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Ben Fei , Weidong Yang , Wenming Chen , Zhijun Li , Yikang Li , Tao Ma , Xing Hu , Lipeng Ma

Classification tasks in 3D point clouds often assume that class events \replaced{are }{follow }independent and identically distributed (IID), although this assumption destroys the correlation between classes. This \replaced{study }{paper…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zhiqiang Tian , Weigang Li , Junwei Hu , Chunhua Deng

Knowledge distillation aims at transferring the knowledge from a large teacher model to a small student model with great improvements of the performance of the student model. Therefore, the student network can replace the teacher network to…

Machine Learning · Computer Science 2021-12-28 Jinhong Lin , Zhaoyang Li

Grounding natural language to the physical world is a ubiquitous topic with a wide range of applications in computer vision and robotics. Recently, 2D vision-language models such as CLIP have been widely popularized, due to their impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Georgios Tziafas , Yucheng Xu , Zhibin Li , Hamidreza Kasaei

Point clouds collected from real-world environments are often incomplete due to factors such as limited sensor resolution, single viewpoints, occlusions, and noise. These challenges make point cloud completion essential for various…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yifan Yang , Yuxiang Yan , Boda Liu , Jian Pu

Robust imitation learning for robot manipulation requires comprehensive 3D perception, yet many existing methods struggle in cluttered environments. Fixed camera view approaches are vulnerable to perspective changes, and 3D point cloud…

Robotics · Computer Science 2025-07-08 Daqi Huang , Zhehao Cai , Yuzhi Hao , Zechen Li , Chee-Meng Chew

Knowledge distillation is an effective approach to learn compact models (students) with the supervision of large and strong models (teachers). As empirically there exists a strong correlation between the performance of teacher and student…

Machine Learning · Computer Science 2022-10-13 Chaofei Wang , Qisen Yang , Rui Huang , Shiji Song , Gao Huang

In instance-level detection tasks (e.g., object detection), reducing input resolution is an easy option to improve runtime efficiency. However, this option traditionally hurts the detection performance much. This paper focuses on boosting…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Lu Qi , Jason Kuen , Jiuxiang Gu , Zhe Lin , Yi Wang , Yukang Chen , Yanwei Li , Jiaya Jia

A crucial task in scene understanding is 3D object detection, which aims to detect and localize the 3D bounding boxes of objects belonging to specific classes. Existing 3D object detectors heavily rely on annotated 3D bounding boxes during…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Zengyi Qin , Jinglu Wang , Yan Lu

Knowledge distillation (KD) is commonly deemed as an effective model compression technique in which a compact model (student) is trained under the supervision of a larger pretrained model or an ensemble of models (teacher). Various…

Machine Learning · Computer Science 2020-07-08 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Fusion of 2D images and 3D point clouds is important because information from dense images can enhance sparse point clouds. However, fusion is challenging because 2D and 3D data live in different spaces. In this work, we propose MVPNet…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Maximilian Jaritz , Jiayuan Gu , Hao Su

Deep neural networks have achieved significant success in 3D point cloud classification while relying on large-scale, annotated point cloud datasets, which are labor-intensive to build. Compared to capturing data with LiDAR sensors and then…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Huantao Ren , Minmin Yang , Senem Velipasalar