English
Related papers

Related papers: Unsupervised 3D Perception with 2D Vision-Language…

200 papers

Data collection for autonomous driving is rapidly accelerating, but manual annotation, especially for 3D labels, remains a major bottleneck due to its high cost and labor intensity. Autolabeling has emerged as a scalable alternative,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Levente Tempfli , Esteban Rivera , Markus Lienkamp

For a self-driving car to operate reliably, its perceptual system must generalize to the end-user's environment -- ideally without additional annotation efforts. One potential solution is to leverage unlabeled data (e.g., unlabeled LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yurong You , Cheng Perng Phoo , Katie Z Luo , Travis Zhang , Wei-Lun Chao , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger

We investigate omni-supervised learning, a special regime of semi-supervised learning in which the learner exploits all available labeled data plus internet-scale sources of unlabeled data. Omni-supervised learning is lower-bounded by…

Computer Vision and Pattern Recognition · Computer Science 2017-12-13 Ilija Radosavovic , Piotr Dollár , Ross Girshick , Georgia Gkioxari , Kaiming He

3D semantic segmentation plays a pivotal role in autonomous driving and road infrastructure analysis, yet state-of-the-art 3D models are prone to severe domain shift when deployed across different datasets. In this paper, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Andrew Caunes , Thierry Chateau , Vincent Fremont

Unsupervised and open-vocabulary 3D object detection has recently gained attention, particularly in autonomous driving, where reducing annotation costs and recognizing unseen objects are critical for both safety and scalability. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 In-Jae Lee , Mungyeom Kim , Kwonyoung Ryu , Pierre Musacchio , Jaesik Park

Current LiDAR-based 3D object detectors for autonomous driving are almost entirely trained on human-annotated data collected in specific geographical domains with specific sensor setups, making it difficult to adapt to a different domain.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Jenny Xu , Steven L. Waslander

Autonomous vision applications in production, intralogistics, or manufacturing environments require perception capabilities beyond a small, fixed set of classes. Recent open-vocabulary methods, leveraging 2D Vision-Language Foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Keno Moenck , Adrian Philip Florea , Julian Koch , Thorsten Schüppstuhl

The ability to interpret and comprehend a 3D scene is essential for many vision and robotics systems. In numerous applications, this involves 3D object detection, i.e.~identifying the location and dimensions of objects belonging to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Olivier Moliner , Viktor Larsson , Kalle Åström

The unsupervised 3D object detection is to accurately detect objects in unstructured environments with no explicit supervisory signals. This task, given sparse LiDAR point clouds, often results in compromised performance for detecting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Ruiyang Zhang , Hu Zhang , Hang Yu , Zhedong Zheng

Self-driving cars must detect other vehicles and pedestrians in 3D to plan safe routes and avoid collisions. State-of-the-art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over-fit to domain…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Yurong You , Carlos Andres Diaz-Ruiz , Yan Wang , Wei-Lun Chao , Bharath Hariharan , Mark Campbell , Kilian Q Weinberger

Holistically understanding an object and its 3D movable parts through visual perception models is essential for enabling an autonomous agent to interact with the world. For autonomous driving, the dynamics and states of vehicle parts such…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Feixiang Lu , Zongdai Liu , Hui Miao , Peng Wang , Liangjun Zhang , Ruigang Yang , Dinesh Manocha , Bin Zhou

Recent advancements in camera-based 3D object detection have introduced cross-modal knowledge distillation to bridge the performance gap with LiDAR 3D detectors, leveraging the precise geometric information in LiDAR point clouds. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sanmin Kim , Youngseok Kim , Sihwan Hwang , Hyeonjun Jeong , Dongsuk Kum

A common dilemma in 3D object detection for autonomous driving is that high-quality, dense point clouds are only available during training, but not testing. We use knowledge distillation to bridge the gap between a model trained on…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Yue Wang , Alireza Fathi , Jiajun Wu , Thomas Funkhouser , Justin Solomon

We present an approach to improve 3D vehicle labeling in self-driving applications through zero-shot inference of vehicle information, leveraging Vehicle Make and Model Recognition (VMMR) methods. The proposed approach utilizes a Vision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Steven Chen , Shivesh Khaitan , Nemanja Djuric

Open-vocabulary 3D object detection methods are able to localize 3D boxes of classes unseen during training. Despite the name, existing methods rely on user-specified classes both at training and inference. We propose to study…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Haomeng Zhang , Kuan-Chuan Peng , Suhas Lohit , Raymond A. Yeh

Weakly supervised point cloud semantic segmentation methods that require 1\% or fewer labels, hoping to realize almost the same performance as fully supervised approaches, which recently, have attracted extensive research attention. A…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Tianfang Sun , Zhizhong Zhang , Xin Tan , Yanyun Qu , Yuan Xie , Lizhuang Ma

This work addresses the unsupervised adaptation of an existing object detector to a new target domain. We assume that a large number of unlabeled videos from this domain are readily available. We automatically obtain labels on the target…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Aruni RoyChowdhury , Prithvijit Chakrabarty , Ashish Singh , SouYoung Jin , Huaizu Jiang , Liangliang Cao , Erik Learned-Miller

To safely deploy autonomous vehicles, onboard perception systems must work reliably at high accuracy across a diverse set of environments and geographies. One of the most common techniques to improve the efficacy of such systems in new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Benjamin Caine , Rebecca Roelofs , Vijay Vasudevan , Jiquan Ngiam , Yuning Chai , Zhifeng Chen , Jonathon Shlens

Despite the importance of unsupervised object detection, to the best of our knowledge, there is no previous work addressing this problem. One main issue, widely known to the community, is that object boundaries derived only from 2D image…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Hao Tian , Yuntao Chen , Jifeng Dai , Zhaoxiang Zhang , Xizhou Zhu

This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shiyang Lu , Yunfu Deng , Abdeslam Boularias , Kostas Bekris