English
Related papers

Related papers: xMOD: Cross-Modal Distillation for 2D/3D Multi-Obj…

200 papers

Tracking 3D objects accurately and consistently is crucial for autonomous vehicles, enabling more reliable downstream tasks such as trajectory prediction and motion planning. Based on the substantial progress in object detection in recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Shuxiao Ding , Eike Rehder , Lukas Schneider , Marius Cordts , Juergen Gall

3D object detection from multiple image views is a fundamental and challenging task for visual scene understanding. Owing to its low cost and high efficiency, multi-view 3D object detection has demonstrated promising application prospects.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinhong Jiang , Feng Zhao

Learning effective multi-modal 3D representations of objects is essential for numerous applications, such as augmented reality and robotics. Existing methods often rely on task-specific embeddings that are tailored either for semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Gaia Di Lorenzo , Federico Tombari , Marc Pollefeys , Daniel Barath

The rise of autonomous vehicles has significantly increased the demand for robust 3D object detection systems. While cameras and LiDAR sensors each offer unique advantages--cameras provide rich texture information and LiDAR offers precise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zitian Wang , Zehao Huang , Yulu Gao , Naiyan Wang , Si Liu

Multimodal intent understanding is a significant research area that requires effective leveraging of multiple modalities to analyze human language. Existing methods face two main challenges in this domain. Firstly, they have limitations in…

Multimedia · Computer Science 2025-05-26 Hanlei Zhang , Qianrui Zhou , Hua Xu , Jianhua Su , Roberto Evans , Kai Gao

We study multi-modal few-shot object detection (FSOD) in this paper, using both few-shot visual examples and class semantic information for detection, which are complementary to each other by definition. Most of the previous works on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Guangxing Han , Long Chen , Jiawei Ma , Shiyuan Huang , Rama Chellappa , Shih-Fu Chang

Multi-object tracking (MOT) is a challenging vision task that aims to detect individual objects within a single frame and associate them across multiple frames. Recent MOT approaches can be categorized into two-stage tracking-by-detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Run Luo , Zikai Song , Lintao Ma , Jinlin Wei , Wei Yang , Min Yang

In this survey, we first introduce the background of popular sensors used for self-driving, their data properties, and the corresponding object detection algorithms. Next, we discuss existing datasets that can be used for evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yingjie Wang , Qiuyu Mao , Hanqi Zhu , Jiajun Deng , Yu Zhang , Jianmin Ji , Houqiang Li , Yanyong Zhang

Cross-modal systems trained on 2D visual inputs are presented with a dimensional shift when processing 3D scenes. An in-scene camera bridges the dimensionality gap but requires learning a control module. We introduce a new method that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jason Armitage , Rico Sennnrich

Object detection has long been a topic of high interest in computer vision literature. Motivated by the fact that annotating data for the multi-object tracking (MOT) problem is immensely expensive, recent studies have turned their attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Son Tran , Cong Tran , Anh Tran , Cuong Pham

Object detection has been extensively utilized in autonomous systems in recent years, encompassing both 2D and 3D object detection. Recent research in this field has primarily centered around multimodal approaches for addressing this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Wendong Zhang

Unsupervised Domain Adaptation (UDA) is crucial to tackle the lack of annotations in a new domain. There are many multi-modal datasets, but most UDA approaches are uni-modal. In this work, we explore how to learn from multi-modality and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Maximilian Jaritz , Tuan-Hung Vu , Raoul de Charette , Émilie Wirbel , Patrick Pérez

Recent advancements in camera-based 3D object detection have introduced cross-modal knowledge distillation to bridge the performance gap with LiDAR 3D detectors, leveraging the precise geometric information in LiDAR point clouds. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sanmin Kim , Youngseok Kim , Sihwan Hwang , Hyeonjun Jeong , Dongsuk Kum

Autonomous systems need to localize and track surrounding objects in 3D space for safe motion planning. As a result, 3D multi-object tracking (MOT) plays a vital role in autonomous navigation. Most MOT methods use a tracking-by-detection…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Can Chen , Luca Zanotti Fragonara , Antonios Tsourdos

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

Most existing multi-object tracking methods typically learn visual tracking features via maximizing dis-similarities of different instances and minimizing similarities of the same instance. While such a feature learning scheme achieves…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yuhao Li , Jiale Cao , Muzammal Naseer , Yu Zhu , Jinqiu Sun , Yanning Zhang , Fahad Shahbaz Khan

Recent approaches for 3D object detection have made tremendous progresses due to the development of deep learning. However, previous researches are mostly based on individual frames, leading to limited exploitation of information between…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Xusen Guo , Jiangfeng Gu , Silu Guo , Zixiao Xu , Chengzhang Yang , Shanghua Liu , Long Cheng , Kai Huang

The estimation of uncertainty in robotic vision, such as 3D object detection, is an essential component in developing safe autonomous systems aware of their own performance. However, the deployment of current uncertainty estimation methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Matthew Pitropov , Chengjie Huang , Vahdat Abdelzad , Krzysztof Czarnecki , Steven Waslander

Objection detection (OD) has been one of the most fundamental tasks in computer vision. Recent developments in deep learning have pushed the performance of image OD to new heights by learning-based, data-driven approaches. On the other…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Peirong Liu , Rui Wang , Pengchuan Zhang , Omid Poursaeed , Yipin Zhou , Xuefei Cao , Sreya Dutta Roy , Ashish Shah , Ser-Nam Lim

Manufacturing requires reliable object detection methods for precise picking and handling of diverse types of manufacturing parts and components. Traditional object detection methods utilize either only 2D images from cameras or 3D data…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Nazanin Mahjourian , Vinh Nguyen