English
Related papers

Related papers: Multi-Granularity Language-Guided Training for Mul…

200 papers

We present a novel visual instruction tuning strategy to improve the zero-shot task generalization of multimodal large language models by building a firm text-only knowledge base. Existing work lacks sufficient experimentation on the…

Computation and Language · Computer Science 2025-07-01 Jianhong Tu , Zhuohao Ni , Nicholas Crispino , Zihao Yu , Michael Bendersky , Beliz Gunel , Ruoxi Jia , Xin Liu , Lingjuan Lyu , Dawn Song , Chenguang Wang

Autonomous-driving perception systems require robust Multi-Object Tracking (MOT) to operate reliably in dynamic environments. MOT maintains consistent object identities across frames while preserving spatial accuracy. Recent foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Diogo Mendonça , Tiago Barros , Cristiano Premebida , Urbano J. Nunes

Multiple Object Tracking (MOT) has witnessed remarkable advances in recent years. However, existing studies dominantly request prior knowledge of the tracking target, and hence may not generalize well to unseen categories. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Hexin Bai , Wensheng Cheng , Peng Chu , Juehuan Liu , Kai Zhang , Haibin Ling

Driven by large-scale contrastive vision-language pre-trained models such as CLIP, recent advancements in the image-text matching task have achieved remarkable success in representation learning. Due to image-level visual-language…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Mengxiao Tian , Xinxiao Wu , Shuo Yang

Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking. Its key lies in how to fuse multi-modal data and reduce the gap between modalities.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

This work proposes an end-to-end multi-camera 3D multi-object tracking (MOT) framework. It emphasizes spatio-temporal continuity and integrates both past and future reasoning for tracked objects. Thus, we name it "Past-and-Future reasoning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Ziqi Pang , Jie Li , Pavel Tokmakov , Dian Chen , Sergey Zagoruyko , Yu-Xiong Wang

Multiple Object Tracking (MOT) is a long-standing task in computer vision. Current approaches based on the tracking by detection paradigm either require some sort of domain knowledge or supervision to associate data correctly into tracks.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Kalun Ho , Janis Keuper , Margret Keuper

Most modern multiple object tracking (MOT) systems follow the tracking-by-detection paradigm, consisting of a detector followed by a method for associating detections into tracks. There is a long history in tracking of combining motion and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Mohamed Chaabane , Peter Zhang , J. Ross Beveridge , Stephen O'Hara

The SLAM system based on static scene assumption will introduce huge estimation errors when moving objects appear in the field of view. This paper proposes a novel multi-object dynamic lidar odometry (MLO) based on semantic object detection…

Robotics · Computer Science 2023-03-03 Tingchen Ma , Yongsheng Ou

Tracking multiple tiny objects is highly challenging due to their weak appearance and limited features. Existing multi-object tracking algorithms generally focus on single-modality scenes, and overlook the complementary characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Qingyu Xu , Longguang Wang , Weidong Sheng , Yingqian Wang , Chao Xiao , Chao Ma , Wei An

Much of the literature on robotic perception focuses on the visual modality. Vision provides a global observation of a scene, making it broadly useful. However, in the domain of robotic manipulation, vision alone can sometimes prove…

Robotics · Computer Science 2019-03-11 Justin Lin , Roberto Calandra , Sergey Levine

Multiple-object tracking and segmentation (MOTS) is a novel computer vision task that aims to jointly perform multiple object tracking (MOT) and instance segmentation. In this work, we present PointTrack++, an effective on-line framework…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Zhenbo Xu , Wei Zhang , Xiao Tan , Wei Yang , Xiangbo Su , Yuchen Yuan , Hongwu Zhang , Shilei Wen , Errui Ding , Liusheng Huang

Accurately distinguishing each object is a fundamental goal of Multi-object tracking (MOT) algorithms. However, achieving this goal still remains challenging, primarily due to: (i) For crowded scenes with occluded objects, the high overlap…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jiapeng Wu , Yichen Liu

We propose a 3D multi-object tracking (MOT) solution using only 2D detections from monocular cameras, which automatically initiates/terminates tracks as well as resolves track appearance-reappearance and occlusions. Moreover, this approach…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Linh Van Ma , Tran Thien Dat Nguyen , Ba-Ngu Vo , Hyunsung Jang , Moongu Jeon

One of the recent trends in vision problems is to use natural language captions to describe the objects of interest. This approach can overcome some limitations of traditional methods that rely on bounding boxes or category annotations.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Pha Nguyen , Kha Gia Quach , Kris Kitani , Khoa Luu

This paper proposes a novel method for online Multi-Object Tracking (MOT) using Graph Convolutional Neural Network (GCNN) based feature extraction and end-to-end feature matching for object association. The Graph based approach incorporates…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Ioannis Papakis , Abhijit Sarkar , Anuj Karpatne

Existing online multiple object tracking (MOT) algorithms often consist of two subtasks, detection and re-identification (ReID). In order to enhance the inference speed and reduce the complexity, current methods commonly integrate these…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 En Yu , Zhuoling Li , Shoudong Han , Hongwei Wang

In many visual systems, visual tracking often bases on RGB image sequences, in which some targets are invalid in low-light conditions, and tracking performance is thus affected significantly. Introducing other modalities such as depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Chenglong Li , Tianhao Zhu , Lei Liu , Xiaonan Si , Zilin Fan , Sulan Zhai

Tracking by natural language specification aims to locate the referred target in a sequence based on the natural language description. Existing algorithms solve this issue in two steps, visual grounding and tracking, and accordingly deploy…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Li Zhou , Zikun Zhou , Kaige Mao , Zhenyu He

In currently available literature, no tracking-by-detection (TBD) paradigm-based tracking method has considered the localization confidence of detection boxes. In most TBD-based methods, it is considered that objects of low detection…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Ting Meng , Chunyun Fu , Mingguang Huang , Xiyang Wang , Jiawei He , Tao Huang , Wankai Shi