English
Related papers

Related papers: Temporal-Enhanced Multimodal Transformer for Refer…

200 papers

The majority of contemporary object-tracking approaches do not model interactions between objects. This contrasts with the fact that objects' paths are not independent: a cyclist might abruptly deviate from a previously planned trajectory…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Fabian B. Fuchs , Adam R. Kosiorek , Li Sun , Oiwi Parker Jones , Ingmar Posner

The complex world around us is inherently multimodal and sequential (continuous). Information is scattered across different modalities and requires multiple continuous sensors to be captured. As machine learning leaps towards better…

Machine Learning · Computer Science 2019-11-25 Amir Zadeh , Chengfeng Mao , Kelly Shi , Yiwei Zhang , Paul Pu Liang , Soujanya Poria , Louis-Philippe Morency

Generic Object Tracking (GOT) is the problem of tracking target objects, specified by bounding boxes in the first frame of a video. While the task has received much attention in the last decades, researchers have almost exclusively focused…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Christoph Mayer , Martin Danelljan , Ming-Hsuan Yang , Vittorio Ferrari , Luc Van Gool , Alina Kuznetsova

Multiple object tracking (MOT) is the task containing detection and association. Plenty of trackers have achieved competitive performance. Unfortunately, for the lack of informative exchange on these subtasks, they are often biased toward…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Bin Sun

The capability to jointly process multi-modal information is becoming an essential task. However, the limited number of paired multi-modal data and the large computational requirements in multi-modal learning hinder the development. We…

Computation and Language · Computer Science 2025-06-09 Minsu Kim , Jee-weon Jung , Hyeongseop Rha , Soumi Maiti , Siddhant Arora , Xuankai Chang , Shinji Watanabe , Yong Man Ro

Referring Video Object Segmentation (RVOS) aims to segment specific objects in a video according to textual descriptions. We observe that recent RVOS approaches often place excessive emphasis on feature extraction and temporal modeling,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Ruixin Zhang , Jiaqing Fan , Yifan Liao , Qian Qiao , Fanzhang Li

Object tracking is divided into single-object tracking (SOT) and multi-object tracking (MOT). MOT aims to maintain the identities of multiple objects across a series of continuous video sequences. In recent years, MOT has made rapid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yukuan Zhang , Yunhua Jia , Housheng Xie , Mengzhen Li , Limin Zhao , Yang Yang , Shan Zhao

Aiming to address the fast multi-object tracking for dense small object in the cluster background, we review track orientated multi-hypothesis tracking(TOMHT) with consideration of batch optimization. Employing autocorrelation based motion…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Longtao Chen , Jing Lou , Wei Zhu , Qingyuan Xia , Mingwu Ren

With the advancement of video analysis technology, the multi-object tracking (MOT) problem in complex scenes involving pedestrians is gaining increasing importance. This challenge primarily involves two key tasks: pedestrian detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jiayi Chen , Chunhua Deng

Referring video object segmentation (RVOS) has recently generated great popularity in computer vision due to its widespread applications. Existing RVOS setting contains elaborately trimmed videos, with text-referred objects always appearing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mingqi Gao , Jinyu Yang , Jingnan Luo , Xiantong Zhen , Jungong Han , Giovanni Montana , Feng Zheng

Learning a data-driven spatio-temporal semantic representation of the objects is the key to coherent and consistent labelling in video. This paper proposes to achieve semantic video object segmentation by learning a data-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Tinghuai Wang

The ability to recognize, localize and track dynamic objects in a scene is fundamental to many real-world applications, such as self-driving and robotic systems. Yet, traditional multiple object tracking (MOT) benchmarks rely only on a few…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Siyuan Li , Tobias Fischer , Lei Ke , Henghui Ding , Martin Danelljan , Fisher Yu

Referring video object segmentation aims to predict foreground labels for objects referred by natural language expressions in videos. Previous methods either depend on 3D ConvNets or incorporate additional 2D ConvNets as encoders to extract…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Zihan Ding , Tianrui Hui , Junshi Huang , Xiaoming Wei , Jizhong Han , Si Liu

Deep-learning models have enabled performance leaps in analysis of high-dimensional functional MRI (fMRI) data. Yet, many previous methods are suboptimally sensitive for contextual representations across diverse time scales. Here, we…

Signal Processing · Electrical Eng. & Systems 2023-02-21 Hasan Atakan Bedel , Irmak Şıvgın , Onat Dalmaz , Salman Ul Hassan Dar , Tolga Çukur

What constitutes an object? This has been a long-standing question in computer vision. Towards this goal, numerous learning-free and learning-based approaches have been developed to score objectness. However, they generally do not scale…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Muhammad Maaz , Hanoona Rasheed , Salman Khan , Fahad Shahbaz Khan , Rao Muhammad Anwer , Ming-Hsuan Yang

Many RGBT tracking researches primarily focus on modal fusion design, while overlooking the effective handling of target appearance changes. While some approaches have introduced historical frames or fuse and replace initial templates to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dengdi Sun , Yajie Pan , Andong Lu , Chenglong Li , Bin Luo

Cross-lingual cross-modal retrieval has garnered increasing attention recently, which aims to achieve the alignment between vision and target language (V-T) without using any annotated V-T data pairs. Current methods employ machine…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yabing Wang , Fan Wang , Jianfeng Dong , Hao Luo

Accurately distinguishing each object is a fundamental goal of Multi-object tracking (MOT) algorithms. However, achieving this goal still remains challenging, primarily due to: (i) For crowded scenes with occluded objects, the high overlap…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jiapeng Wu , Yichen Liu

Tracking transforming objects holds significant importance in various fields due to the dynamic nature of many real-world scenarios. By enabling systems accurately represent transforming objects over time, tracking transforming objects…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 You Wu , Yuelong Wang , Yaxin Liao , Fuliang Wu , Hengzhou Ye , Shuiwang Li

Recent advances in deep learning have brought significant progress in visual grounding tasks such as language-guided video object segmentation. However, collecting large datasets for these tasks is expensive in terms of annotation time,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Ioannis Kazakos , Carles Ventura , Miriam Bellver , Carina Silberer , Xavier Giro-i-Nieto