English
Related papers

Related papers: Robust Tracking via Mamba-based Context-aware Toke…

200 papers

Eye-tracking is a vital technology for human-computer interaction, especially in wearable devices such as AR, VR, and XR. The realization of high-speed and high-precision eye-tracking using frame-based image sensors is constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Hongwei Ren , Xiaopeng Lin , Hongxiang Huang , Yue Zhou , Bojun Cheng

Cross-modal alignment is crucial for multimodal representation fusion due to the inherent heterogeneity between modalities. While Transformer-based methods have shown promising results in modeling inter-modal relationships, their quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Multimodal models often experience a significant performance drop when one or more modalities are missing during inference. To address this challenge, we propose a simple yet effective approach that enhances robustness to missing modalities…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Md Kaykobad Reza , Ameya Patil , Mashhour Solh , M. Salman Asif

The rapid development of large language and vision models (LLVMs) has been driven by advances in visual instruction tuning. Recently, open-source LLVMs have curated high-quality visual instruction tuning datasets and utilized additional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Byung-Kwan Lee , Chae Won Kim , Beomchan Park , Yong Man Ro

Time-series forecasting has seen significant advancements with the introduction of token prediction mechanisms such as multi-head attention. However, these methods often struggle to achieve the same performance as in language modeling,…

Machine Learning · Computer Science 2024-12-03 Panayiotis Christou , Shichu Chen , Xupeng Chen , Parijat Dube

Visual object tracking acts as a pivotal component in various emerging video applications. Despite the numerous developments in visual tracking, existing deep trackers are still likely to fail when tracking against objects with dramatic…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Qiuhong Shen , Xin Li , Fanyang Meng , Yongsheng Liang

State-of-the-art transformer-based large multimodal models (LMMs) struggle to handle hour-long video inputs due to the quadratic complexity of the causal self-attention operations, leading to high computational costs during training and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Weiming Ren , Wentao Ma , Huan Yang , Cong Wei , Ge Zhang , Wenhu Chen

RGB-Thermal (RGBT) tracking aims to exploit visible and thermal infrared modalities for robust all-weather object tracking. However, existing RGBT trackers struggle to resolve modality discrepancies, which poses great challenges for robust…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Hao Li , Yuhao Wang , Xiantao Hu , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu

Multicategory remote object counting is a fundamental task in computer vision, aimed at accurately estimating the number of objects of various categories in remote images. Existing methods rely on CNNs and Transformers, but CNNs struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Peng Liu , Sen Lei , Heng-Chao Li

Boosting performance of the offline trained siamese trackers is getting harder nowadays since the fixed information of the template cropped from the first frame has been almost thoroughly mined, but they are poorly capable of resisting…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Zhihong Fu , Qingjie Liu , Zehua Fu , Yunhong Wang

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

CrackMamba, a Mamba-based model, is designed for efficient and accurate crack segmentation for monitoring the structural health of infrastructure. Traditional Convolutional Neural Network (CNN) models struggle with limited receptive fields,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xin Zuo , Yu Sheng , Jifeng Shen , Yongwei Shan

Autonomous driving holds great promise in addressing traffic safety concerns by leveraging artificial intelligence and sensor technology. Multi-Object Tracking plays a critical role in ensuring safer and more efficient navigation through…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Lei Cheng , Arindam Sengupta , Siyang Cao

Video understanding is a complex challenge that requires effective modeling of spatial-temporal dynamics. With the success of image foundation models (IFMs) in image understanding, recent approaches have explored parameter-efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yuhuan Yang , Chaofan Ma , Zhenjie Mao , Jiangchao Yao , Ya Zhang , Yanfeng Wang

In this paper, we propose a novel on-line visual tracking framework based on the Siamese matching network and meta-learner network, which run at real-time speeds. Conventional deep convolutional feature-based discriminative visual tracking…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Janghoon Choi , Junseok Kwon , Kyoung Mu Lee

Time series foundation models have demonstrated strong performance in zero-shot learning, making them well-suited for predicting rapidly evolving patterns in real-world applications where relevant training data are scarce. However, most of…

Machine Learning · Computer Science 2024-11-06 Haoyu Ma , Yushu Chen , Wenlai Zhao , Jinzhe Yang , Yingsheng Ji , Xinghua Xu , Xiaozhu Liu , Hao Jing , Shengzhuo Liu , Guangwen Yang

Event-based eye tracking has shown great promise with the high temporal resolution and low redundancy provided by the event camera. However, the diversity and abruptness of eye movement patterns, including blinking, fixating, saccades, and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Zhong Wang , Zengyu Wan , Han Han , Bohao Liao , Yuliang Wu , Wei Zhai , Yang Cao , Zheng-jun Zha

Current works focus on addressing the remote sensing change detection task using bi-temporal images. Although good performance can be achieved, however, seldom of they consider the motion cues which may also be vital. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Xixi Wang , Zitian Wang , Jingtao Jiang , Lan Chen , Xiao Wang , Bo Jiang

Existing RGB-Event detection methods process the low-information regions of both modalities (background in images and non-event regions in event data) uniformly during feature extraction and fusion, resulting in high computational costs and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Nan Yang , Yang Wang , Zhanwen Liu , Yuchao Dai , Yang Liu , Xiangmo Zhao

Multi-task dense scene understanding, which learns a model for multiple dense prediction tasks, has a wide range of application scenarios. Modeling long-range dependency and enhancing cross-task interactions are crucial to multi-task dense…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Baijiong Lin , Weisen Jiang , Pengguang Chen , Yu Zhang , Shu Liu , Ying-Cong Chen