English
Related papers

Related papers: RAGTrack: Language-aware RGBT Tracking with Retrie…

200 papers

RGB-T tracking, a vital downstream task of object tracking, has made remarkable progress in recent years. Yet, it remains hindered by two major challenges: 1) the trade-off between performance and efficiency; 2) the scarcity of training…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Qiming Wang , Yongqiang Bai , Hongxing Song

Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Cheng Tan , Jingxuan Wei , Linzhuang Sun , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Due to the limited availability of paired multi-modal data, multi-modal trackers are typically built by adopting pre-trained RGB models with parameter-efficient fine-tuning modules. However, these fine-tuning methods overlook advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 He Wang , Tianyang Xu , Zhangyong Tang , Xiao-Jun Wu , Josef Kittler

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for enhancing the capabilities of large language models. However, existing RAG evaluation predominantly focuses on text retrieval and relies on opaque, end-to-end…

Information Retrieval · Computer Science 2025-05-19 Chuan Xu , Qiaosheng Chen , Yutong Feng , Gong Cheng

This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance semantic understanding and knowledge scheduling efficiency…

Computation and Language · Computer Science 2025-04-29 Jacky He , Guiran Liu , Binrong Zhu , Hanlu Zhang , Hongye Zheng , Xiaokai Wang

In this study, we propose a novel RGB-T tracking framework by jointly modeling both appearance and motion cues. First, to obtain a robust appearance model, we develop a novel late fusion method to infer the fusion weight maps of both RGB…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Pengyu Zhang , Jie Zhao , Dong Wang , Huchuan Lu , Xiaoyun Yang

Future wireless networks aim to deliver high data rates and lower power consumption while ensuring seamless connectivity, necessitating robust optimization. Large language models (LLMs) have been deployed for generalized optimization…

Networking and Internet Architecture · Computer Science 2025-03-12 Muhammad Ahmed Mohsin , Ahsan Bilal , Sagnik Bhattacharya , John M. Cioffi

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

With growing real-world demands, efficient tracking has received increasing attention. However, most existing methods are limited to RGB inputs and struggle in multi-modal scenarios. Moreover, current multi-modal tracking approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Ben Kang , Jie Zhao , Xin Chen , Wanting Geng , Bin Zhang , Lu Zhang , Dong Wang , Huchuan Lu

Many state-of-the-art RGB-T trackers have achieved remarkable results through modality fusion. However, these trackers often either overlook temporal information or fail to fully utilize it, resulting in an ineffective balance between…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Zhirong Zeng , Xiaotao Liu , Meng Sun , Hongyu Wang , Jing Liu

Multi-modal Retrieval-Augmented Generation (RAG) has become a critical method for empowering LLMs by leveraging candidate visual documents. However, current methods consider the entire document as the basic retrieval unit, introducing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yinglu Li , Zhiying Lu , Zhihang Liu , Yiwei Sun , Chuanbin Liu , Hongtao Xie

RGB-Thermal (RGB-T) object detection utilizes thermal infrared (TIR) images to complement RGB data, improving robustness in challenging conditions. Traditional RGB-T detectors assume balanced training data, where both modalities contribute…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Chao Tian , Chao Yang , Guoqing Zhu , Qiang Wang , Zhenyu He

Developing robust multi-modal feature representations is crucial for enhancing object tracking performance. In pursuit of this objective, a novel X Modality Assisting Network (X-Net) is introduced, which explores the impact of the fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Zhaisheng Ding , Haiyan Li , Ruichao Hou , Yanyu Liu , Shidong Xie

Tracking by natural language specification (TNL) aims to consistently localize a target in a video sequence given a linguistic description in the initial frame. Existing methodologies perform language-based and template-based matching for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Yanyan Shao , Shuting He , Qi Ye , Yuchao Feng , Wenhan Luo , Jiming Chen

With the popularity of multi-modal sensors, visible-thermal (RGB-T) object tracking is to achieve robust performance and wider application scenarios with the guidance of objects' temperature information. However, the lack of paired training…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Pengyu Zhang , Jie Zhao , Dong Wang , Huchuan Lu , Xiang Ruan

Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models. RAG…

Computation and Language · Computer Science 2025-03-18 Mingyue Cheng , Yucong Luo , Jie Ouyang , Qi Liu , Huijie Liu , Li Li , Shuo Yu , Bohou Zhang , Jiawei Cao , Jie Ma , Daoyu Wang , Enhong Chen

Retrieval-augmented generation (RAG) has evolved into a family of paradigms with distinct performance profiles and resource demands, turning paradigm selection into a multi-criteria, context-dependent decision problem. Nevertheless,…

Information Retrieval · Computer Science 2026-04-07 Ziqi Wang , Xi Zhu , Shuhang Lin , Haochen Xue , Minghao Guo , Yongfeng Zhang

The advantage of RGB-Thermal (RGB-T) detection lies in its ability to perform modality fusion and integrate cross-modality complementary information, enabling robust detection under diverse illumination and weather conditions. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Chao Tian , Zikun Zhou , Chao Yang , Guoqing Zhu , Fu'an Zhong , Zhenyu He

Multi-modal feature fusion as a core investigative component of RGBT tracking emerges numerous fusion studies in recent years. However, existing RGBT tracking methods widely adopt fixed fusion structures to integrate multi-modal feature,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Andong Lu , Wanyu Wang , Chenglong Li , Jin Tang , Bin Luo

Visible-modal object tracking gives rise to a series of downstream multi-modal tracking tributaries. To inherit the powerful representations of the foundation model, a natural modus operandi for multi-modal tracking is full fine-tuning on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jiawen Zhu , Simiao Lai , Xin Chen , Dong Wang , Huchuan Lu