English
Related papers

Related papers: RAGTrack: Language-aware RGBT Tracking with Retrie…

200 papers

Vision language models (VLMs) have experienced rapid advancements through the integration of large language models (LLMs) with image-text pairs, yet they struggle with detailed regional visual understanding due to limited spatial awareness…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Qiushan Guo , Shalini De Mello , Hongxu Yin , Wonmin Byeon , Ka Chun Cheung , Yizhou Yu , Ping Luo , Sifei Liu

To address this challenge, we introduce CattleFace-RGBT, a RGB-T Cattle Facial Landmark dataset consisting of 2,300 RGB-T image pairs, a total of 4,600 images. Creating a landmark dataset is time-consuming, but AI-assisted annotation can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Ethan Coffman , Reagan Clark , Nhat-Tan Bui , Trong Thang Pham , Beth Kegley , Jeremy G. Powell , Jiangchao Zhao , Ngan Le

Retrieval-Augmented Generation (RAG) compensates for the static knowledge limitations of Large Language Models (LLMs) by integrating external knowledge, producing responses with enhanced factual correctness and query-specific…

Computation and Language · Computer Science 2025-05-21 Ruobing Yao , Yifei Zhang , Shuang Song , Neng Gao , Chenyang Tu

Retrieval-augmented generation (RAG) has emerged as a pivotal method for expanding the knowledge of large language models. To handle complex queries more effectively, researchers developed Adaptive-RAG (A-RAG) to enhance the generated…

Artificial Intelligence · Computer Science 2025-05-27 Jie Ou , Jinyu Guo , Shuaihong Jiang , Zhaokun Wang , Libo Qin , Shunyu Yao , Wenhong Tian

Refining visual representations by eliminating their internal feature-level redundancy is crucial for simultaneously optimizing the performance and computational cost of models in visual tracking. To enhance their performance, many…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Weijing Wu , Qihua Liang , Bineng Zhong , Haiying Xia , Zhiyi Mo , Shuxiang Song

Integrating Large Language Models (LLMs) in Intelligent Tutoring Systems (ITS) presents transformative opportunities for personalized education. However, current implementations face two critical challenges: maintaining factual accuracy and…

Computation and Language · Computer Science 2025-02-13 Chenxi Dong , Yimin Yuan , Kan Chen , Shupei Cheng , Chujie Wen

The recent Segment Anything Model (SAM) demonstrates strong instance segmentation performance across various downstream tasks. However, SAM is trained solely on RGB data, limiting its direct applicability to RGB-thermal (RGB-T) semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dong Xing , Xianxun Zhu , Wei Zhou , Qika Lin , Hang Yang , Yuqing Wang

Reliable semantic segmentation of open environments is essential for intelligent systems, yet significant problems remain: 1) Existing RGB-T semantic segmentation models mainly rely on low-level visual features and lack high-level textual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Meng Yu , Te Cui , Qitong Chu , Wenjie Song , Yi Yang , Yufeng Yue

Multi-modal object tracking integrates auxiliary modalities such as depth, thermal infrared, event flow, and language to provide additional information beyond RGB images, showing great potential in improving tracking stabilization in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiyu Xuan , Zechao Li , Jinhui Tang

Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement…

Machine Learning · Computer Science 2025-10-15 Jeongyeon Hwang , Junyoung Park , Hyejin Park , Dongwoo Kim , Sangdon Park , Jungseul Ok

Accurate multi-modal document retrieval is crucial for Retrieval-Augmented Generation (RAG), yet existing benchmarks do not fully capture real-world challenges with their current design. We introduce REAL-MM-RAG, an automatically generated…

Information Retrieval · Computer Science 2025-02-19 Navve Wasserman , Roi Pony , Oshri Naparstek , Adi Raz Goldfarb , Eli Schwartz , Udi Barzelay , Leonid Karlinsky

A main challenge of Visual-Language Tracking (VLT) is the misalignment between visual inputs and language descriptions caused by target movement. Previous trackers have explored many effective feature modification methods to preserve more…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yihao Zhen , Qiang Wang , Yu Qiao , Liangqiong Qu , Huijie Fan

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by using external knowledge, but it struggles with precise entity information retrieval. In this paper, we proposed MES-RAG framework, which enhances entity-specific…

Computation and Language · Computer Science 2025-03-19 Pingyu Wu , Daiheng Gao , Jing Tang , Huimin Chen , Wenbo Zhou , Weiming Zhang , Nenghai Yu

Remote Sensing Visual Grounding (RSVG) aims to localize target objects in large-scale aerial imagery based on natural language descriptions. Owing to the vast spatial scale and high semantic ambiguity of remote sensing scenes, these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shiqi Huang , Shuting He , Bihan Wen

Multi-modal Retrieval-Augmented Generation (MMRAG) has emerged as a powerful paradigm for enhancing Multimodal Large Language Models in knowledge-intensive question answering by integrating external visual, textual, and structural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiang Fang , Wanlong Fang , Changshuo Wang

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating external knowledge, where the LLM's ability to generate responses based on the combination of a given query and retrieved documents is crucial.…

Computation and Language · Computer Science 2025-08-01 Zhehao Tan , Yihan Jiao , Dan Yang , Lei Liu , Jie Feng , Duolin Sun , Yue Shen , Jian Wang , Peng Wei , Jinjie Gu

Existing open-vocabulary detectors focus on RGB images and fail to generalize to thermal imagery, where low texture and emissivity variations challenge RGB-based semantics. We present Thermal-Det, the first large language model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yasiru Ranasinghe , Elim Schenck , Florence Yellin , Shuowen Hu , Christopher Funk , Vishal M. Patel

RGB-Thermal (RGB-T) semantic segmentation has shown great potential in handling low-light conditions where RGB-based segmentation is hindered by poor RGB imaging quality. The key to RGB-T semantic segmentation is to effectively leverage the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zikun Zhou , Shukun Wu , Guoqing Zhu , Hongpeng Wang , Zhenyu He

RGB-Thermal (RGB-T) pedestrian detection aims to locate the pedestrians in RGB-T image pairs to exploit the complementation between the two modalities for improving detection robustness in extreme conditions. Most existing algorithms assume…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Chao Tian , Zikun Zhou , Yuqing Huang , Gaojun Li , Zhenyu He

The consistency between the semantic information provided by the multi-modal reference and the tracked object is crucial for visual-language (VL) tracking. However, existing VL tracking frameworks rely on static multi-modal references to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaohai Li , Bineng Zhong , Qihua Liang , Zhiyi Mo , Jian Nong , Shuxiang Song