English
Related papers

Related papers: RAGTrack: Language-aware RGBT Tracking with Retrie…

200 papers

Crowd counting is a fundamental yet challenging task, which desires rich information to generate pixel-wise crowd density maps. However, most previous methods only used the limited information of RGB images and cannot well discover…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Lingbo Liu , Jiaqi Chen , Hefeng Wu , Guanbin Li , Chenglong Li , Liang Lin

Vision-language tracking has gained increasing attention in many scenarios. This task simultaneously deals with visual and linguistic information to localize objects in videos. Despite its growing utility, the development of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xingyu Luo , Yidong Cai , Jie Liu , Jie Tang , Gangshan Wu , Limin Wang

Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning power of large language models (LLMs) with external retrieval to enable domain-grounded responses. Effectively adapting RAG systems to domain-specific…

Computation and Language · Computer Science 2026-04-14 Chris Xing Tian , Weihao Xie , Zhen Chen , Zhengyuan Yi , Hui Liu , Haoliang Li , Shiqi Wang , Siwei Ma

The ability to scene understanding in adverse visual conditions, e.g., nighttime, has sparked active research for RGB-Thermal (RGB-T) semantic segmentation. However, it is essentially hampered by two critical problems: 1) the day-night gap…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yexin Liu , Weiming Zhang , Guoyang Zhao , Jinjing Zhu , Athanasios Vasilakos , Lin Wang

Retrieval Augmented Generation (RAG), a paradigm that integrates external contextual information with large language models (LLMs) to enhance factual accuracy and relevance, has emerged as a pivotal area in generative AI. The LLMs used in…

Computation and Language · Computer Science 2024-09-17 Xuan-Phi Nguyen , Shrey Pandit , Senthil Purushwalkam , Austin Xu , Hailin Chen , Yifei Ming , Zixuan Ke , Silvio Savarese , Caiming Xong , Shafiq Joty

Retrieval-augmented code generation utilizes Large Language Models as the generator and significantly expands their code generation capabilities by providing relevant code, documentation, and more via the retriever. The current approach…

Software Engineering · Computer Science 2024-09-25 Xinyu Gao , Yun Xiong , Deze Wang , Zhenhan Guan , Zejian Shi , Haofen Wang , Shanshan Li

Recent progress in VLMs has demonstrated impressive capabilities across a variety of tasks in the natural image domain. Motivated by these advancements, the remote sensing community has begun to adopt VLMs for remote sensing vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Congcong Wen , Yiting Lin , Xiaokang Qu , Nan Li , Yong Liao , Xiang Li , Hui Lin

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge to generate a response within a context with improved accuracy and reduced hallucinations. However, multi-modal RAG systems face…

Machine Learning · Computer Science 2025-01-09 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Object modeling has become a core part of recent tracking frameworks. Current popular tackers use Transformer attention to extract the template feature separately or interactively with the search region. However, separate template learning…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Yidong Cai , Jie Liu , Jie Tang , Gangshan Wu

Retrieval-augmented generation (RAG) combines knowledge from domain-specific sources into large language models to ground answer generation. Current RAG systems lack customizable visibility on the context documents and the model's…

Computation and Language · Computer Science 2024-11-05 Tevin Wang , Jingyuan He , Chenyan Xiong

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

Computation and Language · Computer Science 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang

Retrieval-Augmented Generation (RAG) is a critical paradigm for building reliable, knowledge-intensive Large Language Model (LLM) applications. However, the multi-stage pipeline (retrieve, generate) and unique workload characteristics…

Machine Learning · Computer Science 2025-11-18 Zhengchao Wang , Yitao Hu , Jianing Ye , Zhuxuan Chang , Jiazheng Yu , Youpeng Deng , Keqiu Li

Retrieval-augmented generation (RAG) improves large language models (LLMs) by using external knowledge to guide response generation, reducing hallucinations. However, RAG, particularly multi-modal RAG, can introduce new hallucination…

Machine Learning · Computer Science 2025-01-08 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to locate an arbitrary number of target objects and maintain their identities referred by a language expression in a video. This intricate task involves the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Changcheng Xiao , Qiong Cao , Yujie Zhong , Xiang Zhang , Tao Wang , Canqun Yang , Long Lan

Multi-object tracking (MOT) has traditionally focused on estimating trajectories of all objects in a video, without selectively reasoning about user-specified targets under semantic instructions. In this work, we introduce a query-driven…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Tajamul Ashraf , Tavaheed Tariq , Sonia Yadav , Abrar Ul Riyaz , Wasif Tak , Moloud Abdar , Janibul Bashir

For semantic segmentation in urban scene understanding, RGB cameras alone often fail to capture a clear holistic topology in challenging lighting conditions. Thermal signal is an informative additional channel that can bring to light the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Siqi Fan , Zhe Wang , Yan Wang , Jingjing Liu

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

Large Language Models (LLMs) are capable of natural language understanding and generation. But they face challenges such as hallucination and outdated knowledge. Fine-tuning is one possible solution, but it is resource-intensive and must be…

Computation and Language · Computer Science 2025-07-01 Shadman Sobhan , Mohammad Ariful Haque

Retrieval-augmented generation (RAG) has proven effective in integrating knowledge into large language models (LLMs). However, conventional RAGs struggle to capture complex relationships between pieces of knowledge, limiting their…

Information Retrieval · Computer Science 2025-12-12 Linhao Luo , Zicheng Zhao , Gholamreza Haffari , Dinh Phung , Chen Gong , Shirui Pan