English
Related papers

Related papers: TempRet: Temporal Enhancement and Two-Stage Rerank…

200 papers

Video large language models have achieved remarkable performance in tasks such as video question answering, however, their temporal understanding remains suboptimal. To address this limitation, we curate a dedicated instruction fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Yunxiao Wang , Meng Liu , Wenqi Liu , Xuemeng Song , Bin Wen , Fan Yang , Tingting Gao , Di Zhang , Guorui Zhou , Liqiang Nie

Composed image retrieval aims to find an image that best matches a given multi-modal user query consisting of a reference image and text pair. Existing methods commonly pre-compute image embeddings over the entire corpus and compare these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Zheyuan Liu , Weixuan Sun , Damien Teney , Stephen Gould

State-of-the-art text-video retrieval (TVR) methods typically utilize CLIP and cosine similarity for efficient retrieval. Meanwhile, cross attention methods, which employ a transformer decoder to compute attention between each text query…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Zuozhuo Dai , Fangtao Shao , Qingkun Su , Zilong Dong , Siyu Zhu

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve a target image given a reference image and a relative text, without relying on costly triplet annotations. Existing CLIP-based methods face two core challenges: (1) union-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuqi Xiao , Yingying Zhu

This technical report presents our solution, EgoAdapt (Egocentric Adaptation via Category, Calibration, and Consistency), to the CVPR 2026 HD-EPIC VQA challenge. HD-EPIC evaluates whether a vision-language model can reason over realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Guozhi Qiu , Weili Guan , Liqiang Nie

Partially Relevant Video Retrieval (PRVR) aims to retrieve the target video that is partially relevant to the text query. The primary challenge in PRVR arises from the semantic asymmetry between textual and visual modalities, as videos…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Junlong Ren , Gangjian Zhang , Yu Hu , Jian Shu , Hui Xiong , Hao Wang

Video moment retrieval (VMR) is to search for a visual temporal moment in an untrimmed raw video by a given text query description (sentence). Existing studies either start from collecting exhaustive frame-wise annotations on the temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Weitong Cai , Jiabo Huang , Shaogang Gong

In-context learning (ICL) enables generalization to new tasks with minimal labeled data. However, mainstream ICL approaches rely on a gridding strategy, which lacks the flexibility required for vision applications. We introduce Temporal, a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Assefa Wahd , Jacob Jaremko , Abhilash Hareendranathan

Given a natural language query, video moment retrieval aims to localize the described temporal moment in an untrimmed video. A major challenge of this task is its heavy dependence on labor-intensive annotations for training. Unlike existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Peijun Bao , Chenqi Kong , Zihao Shao , Boon Poh Ng , Meng Hwa Er , Alex C. Kot

The goal of Text-to-Image Person Retrieval (TIPR) is to retrieve specific person images according to the given textual descriptions. A primary challenge in this task is bridging the substantial representational gap between visual and…

Computation and Language · Computer Science 2025-01-20 Delong Liu , Haiwen Li , Zhicheng Zhao , Yuan Dong

The exponential growth of digital video content has posed critical challenges in moment-level video retrieval, where existing methodologies struggle to efficiently localize specific segments within an expansive video corpus. Current…

Multimodal adaptation equips large language models (LLMs) with perceptual capabilities, but often weakens the reasoning ability inherited from language-only pretraining. This trade-off is especially pronounced in video-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zihang Fu , Haonan Wang , Jian Kang , Kenji Kawaguchi , Jiaying Wu

tmospheric turbulence presents a significant challenge in long-range imaging. Current restoration algorithms often struggle with temporal inconsistency, as well as limited generalization ability across varying turbulence levels and scene…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Haoming Cai , Jingxi Chen , Brandon Y. Feng , Weiyun Jiang , Mingyang Xie , Kevin Zhang , Ashok Veeraraghavan , Christopher Metzler

In recent years, large-scale pre-trained multimodal models (LMMs) generally emerge to integrate the vision and language modalities, achieving considerable success in multimodal tasks, such as text-image classification. The growing size of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Xinyao Yu , Hao Sun , Zeyu Ling , Ziwei Niu , Zhenjia Bai , Rui Qin , Yen-Wei Chen , Lanfen Lin

State-of-the-art video-text retrieval (VTR) methods typically involve fully fine-tuning a pre-trained model (e.g. CLIP) on specific datasets. However, this can result in significant storage costs in practical applications as a separate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Xiaojie Jin , Bowen Zhang , Weibo Gong , Kai Xu , XueQing Deng , Peng Wang , Zhao Zhang , Xiaohui Shen , Jiashi Feng

Implicit Neural Representations (INRs) have recently demonstrated impressive performance for video compression. However, since a separate INR must be overfit for each video, scaling to high-resolution videos while maintaining encoding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Namitha Padmanabhan , Matthew Gwilliam , Abhinav Shrivastava

Recently, prompt learning has demonstrated remarkable success in adapting pre-trained Vision-Language Models (VLMs) to various downstream tasks such as image classification. However, its application to the downstream Image-Text Retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yifan Wang , Tao Wang , Chenwei Tang , Caiyang Yu , Zhengqing Zang , Mengmi Zhang , Shudong Huang , Jiancheng Lv

Composed Image Retrieval (CIR) is the task of retrieving a target image from a gallery using a composed query consisting of a reference image and a modification text. Among various CIR approaches, training-free zero-shot methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Seong-Whan Lee

As a widely studied task, video restoration aims to enhance the quality of the videos with multiple potential degradations, such as noises, blurs and compression artifacts. Among video restorations, compressed video quality enhancement and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Meisong Zheng , Qunliang Xing , Minglang Qiao , Mai Xu , Lai Jiang , Huaida Liu , Ying Chen

In recent years, the explosion of web videos makes text-video retrieval increasingly essential and popular for video filtering, recommendation, and search. Text-video retrieval aims to rank relevant text/video higher than irrelevant ones.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Chen Jiang , Hong Liu , Xuzheng Yu , Qing Wang , Yuan Cheng , Jia Xu , Zhongyi Liu , Qingpei Guo , Wei Chu , Ming Yang , Yuan Qi