English
Related papers

Related papers: The Devil is in Temporal Token: High Quality Video…

200 papers

Referring Video Object Segmentation (RVOS) aims to segment specific objects in a video according to textual descriptions. We observe that recent RVOS approaches often place excessive emphasis on feature extraction and temporal modeling,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Ruixin Zhang , Jiaqing Fan , Yifan Liao , Qian Qiao , Fanzhang Li

Video captioning is a critical task in the field of multimodal machine learning, aiming to generate descriptive and coherent textual narratives for video content. While large vision-language models (LVLMs) have shown significant progress,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Ji-jun Park , Soo-joon Choi

Video large language models (LLMs) achieve strong video understanding by leveraging a large number of spatio-temporal tokens, but suffer from quadratic computational scaling with token count. To address this, we propose a training-free…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Jeongseok Hyun , Sukjun Hwang , Su Ho Han , Taeoh Kim , Inwoong Lee , Dongyoon Wee , Joon-Young Lee , Seon Joo Kim , Minho Shim

Video MLLMs face a persistent tension between spatial fidelity and temporal coverage: preserving fine-grained visual details requires many spatial tokens, while capturing short-lived events requires dense temporal sampling. We propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yigui Feng , Qinglin Wang , Yang Liu , Jie Liu

Video super-resolution (VSR) aims to restore a sequence of high-resolution (HR) frames from their low-resolution (LR) counterparts. Although some progress has been made, there are grand challenges to effectively utilize temporal dependency…

Image and Video Processing · Electrical Eng. & Systems 2022-04-21 Chengxu Liu , Huan Yang , Jianlong Fu , Xueming Qian

The rapid development of multimodal large-language models (MLLMs) has significantly expanded the scope of visual language reasoning, enabling unified systems to interpret and describe complex visual content. However, applying these models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Xinkui Zhao , Zuxin Wang , Yifan Zhang , Guanjie Cheng , Yueshen Xu , Shuiguang Deng , Chang Liu , Naibo Wang , Jianwei Yin

Streaming video understanding with large vision-language models (VLMs) requires a compact memory that can support future reasoning over an ever-growing visual history. A common solution is to compress the key-value (KV) cache, but existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ailar Mahdizadeh , Puria Azadi , Muchen Li , Xiangteng He , Leonid Sigal

In video Multimodal Large Language Models (video MLLMs), the visual encapsulation process plays a pivotal role in converting video contents into representative tokens for LLM input. While linear projectors are widely employed for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Jiahe Zhao , Rongkun Zheng , Yi Wang , Helin Wang , Hengshuang Zhao

Adapting Multimodal Large Language Models (MLLMs) for hour-long videos is bottlenecked by context limits. Dense visual streams saturate token budgets and exacerbate the lost-in-the-middle phenomenon. Existing heuristics, like sparse…

Streaming Video Large Language Models (VideoLLMs) have demonstrated impressive performance across various video understanding tasks, but they face significant challenges in real-time deployment due to the high computational cost of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yiyu Wang , Xuyang Liu , Xiyan Gui , Xinying Lin , Boxue Yang , Chenfei Liao , Tailai Chen , Linfeng Zhang

Token pruning is essential for enhancing the computational efficiency of vision-language models (VLMs), particularly for video-based tasks where temporal redundancy is prevalent. Prior approaches typically prune tokens either (1) within the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Jianrui Zhang , Yue Yang , Rohun Tripathi , Winson Han , Ranjay Krishna , Christopher Clark , Yong Jae Lee , Sangho Lee

Video-language models (VLMs) face rapid inference costs as visual token counts scale with video length. For example, 32 frames at $448{\times}448$ resolution already yield >8,000 visual tokens in Qwen3-VL, making LLM prefill the dominant…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Simin Huo , Ning LI

Streaming video understanding requires models to robustly encode, store, and retrieve information from a continuous video stream to support accurate video question answering (VQA). Existing state-of-the-art approaches rely on key-value…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Vatsal Agarwal , Saksham Suri , Matthew Gwilliam , Pulkit Kumar , Abhinav Shrivastava

Referring Video Object Segmentation (RVOS) aims to segment the object referred to by the query sentence in the video. Most existing methods require end-to-end training with dense mask annotations, which could be computation-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Ci-Siang Lin , Min-Hung Chen , I-Jieh Liu , Chien-Yi Wang , Sifei Liu , Yu-Chiang Frank Wang

Large Vision-Language Models (VLMs) have been extended to understand both images and videos. Visual token compression is leveraged to reduce the considerable token length of visual inputs. To meet the needs of different tasks, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Chenyu Yang , Xuan Dong , Xizhou Zhu , Weijie Su , Jiahao Wang , Hao Tian , Zhe Chen , Wenhai Wang , Lewei Lu , Jifeng Dai

Token-based video representation has emerged as a promising approach for enabling large language models (LLMs) to interpret video content. However, existing token reduction techniques, such as pruning and merging, often disrupt essential…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Haichao Zhang , Yun Fu

High temporal resolution is essential for capturing fine-grained details in video understanding. However, current video large language models (VLLMs) and benchmarks mostly rely on low-frame-rate sampling, such as uniform sampling or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Haichao Zhang , Wenhao Chai , Shwai He , Ang Li , Yun Fu

Multi-modal large language models (MLLMs) have achieved remarkable capabilities by integrating visual perception with language understanding, enabling applications such as image-grounded dialogue, visual question answering, and scientific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Zengjie Hu , Fupeng Sun , Jiantao Qiu , Yizhen Jiang , Guangxin He , Bohan Zeng , Conghui He , Binhang Yuan , Wentao Zhang

Vision-language models (VLMs) have demonstrated impressive multimodal comprehension capabilities and are being deployed in an increasing number of online video understanding applications. While recent efforts extensively explore advancing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-08 Shengyuan Ye , Bei Ouyang , Tianyi Qian , Liekang Zeng , Mu Yuan , Xiaowen Chu , Weijie Hong , Xu Chen

Reinforcement learning (RL) has shown strong potential for enhancing reasoning in multimodal large language models, yet existing video reasoning methods often rely on coarse sequence-level rewards or single-factor token selection,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Ziyue Wang , Sheng Jin , Zhongrong Zuo , Jiawei Wu , Han Qiu , Qi She , Hao Zhang , Xudong Jiang