English
Related papers

Related papers: Video Active Perception: Effective Inference-Time …

200 papers

Video Anomaly Detection (VAD) aims to localize abnormal events on the timeline of long-range surveillance videos. Anomaly-scoring-based methods have been prevailing for years but suffer from the high complexity of thresholding and low…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Hui Lv , Qianru Sun

Pre-trained vision-language models (VLMs) have enabled significant progress in open vocabulary computer vision tasks such as image classification, object detection and image segmentation. Some recent works have focused on extending VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Rohit Gupta , Mamshad Nayeem Rizve , Jayakrishnan Unnikrishnan , Ashish Tawari , Son Tran , Mubarak Shah , Benjamin Yao , Trishul Chilimbi

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

Large vision--language models (VLMs) are increasingly applied to long-video question answering, yet inference is often bottlenecked by the number of input frames and resulting visual tokens. Naive sparse sampling can miss decisive moments,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yuning Huang , Xiaoyu Ji , Joseph Huang , Yichi Zhang , Fengqing Zhu

Vehicle make and model recognition (VMMR) is an important task in intelligent transportation systems, but existing approaches struggle to adapt to newly released models. Contrastive Language-Image Pretraining (CLIP) provides strong…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Wei-Chia Chang , Yan-Ann Chen

Segmenting long-form videos into semantically coherent scenes is a fundamental task in large-scale video understanding. Existing encoder-based methods are limited by visual-centric biases, classify each shot in isolation without leveraging…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Nimrod Berman , Adam Botach , Emanuel Ben-Baruch , Shunit Haviv Hakimi , Asaf Gendler , Ilan Naiman , Erez Yosef , Igor Kviatkovsky

Multimodal Large Language Models (MLLMs) perform well in video understanding but degrade on long videos due to fixed-length context and weak long-term dependency modeling. Retrieval-Augmented Generation (RAG) can expand knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Zhucun Xue , Jiangning Zhang , Xurong Xie , Yuxuan Cai , Yong Liu , Xiangtai Li , Dacheng Tao

The ability to understand long videos is vital for embodied intelligent agents, because their effectiveness depends on how well they can accumulate, organize, and leverage long-horizon perceptual memories. Recently, multimodal LLMs have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Tatiana Zemskova , Solomon Andryushenko , Ilya Obrubov , Viktoriia Khoruzhaia , Ekaterina Eroshenko , Ekaterina Derevyanka , Dmitry Yudin

Deep learning algorithms have pushed the boundaries of computer vision research and have depicted commendable performance in a variety of applications. However, training a robust deep neural network necessitates a large amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Debanjan Goswami , Shayok Chakraborty

Despite recent advances in Video Large Language Models (VideoLLMs), effectively understanding long-form videos remains a significant challenge. Perceiving lengthy videos containing thousands of frames poses substantial computational burden.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Linli Yao , Haoning Wu , Kun Ouyang , Yuanxing Zhang , Caiming Xiong , Bei Chen , Xu Sun , Junnan Li

Video question answering (VQA) with vision-language models (VLMs) depends critically on which frames are selected from the input video, yet most systems rely on uniform or heuristic sampling that cannot be optimized for downstream answering…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Xiangyu Bai , Bishoy Galoaa , Sarah Ostadabbas

Video-Action Models (VAMs) have emerged as a promising framework for embodied intelligence, learning implicit world dynamics from raw video streams to produce temporally consistent action predictions. Although such models demonstrate strong…

Vision-Language-Action (VLA) models have rapidly advanced embodied intelligence, enabling robots to execute complex, instruction-driven tasks. However, as model capacity and visual context length grow, the inference cost of VLA systems…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jintao Cheng , Haozhe Wang , Weibin Li , Gang Wang , Yipu Zhang , Xiaoyu Tang , Jin Wu , Xieyuanli Chen , Yunhui Liu , Wei Zhang

Vision-Language Models (VLMs) often struggle with tasks that require fine-grained image understanding, such as scene-text recognition or document analysis, due to perception limitations and visual fragmentation. To address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Miguel Carvalho , Helder Dias , Bruno Martins

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Kohei Uehara , Nabarun Goswami , Hanqin Wang , Toshiaki Baba , Kohtaro Tanaka , Tomohiro Hashimoto , Kai Wang , Rei Ito , Takagi Naoya , Ryo Umagami , Yingyi Wen , Tanachai Anakewat , Tatsuya Harada

Video Large Language Models (Video-LLMs) have made remarkable progress in video understanding tasks. However, they are constrained by the maximum length of input tokens, making it impractical to input entire videos. Existing frame selection…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Sicheng Yu , Chengkai Jin , Huanyu Wang , Zhenghao Chen , Sheng Jin , Zhongrong Zuo , Xiaolei Xu , Zhenbang Sun , Bingni Zhang , Jiawei Wu , Hao Zhang , Qianru Sun

Long-form video understanding is essential for various applications such as video retrieval, summarizing, and question answering. Yet, traditional approaches demand substantial computing power and are often bottlenecked by GPU memory. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Saket Gurukar , Asim Kadav

Despite the impressive advancements of Large Vision-Language Models (LVLMs), existing approaches suffer from a fundamental bottleneck: inefficient visual-language integration. Current methods either disrupt the model's inherent structure or…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Tongtian Yue , Longteng Guo , Yepeng Tang , Zijia Zhao , Xinxin Zhu , Hua Huang , Jing Liu

Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a persistent challenge. Although recent agentic approaches incorporate tool use, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhiwei Ning , Xuanang Gao , Jiaxi Cao , Gengming Zhang , Shengnan Ma , Wenwen Tong , Hanming Deng , Jie Yang , Wei Liu

Building robust vision systems for high-stakes domains such as remote sensing requires stronger visual reasoning than what single-pass inference typically provides; yet, retraining large models is often computationally expensive and data…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian