English
Related papers

Related papers: MA-LMM: Memory-Augmented Large Multimodal Model fo…

200 papers

Video sequences offer valuable temporal information, but existing large multimodal models (LMMs) fall short in understanding extremely long videos. Many works address this by reducing the number of visual tokens using visual resamplers.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Peiyuan Zhang , Kaichen Zhang , Bo Li , Guangtao Zeng , Jingkang Yang , Yuanhan Zhang , Ziyue Wang , Haoran Tan , Chunyuan Li , Ziwei Liu

Long video understanding is still challenging for recent Large Video-Language Models (LVLMs) due to the conflict between long-form temporal understanding and detailed spatial perception. LVLMs with a uniform frame sampling mechanism, which…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Shenghao Fu , Qize Yang , Yuan-Ming Li , Xihan Wei , Xiaohua Xie , Wei-Shi Zheng

Long video understanding is a complex task that requires both spatial detail and temporal awareness. While Vision-Language Models (VLMs) obtain frame-level understanding capabilities through multi-frame input, they suffer from information…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Ziyi Wang , Haoran Wu , Yiming Rong , Deyang Jiang , Yixin Zhang , Yunlong Zhao , Shuang Xu , Bo XU

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

Large Language Models (LLMs), with remarkable conversational capability, have emerged as AI assistants that can handle both visual and textual modalities. However, their effectiveness in joint video and language understanding has not been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruipu Luo , Ziwang Zhao , Min Yang , Zheming Yang , Minghui Qiu , Tao Wang , Zhongyu Wei , Yanhao Wang , Cen Chen

Rapid advancements have been made in extending Large Language Models (LLMs) to Large Multi-modal Models (LMMs). However, extending input modality of LLMs to video data remains a challenging endeavor, especially for long videos. Due to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jiajun Liu , Yibing Wang , Hanghang Ma , Xiaoping Wu , Xiaoqi Ma , Xiaoming Wei , Jianbin Jiao , Enhua Wu , Jie Hu

Multimodal Large Language Models (MLLMs) have achieved remarkable performance by aligning pretrained visual representations with the linguistic knowledge embedded in Large Language Models (LLMs). However, existing approaches typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Ying Liu , Yudong Han , Kean Shi , Liyuan Pan

Recent advancements in video understanding within visual large language models (VLLMs) have led to notable progress. However, the complexity of video data and contextual processing limitations still hinder long-video comprehension. A common…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Yanan Guo , Wenhui Dong , Jun Song , Shiding Zhu , Xuan Zhang , Hanqing Yang , Yingbo Wang , Yang Du , Xianing Chen , Bo Zheng

Recent studies have shown that agent-based systems leveraging large language models (LLMs) for key information retrieval and integration have emerged as a promising approach for long video understanding. However, these systems face two…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jialong Zuo , Yongtai Deng , Lingdong Kong , Jingkang Yang , Rui Jin , Yiwei Zhang , Nong Sang , Liang Pan , Ziwei Liu , Changxin Gao

Video Large Language Models (Video-LLMs) have made remarkable progress in video understanding tasks. However, they are constrained by the maximum length of input tokens, making it impractical to input entire videos. Existing frame selection…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Sicheng Yu , Chengkai Jin , Huanyu Wang , Zhenghao Chen , Sheng Jin , Zhongrong Zuo , Xiaolei Xu , Zhenbang Sun , Bingni Zhang , Jiawei Wu , Hao Zhang , Qianru Sun

Recent advances in video-based multimodal large language models (Video-LLMs) have significantly improved video understanding by processing videos as sequences of image frames. However, many existing methods treat frames independently in the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jindong Jiang , Xiuyu Li , Zhijian Liu , Muyang Li , Guo Chen , Zhiqi Li , De-An Huang , Guilin Liu , Zhiding Yu , Kurt Keutzer , Sungjin Ahn , Jan Kautz , Hongxu Yin , Yao Lu , Song Han , Wonmin Byeon

Current large multimodal models (LMMs) face significant challenges in processing and comprehending long-duration or high-resolution videos, which is mainly due to the lack of high-quality datasets. To address this issue from a data-centric…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Weiming Ren , Huan Yang , Jie Min , Cong Wei , Wenhu Chen

We explore how reconciling several foundation models (large language models and vision-language models) with a novel unified memory mechanism could tackle the challenging video understanding problem, especially capturing the long-term…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yue Fan , Xiaojian Ma , Rujie Wu , Yuntao Du , Jiaqi Li , Zhi Gao , Qing Li

Long-form video understanding remains challenging for Vision-Language Models (VLMs) due to the inherent tension between computational constraints and the need to capture information distributed across thousands of frames. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Junbo Zou , Ziheng Huang , Shengjie Zhang , Liwen Zhang , Weining Shen

Large Vision-Language Models (LVLMs) have demonstrated strong multimodal reasoning capabilities on long and complex documents. However, their high memory footprint makes them impractical for deployment on resource-constrained edge devices.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Tanveer Hannan , Dimitrios Mallios , Parth Pathak , Faegheh Sardari , Thomas Seidl , Gedas Bertasius , Mohsen Fayyaz , Sunando Sengupta

The Large Vision-Language Model (LVLM) has enhanced the performance of various downstream tasks in visual-language understanding. Most existing approaches encode images and videos into separate feature spaces, which are then fed as inputs…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Bin Lin , Yang Ye , Bin Zhu , Jiaxi Cui , Munan Ning , Peng Jin , Li Yuan

Video-based large language models (Video-LLMs) have been recently introduced, targeting both fundamental improvements in perception and comprehension, and a diverse range of user inquiries. In pursuit of the ultimate goal of achieving…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Munan Ning , Bin Zhu , Yujia Xie , Bin Lin , Jiaxi Cui , Lu Yuan , Dongdong Chen , Li Yuan

Video Large Language Models (Video-LLMs) are flourishing and has advanced many video-language tasks. As a golden testbed, Video Question Answering (VideoQA) plays pivotal role in Video-LLM developing. This work conducts a timely and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Junbin Xiao , Nanxin Huang , Hangyu Qin , Dongyang Li , Yicong Li , Fengbin Zhu , Zhulin Tao , Jianxing Yu , Liang Lin , Tat-Seng Chua , Angela Yao

The application of Large Vision-Language Models (LVLMs) for analyzing images and videos is an exciting and rapidly evolving field. In recent years, we've seen significant growth in high-quality image-text datasets for fine-tuning image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Han Wang , Yuxiang Nie , Yongjie Ye , Deng GuanYu , Yanjie Wang , Shuai Li , Haiyang Yu , Jinghui Lu , Can Huang

Recent advances in Large Language Models (LLMs) have enabled the development of Video-LLMs, advancing multimodal learning by bridging video data with language tasks. However, current video understanding models struggle with processing long…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Haomiao Xiong , Zongxin Yang , Jiazuo Yu , Yunzhi Zhuge , Lu Zhang , Jiawen Zhu , Huchuan Lu