English
Related papers

Related papers: Oryx MLLM: On-Demand Spatial-Temporal Understandin…

200 papers

We introduce OmChat, a model designed to excel in handling long contexts and video understanding tasks. OmChat's new architecture standardizes how different visual inputs are processed, making it more efficient and adaptable. It uses a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Tiancheng Zhao , Qianqian Zhang , Kyusong Lee , Peng Liu , Lu Zhang , Chunxin Fang , Jiajia Liao , Kelei Jiang , Yibo Ma , Ruochen Xu

The recent advent of Large Language Models (LLMs) has ushered sophisticated reasoning capabilities into the realm of video through Video Large Language Models (VideoLLMs). However, VideoLLMs currently rely on a single vision encoder for all…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jihoon Chung , Tyler Zhu , Max Gonzalez Saez-Diez , Juan Carlos Niebles , Honglu Zhou , Olga Russakovsky

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Long video understanding is still challenging for recent Large Video-Language Models (LVLMs) due to the conflict between long-form temporal understanding and detailed spatial perception. LVLMs with a uniform frame sampling mechanism, which…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Shenghao Fu , Qize Yang , Yuan-Ming Li , Xihan Wei , Xiaohua Xie , Wei-Shi Zheng

The Multi-Modal Large Language Model (MLLM) refers to an extension of the Large Language Model (LLM) equipped with the capability to receive and infer multi-modal data. Spatial awareness stands as one of the crucial abilities of MLLM,…

Artificial Intelligence · Computer Science 2023-11-02 Yongqiang Zhao , Zhenyu Li , Zhi Jin , Feng Zhang , Haiyan Zhao , Chengfeng Dou , Zhengwei Tao , Xinhai Xu , Donghong Liu

Multi-modal large language models (MLLMs) have demonstrated considerable potential across various downstream tasks that require cross-domain knowledge. MLLMs capable of processing videos, known as Video-MLLMs, have attracted broad interest…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiajun Fei , Dian Li , Zhidong Deng , Zekun Wang , Gang Liu , Hui Wang

Current large multimodal models (LMMs) face significant challenges in processing and comprehending long-duration or high-resolution videos, which is mainly due to the lack of high-quality datasets. To address this issue from a data-centric…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Weiming Ren , Huan Yang , Jie Min , Cong Wei , Wenhu Chen

Following the impressive development of LLMs, vision-language alignment in LLMs is actively being researched to enable multimodal reasoning and visual IO. This direction of research is particularly relevant to medical imaging because…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Suhyeon Lee , Won Jun Kim , Jinho Chang , Jong Chul Ye

Multimodal large language models (MLLMs) have shown impressive capabilities across various domains, excelling in processing and understanding information from multiple modalities. Despite the rapid progress made previously, insufficient OCR…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Song Chen , Xinyu Guo , Yadong Li , Tao Zhang , Mingan Lin , Dongdong Kuang , Youwei Zhang , Lingfeng Ming , Fengyu Zhang , Yuran Wang , Jianhua Xu , Zenan Zhou , Weipeng Chen

Multimodal large language models are increasingly expected to perform thinking with images, yet existing visual latent reasoning methods still rely on explicit textual chain-of-thought interleaved with visual latent tokens. This interleaved…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Houcheng Jiang , Jiajun Fu , Junfeng Fang , Chen Gao , Xiang Wang , Xiangnan He , Yong Li

The exponential increase in video content poses significant challenges in terms of efficient navigation, search, and retrieval, thus requiring advanced video summarization techniques. Existing video summarization methods, which heavily rely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Min Jung Lee , Dayoung Gong , Minsu Cho

Multimodal Large Language Models (MLLMs) have made impressive progress in connecting vision and language, but they still struggle with spatial understanding and viewpoint-aware reasoning. Recent efforts aim to augment the input…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Kevin Qu , Haozhe Qi , Mihai Dusmanu , Mahdi Rad , Rui Wang , Marc Pollefeys

Multimodal Large Language Models (MLLMs) are experiencing rapid growth, yielding a plethora of noteworthy contributions in recent months. The prevailing trend involves adopting data-driven methodologies, wherein diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Xin He , Longhui Wei , Lingxi Xie , Qi Tian

This paper introduces MiniGPT4-Video, a multimodal Large Language Model (LLM) designed specifically for video understanding. The model is capable of processing both temporal visual and textual data, making it adept at understanding the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kirolos Ataallah , Xiaoqian Shen , Eslam Abdelrahman , Essam Sleiman , Deyao Zhu , Jian Ding , Mohamed Elhoseiny

The growing interest in embodied agents increases the demand for spatiotemporal video understanding, yet existing benchmarks largely emphasize extractive reasoning, where answers can be explicitly presented within spatiotemporal events. It…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Seunghwan Bang , Hwanjun Song

Large Language Models (LLMs) are advancing into Multimodal LLMs (MLLMs), capable of processing image, audio, and video as well as text. Combining first-person video, MLLMs show promising potential for understanding human activities through…

Human-Computer Interaction · Computer Science 2025-04-09 Jun Rekimoto

Long-form video understanding remains challenging due to the extended temporal structure and dense multimodal cues. Despite recent progress, many existing approaches still rely on hand-crafted reasoning pipelines or employ token-consuming…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yufei Yin , Qianke Meng , Minghao Chen , Jiajun Ding , Zhenwei Shao , Zhou Yu

In recent years, the development of Large Language Models (LLMs) has significantly advanced, extending their capabilities to multimodal tasks through Multimodal Large Language Models (MLLMs). However, video understanding remains a…

With the burgeoning growth of online video platforms and the escalating volume of video content, the demand for proficient video understanding tools has intensified markedly. Given the remarkable capabilities of large language models (LLMs)…

Vision-Language Models (VLMs) are crucial for applications requiring integrated understanding textual and visual information. However, existing VLMs struggle with long videos due to computational inefficiency, memory limitations, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Anxhelo Diko , Tinghuai Wang , Wassim Swaileh , Shiyan Sun , Ioannis Patras