中文
相关论文

相关论文: DynamicVL: Benchmarking Multimodal Large Language …

200 篇论文

The recent development of Multimodal Large Language Models (MLLMs) has significantly advanced AI's ability to understand visual modalities. However, existing evaluation benchmarks remain limited to single-turn question answering,…

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao

Multimodal large language models have become a popular topic in deep visual understanding due to many promising real-world applications. However, hour-long video understanding, spanning over one hour and containing tens of thousands of…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Heqing Zou , Tianze Luo , Guiyang Xie , Victor Xiao Jie Zhang , Fengmao Lv , Guangcong Wang , Junyang Chen , Zhuochen Wang , Hansheng Zhang , Huaijian Zhang

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

Large language models (LLMs) have demonstrated immense capabilities in understanding textual data and are increasingly being adopted to help researchers accelerate scientific discovery through knowledge extraction (information retrieval),…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Robinson Umeike , Neil Getty , Fangfang Xia , Rick Stevens

Existing semi-supervised video anomaly detection (VAD) methods often struggle with detecting complex anomalies involving object interactions and generally lack explainability. To overcome these limitations, we propose a novel VAD framework…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Furkan Mumcu , Michael J. Jones , Anoop Cherian , Yasin Yilmaz

Multimodal Large Language Models (MLLMs) have shown success in various general image processing tasks, yet their application in medical imaging is nascent, lacking tailored models. This study investigates the potential of MLLMs in improving…

计算机视觉与模式识别 · 计算机科学 2024-05-13 Ling Yang , Zhanyu Wang , Zhenghao Chen , Xinyu Liang , Luping Zhou

Multimodal Large Language Models (MLLMs) have made significant progress in tasks such as image captioning and question answering. However, while these models can generate realistic captions, they often struggle with providing precise…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Chun-Peng Chang , Alain Pagani , Didier Stricker

Recent Multimodal Large Language Models (MLLMs) excel in vision-language understanding but face challenges in adapting to dynamic real-world scenarios that require continuous integration of new knowledge and skills. While continual learning…

计算与语言 · 计算机科学 2025-10-02 Hongbo Zhao , Fei Zhu , Haiyang Guo , Meng Wang , Rundong Wang , Gaofeng Meng , Zhaoxiang Zhang

Multimodal Large Language Models (MLLMs) have recently shown promising progress in geospatial reasoning. However, existing remote sensing benchmarks remain largely 2D-centric, evaluating models primarily on optical appearance. In natural…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Jing Huang , Duanchu Wang , Junjie Yang , Zihang Cheng , Cheng Li , Lin Cui , Zhouyi Wu , Di Wang

Benchmarking spatial reasoning in multimodal large language models (MLLMs) has attracted growing interest in computer vision due to its importance for embodied AI and other agentic systems that require precise interaction with the physical…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Zelin Xu , Yupu Zhang , Saugat Adhikari , Saiful Islam , Tingsong Xiao , Zibo Liu , Shigang Chen , Da Yan , Zhe Jiang

Multi-modal large language models (MLLMs) have achieved remarkable performance on objective multimodal perception tasks, but their ability to interpret subjective, emotionally nuanced multimodal content remains largely unexplored. Thus, it…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Qu Yang , Mang Ye , Bo Du

Multimodal large language models (MLLMs) have emerged as a promising paradigm for dental image analysis. However, their ability to capture the multi-level cognitive processes required for radiographic analysis remains unclear. Here, we…

计算与语言 · 计算机科学 2026-05-11 Rongyang Wang , Shuang Zhou , Jiashuo Wang , Wenya Xie , Xiaoxia Che

Multi-modal large language models (MLLMs) have shown incredible capabilities in a variety of 2D vision and language tasks. We extend MLLMs' perceptual capabilities to ground and reason about images in 3-dimensional space. To that end, we…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Jang Hyun Cho , Boris Ivanovic , Yulong Cao , Edward Schmerling , Yue Wang , Xinshuo Weng , Boyi Li , Yurong You , Philipp Krähenbühl , Yan Wang , Marco Pavone

Although great progress has been made by previous table understanding methods including recent approaches based on large language models (LLMs), they rely heavily on the premise that given tables must be converted into a certain text…

计算与语言 · 计算机科学 2024-06-13 Mingyu Zheng , Xinwei Feng , Qingyi Si , Qiaoqiao She , Zheng Lin , Wenbin Jiang , Weiping Wang

Multi-modal large language models (MLLMs) have shown promise in advancing healthcare. However, most existing models remain confined to single-image understanding, which greatly limits their applicability in clinical workflows. In practice,…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhen Chen , Yihang Fu , Gabriel Madera , Mauro Giuffre , Serina Applebaum , Hyunjae Kim , Hua Xu , Qingyu Chen

Multimodal large language models (MLLMs) are changing how Blind and Low Vision (BLV) people access visual information. Unlike traditional visual interpretation tools that only provide descriptions, MLLM-enabled applications offer…

人机交互 · 计算机科学 2026-02-20 Ricardo E. Gonzalez Penuela , Crescentia Jung , Sharon Y Lin , Ruiying Hu , Shiri Azenkot

Large Vision-Language Models (LVLMs) have recently played a dominant role in multimodal vision-language learning. Despite the great success, it lacks a holistic evaluation of their efficacy. This paper presents a comprehensive evaluation of…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Peng Xu , Wenqi Shao , Kaipeng Zhang , Peng Gao , Shuo Liu , Meng Lei , Fanqing Meng , Siyuan Huang , Yu Qiao , Ping Luo

Multimodal Large Language Models (MLLMs) are increasingly applied in real-world scenarios where user-provided images are often imperfect, requiring active image manipulations such as cropping, editing, or enhancement to uncover salient…

With the rapid development of Multi-modal Large Language Models (MLLMs), an increasing number of benchmarks have been established to evaluate the video understanding capabilities of these models. However, these benchmarks focus on…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Chenkai Zhang , Yiming Lei , Zeming Liu , Haitao Leng , Shaoguo Liu , Tingting Gao , Qingjie Liu , Yunhong Wang