English
Related papers

Related papers: UWBench: A Comprehensive Vision-Language Benchmark…

200 papers

Vision-Language Models (VLMs) have demonstrated significant potential in medical image analysis, yet their application in intraoral photography remains largely underexplored due to the lack of fine-grained, annotated datasets and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Meng-Xun Li , Wen-Hui Deng , Zhi-Xing Wu , Chun-Xiao Jin , Jia-Min Wu , Yue Han , James Kit Hon Tsoi , Gui-Song Xia , Cui Huang

Multimodal Large Language Models (MLLMs) have demonstrated impressive 2D image/video understanding capabilities. However, there are no publicly standardized benchmarks to assess the abilities of MLLMs in understanding the 4D objects (3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Wenxuan Zhu , Bing Li , Cheng Zheng , Jinjie Mai , Jun Chen , Letian Jiang , Abdullah Hamdi , Sara Rojas Martinez , Chia-Wen Lin , Mohamed Elhoseiny , Bernard Ghanem

Vision-Language Models (VLMs) have achieved strong performance on standard vision-language benchmarks, yet often rely on surface-level recognition rather than deeper reasoning. We propose visual word puzzles as a challenging alternative, as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Ali Najar , Alireza Mirrokni , Arshia Izadyari , Sadegh Mohammadian , Amir Homayoon Sharifizade , Asal Meskin , Mobin Bagherian , Ehsaneddin Asgari

End-to-end In-Image Machine Translation (IIMT) aims to convert text embedded within an image into a target language while preserving the original visual context, layout, and rendering style. However, existing IIMT benchmarks are largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jiahao Lyu , Pei Fu , Zhenhang Li , Weichao Zeng , Shaojie Zhang , Jiahui Yang , Can Ma , Yu Zhou , Zhenbo Luo , Jian Luan

Large Vision-Language Models (LVLMs) increasingly rely on retrieval to answer knowledge-intensive multimodal questions. Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections…

Computation and Language · Computer Science 2026-04-15 Nicholas Moratelli , Christopher Davis , Leonardo F. R. Ribeiro , Bill Byrne , Gonzalo Iglesias

Underwater activities like scuba diving enable millions annually to explore marine environments for recreation and scientific research. Maintaining situational awareness and effective communication are essential for diver safety.…

Human-Computer Interaction · Computer Science 2025-10-28 Beitong Tian , Lingzhi Zhao , Bo Chen , Haozhen Zheng , Jingcheng Yang , Mingyuan Wu , Deepak Vasisht , Klara Nahrstedt

Can Multimodal Large Language Models (MLLMs) develop an intuitive number sense similar to humans? Targeting this problem, we introduce Visual Number Benchmark (VisNumBench) to evaluate the number sense abilities of MLLMs across a wide range…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Tengjin Weng , Jingyi Wang , Wenhao Jiang , Zhong Ming

Recent advances in multimodal large language models (MLLMs) have demonstrated substantial potential in video understanding. However, existing benchmarks fail to comprehensively evaluate synergistic reasoning capabilities across audio and…

With the rapid development of Multi-modal Large Language Models (MLLMs), a number of diagnostic benchmarks have recently emerged to evaluate the comprehension capabilities of these models. However, most benchmarks predominantly assess…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Kunchang Li , Yali Wang , Yinan He , Yizhuo Li , Yi Wang , Yi Liu , Zun Wang , Jilan Xu , Guo Chen , Ping Luo , Limin Wang , Yu Qiao

Large multimodal models (LMMs) have recently gained attention due to their effectiveness to understand and generate descriptions of visual content. Most existing LMMs are in English language. While few recent works explore multilingual…

Video foundation models aim to integrate video understanding, generation, editing, and instruction following within a single framework, making them a central direction for next-generation multimodal systems. However, existing evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jianhui Wei , Xiaotian Zhang , Yichen Li , Yuan Wang , Yan Zhang , Ziyi Chen , Zhihang Tang , Wei Xu , Zuozhu Liu

Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs)…

Robotics · Computer Science 2025-05-20 Hu Yue , Siyuan Huang , Yue Liao , Shengcong Chen , Pengfei Zhou , Liliang Chen , Maoqing Yao , Guanghui Ren

Large Vision-Language Models (LVLMs) show significant strides in general-purpose multimodal applications such as visual dialogue and embodied navigation. However, existing multimodal evaluation benchmarks cover a limited number of…

Underwater communication is essential for environmental monitoring, marine biology research, and underwater exploration. Traditional underwater communication faces limitations like low bandwidth, high latency, and susceptibility to noise,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weilong Chen , Wenxuan Xu , Haoran Chen , Xinran Zhang , Zhijin Qin , Yanru Zhang , Zhu Han

Multimodal LLMs (MLLMs) are capable of performing complex data analysis, visual question answering, generation, and reasoning tasks. However, their ability to analyze biometric data is relatively underexplored. In this work, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ekta Gavas , Sudipta Banerjee , Chinmay Hegde , Nasir Memon

Vision language models (VLMs) achieve strong performance on RGB imagery, but they do not generalize to thermal images. Thermal sensing plays a critical role in settings where visible light fails, including nighttime surveillance, search and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Ayush Shrivastava , Kirtan Gangani , Laksh Jain , Mayank Goel , Nipun Batra

Vision-and-Language Navigation (VLN), as a widely discussed research direction in embodied intelligence, aims to enable embodied agents to navigate in complicated visual environments through natural language commands. Most existing VLN…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Youzhi Liu , Fanglong Yao , Yuanchang Yue , Guangluan Xu , Xian Sun , Kun Fu

In this work, we introduce the Qwen-VL series, a set of large-scale vision-language models (LVLMs) designed to perceive and understand both texts and images. Starting from the Qwen-LM as a foundation, we endow it with visual capacity by the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Jinze Bai , Shuai Bai , Shusheng Yang , Shijie Wang , Sinan Tan , Peng Wang , Junyang Lin , Chang Zhou , Jingren Zhou

Recent advancements in Large Language Models (LLMs) have paved the way for Vision Large Language Models (VLLMs) capable of performing a wide range of visual understanding tasks. While LLMs have demonstrated impressive performance on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Muhammad Ali , Salman Khan

We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed for real-world vision and language understanding applications. Our approach is structured around three key dimensions: We strive to ensure our data is diverse,…

Artificial Intelligence · Computer Science 2024-03-12 Haoyu Lu , Wen Liu , Bo Zhang , Bingxuan Wang , Kai Dong , Bo Liu , Jingxiang Sun , Tongzheng Ren , Zhuoshu Li , Hao Yang , Yaofeng Sun , Chengqi Deng , Hanwei Xu , Zhenda Xie , Chong Ruan