中文
相关论文

相关论文: JEEM: Vision-Language Understanding in Four Arabic…

200 篇论文

Vision-language models (VLMs) have enabled strong zero-shot classification through image-text alignment. Yet, their purely visual inference capabilities remain under-explored. In this work, we conduct a comprehensive evaluation of both…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Illia Volkov , Nikita Kisel , Klara Janouskova , Jiri Matas

Internet audio-visual clips convey meaning through time-varying sound and motion, which extend beyond what text alone can represent. To examine whether AI models can understand such signals in human cultural contexts, we introduce AVMeme…

As Vision and Language models (VLMs) are reaching users across the globe, assessing their cultural understanding has become a critical challenge. In this paper, we introduce CROPE, a visual question answering benchmark designed to probe the…

计算与语言 · 计算机科学 2025-02-07 Malvina Nikandrou , Georgios Pantazopoulos , Nikolas Vitsakis , Ioannis Konstas , Alessandro Suglia

In this paper, we introduce an open-source Korean-English vision-language model (VLM), VARCO-VISION. We incorporate a step-by-step training strategy that allows a model learn both linguistic and visual information while preserving the…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Jeongho Ju , Daeyoung Kim , SunYoung Park , Youngjune Kim

The Large Vision-Language Model (LVLM) has enhanced the performance of various downstream tasks in visual-language understanding. Most existing approaches encode images and videos into separate feature spaces, which are then fed as inputs…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Bin Lin , Yang Ye , Bin Zhu , Jiaxi Cui , Munan Ning , Peng Jin , Li Yuan

As Vision-Language Models (VLMs) achieve widespread deployment across diverse cultural contexts, ensuring their cultural competence becomes critical for responsible AI systems. While prior work has evaluated cultural awareness in text-only…

计算与语言 · 计算机科学 2025-08-26 Arka Mukherjee , Shreya Ghosh

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

As the reach of large language models (LMs) expands globally, their ability to cater to diverse cultural contexts becomes crucial. Despite advancements in multilingual capabilities, models are not designed with appropriate cultural nuances.…

计算与语言 · 计算机科学 2024-03-21 Tarek Naous , Michael J. Ryan , Alan Ritter , Wei Xu

Recent Vision-Language Models (VLMs) have demonstrated impressive multimodal comprehension and reasoning capabilities, yet they often struggle with trivially simple visual tasks. In this work, we focus on the domain of basic 2D Euclidean…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Hyunsik Chae , Seungwoo Yoon , Jaden Park , Chloe Yewon Chun , Yongin Cho , Mu Cai , Yong Jae Lee , Ernest K. Ryu

Aligning visual features with language embeddings is a key challenge in vision-language models (VLMs). The performance of such models hinges on having a good connector that maps visual features generated by a vision encoder to a shared…

The ability to construct mental models of the world is a central aspect of understanding. Similarly, visual understanding can be viewed as the ability to construct a representative model of the system depicted in an image. This work…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Sagi Eppel

Vision-language models (VLMs) have rapidly evolved into general-purpose multimodal reasoners with strong zero-shot generalization. In this context, VLMs could greatly benefit the analysis of human gaze and attention, a central task in human…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Hengfei Wang , Anshul Gupta , Pierre Vuillecard , Jean-Marc Odobez

While bias in large language models (LLMs) is well-studied, similar concerns in vision-language models (VLMs) have received comparatively less attention. Existing VLM bias studies often focus on portrait-style images and gender-occupation…

计算与语言 · 计算机科学 2026-04-30 Chahat Raj , Bowen Wei , Aylin Caliskan , Antonios Anastasopoulos , Ziwei Zhu

The ability to distinguish subtle differences between visually similar images is essential for diverse domains such as industrial anomaly detection, medical imaging, and aerial surveillance. While comparative reasoning benchmarks for…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Minkyu Kim , Sangheon Lee , Dongmin Park

Following the recent popularity of Large Language Models (LLMs), several attempts have been made to extend them to the visual domain. From having a visual assistant that could guide us through unfamiliar environments to generative models…

Vision-language models (VLMs) integrate visual and textual information, enabling a wide range of applications such as image captioning and visual question answering, making them crucial for modern AI systems. However, their high…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Gaurav Shinde , Anuradha Ravi , Emon Dey , Shadman Sakib , Milind Rampure , Nirmalya Roy

Existing Large Multimodal Models (LMMs) generally focus on only a few regions and languages. As LMMs continue to improve, it is increasingly important to ensure they understand cultural contexts, respect local sensitivities, and support…

Multimodal large language models (MLLMs) have proven effective in a wide range of tasks requiring complex reasoning and linguistic comprehension. However, due to a lack of high-quality multimodal resources in languages other than English,…

MM-Vet, with open-ended vision-language questions targeting at evaluating integrated capabilities, has become one of the most popular benchmarks for large multimodal model evaluation. MM-Vet assesses six core vision-language (VL)…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Weihao Yu , Zhengyuan Yang , Lingfeng Ren , Linjie Li , Jianfeng Wang , Kevin Lin , Chung-Ching Lin , Zicheng Liu , Lijuan Wang , Xinchao Wang

In recent years, 2D Vision-Language Models (VLMs) have made significant strides in image-text understanding tasks. However, their performance in 3D spatial comprehension, which is critical for embodied intelligence, remains limited. Recent…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Zhangyang Qi , Zhixiong Zhang , Ye Fang , Jiaqi Wang , Hengshuang Zhao