中文
相关论文

相关论文: Color Names in Vision-Language Models

200 篇论文

Large language models (LLMs) have made significant advancements in natural language understanding. However, through that enormous semantic representation that the LLM has learnt, is it somehow possible for it to understand images as well?…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Mu Cai , Zeyi Huang , Yuheng Li , Utkarsh Ojha , Haohan Wang , Yong Jae Lee

This research investigates both explicit and implicit social biases exhibited by Vision-Language Models (VLMs). The key distinction between these bias types lies in the level of awareness: explicit bias refers to conscious, intentional…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Jen-tse Huang , Jiantong Qin , Jianping Zhang , Youliang Yuan , Wenxuan Wang , Jieyu Zhao

Vision-Language Models (VLMs) transfer visual and textual data into a shared embedding space. In so doing, they enable a wide range of multimodal tasks, while also raising critical questions about the nature of machine 'understanding.' In…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Stefanie Schneider

Large Vision-Language Models (VLMs) rely on effective multimodal alignment between pre-trained vision encoders and Large Language Models (LLMs) to integrate visual and textual information. This paper presents a comprehensive analysis of…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Shweta Mahajan , Hoang Le , Hyojin Park , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

Top-view perspective denotes a typical way in which humans read and reason over different types of maps, and it is vital for localization and navigation of humans as well as of `non-human' agents, such as the ones backed by large…

计算与语言 · 计算机科学 2024-06-05 Chengzu Li , Caiqi Zhang , Han Zhou , Nigel Collier , Anna Korhonen , Ivan Vulić

Generative artificial intelligence (AI) systems based on large-scale pretrained foundation models (PFMs) such as vision-language models, large language models (LLMs), diffusion models and vision-language-action (VLA) models have…

人工智能 · 计算机科学 2025-01-07 Alhassan Mumuni , Fuseini Mumuni

Advances in vision language models (VLMs) have enabled the simulation of general human behavior through their reasoning and problem solving capabilities. However, prior research has not investigated such simulation capabilities in the…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Rosiana Natalie , Wenqian Xu , Ruei-Che Chang , Rada Mihalcea , Anhong Guo

The language for expressing comparisons is often complex and nuanced, making supporting natural language-based visual comparison a non-trivial task. To better understand how people reason about comparisons in natural language, we explore a…

人机交互 · 计算机科学 2022-08-09 Aimen Gaba , Vidya Setlur , Arjun Srinivasan , Jane Hoffswell , Cindy Xiong

Large Vision Language Models (LVLMs) have demonstrated remarkable abilities in understanding and reasoning about both visual and textual information. However, existing evaluation methods for LVLMs, primarily based on benchmarks like Visual…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Xinyu Wang , Bohan Zhuang , Qi Wu

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Vision Large Language Models (VLMs) combine visual understanding with natural language processing, enabling tasks like image captioning, visual question answering, and video analysis. While VLMs show impressive capabilities across domains…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Ahmed Sharshar , Latif U. Khan , Waseem Ullah , Mohsen Guizani

Most visual recognition studies rely heavily on crowd-labelled data in deep neural networks (DNNs) training, and they usually train a DNN for each single visual recognition task, leading to a laborious and time-consuming visual recognition…

计算机视觉与模式识别 · 计算机科学 2024-02-19 Jingyi Zhang , Jiaxing Huang , Sheng Jin , Shijian Lu

Iconicity, the resemblance between linguistic form and meaning, is pervasive in signed languages, offering a natural testbed for visual grounding. For vision-language models (VLMs), the challenge is to recover such essential mappings from…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Onur Keleş , Aslı Özyürek , Gerardo Ortega , Kadir Gökgöz , Esam Ghaleb

The advancement of large language models (LLMs) has catalyzed a paradigm shift from code generation assistance to autonomous coding agents, enabling a novel development methodology termed "Vibe Coding" where developers validate AI-generated…

We introduce VLM-Lens, a toolkit designed to enable systematic benchmarking, analysis, and interpretation of vision-language models (VLMs) by supporting the extraction of intermediate outputs from any layer during the forward pass of…

计算与语言 · 计算机科学 2025-10-03 Hala Sheta , Eric Huang , Shuyu Wu , Ilia Alenabi , Jiajun Hong , Ryker Lin , Ruoxi Ning , Daniel Wei , Jialin Yang , Jiawei Zhou , Ziqiao Ma , Freda Shi

The Large Vision Language Model (VLM) has recently addressed remarkable progress in bridging two fundamental modalities. VLM, trained by a sufficiently large dataset, exhibits a comprehensive understanding of both visual and linguistic to…

计算机视觉与模式识别 · 计算机科学 2024-11-28 Donggoo Kang , Dasol Jeong , Hyunmin Lee , Sangwoo Park , Hasil Park , Sunkyu Kwon , Yeongjoon Kim , Joonki Paik

Vision-Language Models (VLMs) extend Large Language Models' capabilities by integrating image processing, but concerns persist about their potential to reproduce and amplify human biases. While research has documented how these models…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Messi H. J. Lee , Soyeon Jeon

We introduce CompareBench, a benchmark for evaluating visual comparison reasoning in vision-language models (VLMs), a fundamental yet understudied skill. CompareBench consists of 1000 QA pairs across four tasks: quantity (600), temporal…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Jie Cai , Kangning Yang , Lan Fu , Jiaming Ding , Jinlong Li , Huiming Sun , Daitao Xing , Jinglin Shen , Zibo Meng

Large language models are known to suffer from the hallucination problem in that they are prone to output statements that are false or inconsistent, indicating a lack of knowledge. A proposed solution to this is to provide the model with…

计算与语言 · 计算机科学 2021-10-01 Tobias Norlund , Lovisa Hagström , Richard Johansson

Artificial Intelligence have profoundly transformed the technological landscape in recent years. Large Language Models (LLMs) have demonstrated impressive abilities in reasoning, text comprehension, contextual pattern recognition, and…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Efthymios Tsaprazlis , Tiantian Feng , Anil Ramakrishna , Rahul Gupta , Shrikanth Narayanan