中文
相关论文

相关论文: Can Vision Language Models Judge Action Quality? A…

200 篇论文

Psychophysical experiments remain the most reliable approach for perceptual image quality assessment (IQA), yet their cost and limited scalability encourage automated approaches. We investigate whether Vision Language Models (VLMs) can…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Imran Mehmood , Imad Ali Shah , Ming Ronnier Luo , Brian Deegan

Visual Question-Answering (VQA) has become key to user experience, particularly after improved generalization capabilities of Vision-Language Models (VLMs). But evaluating VLMs for an application requirement using a standardized framework…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Neelabh Sinha , Vinija Jain , Aman Chadha

Despite remarkable progress in recent years, Vision Language Models (VLMs) remain prone to overconfidence and hallucinations on tasks such as Visual Question Answering (VQA) and Visual Reasoning. Bayesian methods can potentially improve…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Tobias Jan Wieczorek , Nathalie Daun , Mohammad Emtiyaz Khan , Marcus Rohrbach

Visual Language Action (VLA) models are a multi-modal class of Artificial Intelligence (AI) systems that integrate visual perception, natural language understanding, and action planning to enable agents to interpret their environment,…

软件工程 · 计算机科学 2025-08-04 Pablo Valle , Chengjie Lu , Shaukat Ali , Aitor Arrieta

Vision-language models (VLMs) are increasingly proposed as general-purpose tools for scientific data interpretation, yet their reliability on real astronomical observations across diverse modalities remains untested. We present…

人工智能 · 计算机科学 2026-04-28 Wenke Ren , Hengxiao Guo , Wenwen Zuo , Xiaoman Zhang

Vision-Language Models (VLMs) excel at complex visual tasks such as VQA and chart understanding, yet recent work suggests they struggle with simple perceptual tests. We present an evaluation of vision-language models' capacity for nonlocal…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Shmuel Berman , Jia Deng

Visual Question Answering (VQA) is a core task for evaluating the capabilities of Vision-Language Models (VLMs). Existing VQA benchmarks primarily feature clear and unambiguous image-question pairs, whereas real-world scenarios often…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jihyoung Jang , Hyounghun Kim

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

Vision-Language Models (VLMs) trained on web-scale corpora excel at natural image tasks and are increasingly repurposed for healthcare; however, their competence in medical tasks remains underexplored. We present a comprehensive evaluation…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Che Liu , Jiazhen Pan , Weixiang Shen , Wenjia Bai , Daniel Rueckert , Rossella Arcucci

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Samarth Singhal , Sandeep Singhal

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky

Vision Language Models (VLMs) bridge visual perception and linguistic reasoning. In Autonomous Driving (AD), this synergy has enabled Vision Language Action (VLA) models, which translate high-level multimodal understanding into driving…

机器人学 · 计算机科学 2026-03-11 Yuan Gao , Dengyuan Hua , Mattia Piccinini , Finn Rasmus Schäfer , Korbinian Moller , Lin Li , Johannes Betz

Image Quality Assessment (IQA) is a long-standing problem in computer vision. Previous methods typically focus on predicting numerical scores without explanation or providing low-level descriptions lacking precise scores. Recent…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Guoqiang Liang , Jianyi Wang , Zhonghua Wu , Shangchen Zhou

Videos are unique in their ability to capture actions which transcend multiple frames. Accordingly, for many years action recognition was the quintessential task for video understanding. Unfortunately, due to a lack of sufficiently diverse…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Tanush Yadav , Mohammadreza Salehi , Jae Sung Park , Vivek Ramanujan , Hannaneh Hajishirzi , Yejin Choi , Ali Farhadi , Rohun Tripathi , Ranjay Krishna

Fine-tuning vision-language models (VLMs) on robot teleoperation data to create vision-language-action (VLA) models is a promising paradigm for training generalist policies, but it suffers from a fundamental tradeoff: learning to produce…

机器人学 · 计算机科学 2025-09-29 Asher J. Hancock , Xindi Wu , Lihan Zha , Olga Russakovsky , Anirudha Majumdar

Vision-Language-Action (VLA) models, which integrate pretrained large Vision-Language Models (VLM) into their policy backbone, are gaining significant attention for their promising generalization capabilities. This paper revisits a…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Jianke Zhang , Xiaoyu Chen , Qiuyue Wang , Mingsheng Li , Yanjiang Guo , Yucheng Hu , Jiajun Zhang , Shuai Bai , Junyang Lin , Jianyu Chen

The advent of Vision Language Models (VLM) has allowed researchers to investigate the visual understanding of a neural network using natural language. Beyond object classification and detection, VLMs are capable of visual comprehension and…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Haz Sameen Shahgir , Khondker Salman Sayeed , Abhik Bhattacharjee , Wasi Uddin Ahmad , Yue Dong , Rifat Shahriyar

Latent Action Models (LAMs) have rapidly gained traction as an important component in the pre-training pipelines of leading Vision-Language-Action models. However, they fail when observations contain action-correlated distractors, often…

With the ever-increasing popularity of pretrained Video-Language Models (VidLMs), there is a pressing need to develop robust evaluation methodologies that delve deeper into their visio-linguistic capabilities. To address this challenge, we…

Robot action planning in the real world is challenging as it requires not only understanding the current state of the environment but also predicting how it will evolve in response to actions. Vision-language-action (VLA), which repurpose…

‹ 上一页 1 2 3 10 下一页 ›