中文
相关论文

相关论文: WildVision: Evaluating Vision-Language Models in t…

200 篇论文

Large Vision-Language Models (LVLMs) have shown promising capabilities in understanding and generating information by integrating both visual and textual data. However, current models are still prone to hallucinations, which degrade the…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Robert Wijaya , Ngoc-Bao Nguyen , Ngai-Man Cheung

Human-scene vision-language tasks are increasingly prevalent in diverse social applications, yet recent advancements predominantly rely on models specifically tailored to individual tasks. Emerging research indicates that large…

人工智能 · 计算机科学 2024-11-06 Dawei Dai , Xu Long , Li Yutang , Zhang Yuanhui , Shuyin Xia

Open-source Vision-Language Models show immense promise for enterprise applications, yet a critical disconnect exists between academic evaluation and enterprise deployment requirements. Current benchmarks rely heavily on multiple-choice…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Srihari Bandraupalli , Anupam Purwar

Spatial reasoning is a core aspect of human intelligence that allows perception, inference and planning in 3D environments. However, current vision-language models (VLMs) struggle to maintain geometric coherence and cross-view consistency…

人工智能 · 计算机科学 2025-12-03 Qiyao Xue , Weichen Liu , Shiqi Wang , Haoming Wang , Yuyang Wu , Wei Gao

The issue of hallucinations is a prevalent concern in existing Large Vision-Language Models (LVLMs). Previous efforts have primarily focused on investigating object hallucinations, which can be easily alleviated by introducing object…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Mingrui Wu , Jiayi Ji , Oucheng Huang , Jiale Li , Yuhang Wu , Xiaoshuai Sun , Rongrong Ji

Vision-Language Models (VLMs) have achieved remarkable progress across tasks such as visual question answering and image captioning. Yet, the extent to which these models perform visual reasoning as opposed to relying on linguistic priors…

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao

Vision-language models (VLMs) have advanced rapidly, yet their capacity for image-grounded geolocation in open-world conditions, a task that is challenging and of demand in real life, has not been comprehensively evaluated. We present…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Zhaofang Qian , Hardy Chen , Zeyu Wang , Li Zhang , Zijun Wang , Xiaoke Huang , Hui Liu , Xianfeng Tang , Zeyu Zheng , Haoqin Tu , Cihang Xie , Yuyin Zhou

Pre-trained multi-modal vision-language models (VLMs) are becoming increasingly popular due to their exceptional performance on downstream vision applications, particularly in the few- and zero-shot settings. However, selecting the…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Orr Zohar , Shih-Cheng Huang , Kuan-Chieh Wang , Serena Yeung

Vision Language Models (VLMs) have exhibited remarkable generalization capabilities, yet their robustness in dynamic real-world scenarios remains largely unexplored. To systematically evaluate VLMs' robustness to real-world 3D variations,…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Shouwei Ruan , Hanqing Liu , Yao Huang , Xiaoqi Wang , Caixin Kang , Hang Su , Yinpeng Dong , Xingxing Wei

Recent advancements in Large Multimodal Models (LMMs) have shown promising results in mathematical reasoning within visual contexts, with models approaching human-level performance on existing benchmarks such as MathVista. However, we…

计算机视觉与模式识别 · 计算机科学 2024-02-23 Ke Wang , Junting Pan , Weikang Shi , Zimu Lu , Mingjie Zhan , Hongsheng Li

The advent of immersive Virtual Reality applications has transformed various domains, yet their integration with advanced artificial intelligence technologies like Visual Language Models remains underexplored. This study introduces a…

机器人学 · 计算机科学 2024-08-06 Mikhail Konenkov , Artem Lykov , Daria Trinitatova , Dzmitry Tsetserukou

Large Vision-Language Models (LVLMs) have been widely adopted in various applications; however, they exhibit significant gender biases. Existing benchmarks primarily evaluate gender bias at the demographic group level, neglecting individual…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Yisong Xiao , Aishan Liu , QianJia Cheng , Zhenfei Yin , Siyuan Liang , Jiapeng Li , Jing Shao , Xianglong Liu , Dacheng Tao

The rapidly evolving sector of Multi-modal Large Language Models (MLLMs) is at the forefront of integrating linguistic and visual processing in artificial intelligence. This paper presents an in-depth comparative study of two pioneering…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Zhangyang Qi , Ye Fang , Mengchen Zhang , Zeyi Sun , Tong Wu , Ziwei Liu , Dahua Lin , Jiaqi Wang , Hengshuang Zhao

Despite their promise to perform complex reasoning, large language models (LLMs) have been shown to have limited effectiveness in end-to-end planning. This has inspired an intriguing question: if these models cannot plan well, can they…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Mohamed Aghzal , Xiang Yue , Erion Plaku , Ziyu Yao

Reinforcement Fine-Tuning (RFT) with verifiable rewards has advanced large language models but remains underexplored for Vision-Language (VL) models. The Vision-Language Reward Model (VL-RM) is key to aligning VL models by providing…

计算与语言 · 计算机科学 2025-06-18 Jipeng Zhang , Kehao Miao , Renjie Pi , Zhaowei Wang , Runtao Liu , Rui Pan , Tong Zhang

The emergence of large vision models (LVMs) is following in the footsteps of the recent prosperity of Large Language Models (LLMs) in following years. However, there's a noticeable gap in structured research applying LVMs to human-robot…

人机交互 · 计算机科学 2024-09-17 Yuchong Zhang , Yong Ma , Danica Kragic

Vision-Language Models (VLMs) have revolutionized artificial intelligence and robotics due to their commonsense reasoning capabilities. In robotic manipulation, VLMs are used primarily as high-level planners, but recent work has also…

机器人学 · 计算机科学 2025-09-03 Enyu Zhao , Vedant Raval , Hejia Zhang , Jiageng Mao , Zeyu Shangguan , Stefanos Nikolaidis , Yue Wang , Daniel Seita

We introduce V-Agent, a novel multi-agent platform designed for advanced video search and interactive user-system conversations. By fine-tuning a vision-language model (VLM) with a small video preference dataset and enhancing it with a…

计算机视觉与模式识别 · 计算机科学 2026-01-08 SunYoung Park , Jong-Hyeon Lee , Youngjune Kim , Daegyu Sung , Younghyun Yu , Young-rok Cha , Jeongho Ju

Multimodal large language models (MLLMs) are expected to jointly interpret vision, audio, and language, yet existing video benchmarks rarely assess fine-grained reasoning about human speech. Many tasks remain visually solvable or only…