English
Related papers

Related papers: Towards Flexible Evaluation for Generative Visual …

200 papers

Automated fetal ultrasound interpretation requires a workflow from visual perception, including plane recognition and anatomical segmentation, to clinical understanding, including biometric measurement and diagnostic reporting. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiaotian Hu , Mingxuan Liu , Junwei Huang , Kasidit Anmahapong , Yifei Chen , Yiming Huang , Xuguang Bai , Zihan Li , Hongjia Yang , Yingqi Hao , Hong Xu , Yu Jiang , Tian Tian , Yi Liao , Haibo Qu , Qiyuan Tian

With advances in multimodal research and deep learning, Multimodal Large Language Models (MLLMs) have emerged as a powerful paradigm for a wide range of multimodal tasks. As a core problem in vision-language research, Visual Question…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Quanxing Xu , Ling Zhou , Xian Zhong , Xiaohua Huang , Rubing Huang , Chia-Wen Lin

Visual Question Answering (VQA) requires reasoning across visual and textual modalities, yet Large Vision-Language Models (LVLMs) often lack integrated commonsense knowledge, limiting their robustness in real-world scenarios. To address…

Computation and Language · Computer Science 2025-06-12 Shuo Yang , Siwen Luo , Soyeon Caren Han , Eduard Hovy

The rapid development of vision language models (VLMs) demands rigorous and reliable evaluation. However, current visual question answering (VQA) benchmarks often depend on open-ended questions, making accurate evaluation difficult due to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yuhui Zhang , Yuchang Su , Yiming Liu , Xiaohan Wang , James Burgess , Elaine Sui , Chenyu Wang , Josiah Aklilu , Alejandro Lozano , Anjiang Wei , Ludwig Schmidt , Serena Yeung-Levy

Visual Question Answering (VQA) is a task that requires computers to give correct answers for the input questions based on the images. This task can be solved by humans with ease but is a challenge for computers. The VLSP2022-EVJVQA shared…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Triet Minh Thai , Son T. Luu

The field of visual question answering (VQA) has recently seen a surge in research focused on providing explanations for predicted answers. However, current systems mostly rely on separate models to predict answers and generate…

Computation and Language · Computer Science 2023-02-14 Chenxi Whitehouse , Tillman Weyde , Pranava Madhyastha

In recent years, Visual Question Answering (VQA) has gained significant attention for its diverse applications, including intelligent car assistance, aiding visually impaired individuals, and document image information retrieval using…

Computation and Language · Computer Science 2023-10-30 Khiem Vinh Tran , Hao Phu Phan , Kiet Van Nguyen , Ngan Luu Thuy Nguyen

The ideal form of Visual Question Answering requires understanding, grounding and reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most existing VQA benchmarks are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Kang Chen , Xiangqian Wu

Visual Question Answering (VQA) is an interdisciplinary field that bridges the gap between computer vision (CV) and natural language processing(NLP), enabling Artificial Intelligence(AI) systems to answer questions about images. Since its…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Anupam Pandey , Deepjyoti Bodo , Arpan Phukan , Asif Ekbal

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in visual-text processing. However, existing static image-text benchmarks are insufficient for evaluating their dynamic perception and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Xiangxi Zheng , Linjie Li , Zhengyuan Yang , Ping Yu , Alex Jinpeng Wang , Rui Yan , Yuan Yao , Lijuan Wang

Large Vision-Language Models (LVLMs) show promise for scientific applications, yet open-source models still struggle with Scientific Visual Question Answering (SVQA), namely answering questions about figures from scientific papers. A key…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yuyi Li , Daoyuan Chen , Zhen Wang , Yutong Lu , Yaliang Li

The emergence of multimodal large models (MLMs) has significantly advanced the field of visual understanding, offering remarkable capabilities in the realm of visual question answering (VQA). Yet, the true challenge lies in the domain of…

Computation and Language · Computer Science 2024-08-27 Yunxin Li , Longyue Wang , Baotian Hu , Xinyu Chen , Wanqi Zhong , Chenyang Lyu , Wei Wang , Min Zhang

Effective multimodal reasoning depends on the alignment of visual and linguistic representations, yet the mechanisms by which vision-language models (VLMs) achieve this alignment remain poorly understood. Following the LiMBeR framework, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Constantin Venhoff , Ashkan Khakzar , Sonia Joseph , Philip Torr , Neel Nanda

Table Visual Question Answering (Table VQA) is typically addressed by large vision-language models (VLMs). While such models can answer directly from images, they often miss fine-grained details unless scaled to very large sizes, which are…

Computation and Language · Computer Science 2025-10-09 Guo Yutong , Wanying Wang , Yue Wu , Zichen Miao , Haoyu Wang

We present FlagEvalMM, an open-source evaluation framework designed to comprehensively assess multimodal models across a diverse range of vision-language understanding and generation tasks, such as visual question answering,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zheqi He , Yesheng Liu , Jing-shu Zheng , Xuejing Li , Jin-Ge Yao , Bowen Qin , Richeng Xuan , Xi Yang

Recent advances in Large Vision-Language Models (LVLMs) have enabled training-free Fine-Grained Visual Recognition (FGVR). However, effectively exploiting LVLMs for FGVR remains challenging due to the inherent visual ambiguity of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jingxiao Yang , DaLin He , Miao Pan , Kaixiang Yao , Ge Su , Wenqi Zhang , Yifeng Hu , Tangwei Li , Yuke Li , Xuhong Zhang

Event-Level Video Question Answering (EVQA) requires complex reasoning across video events to obtain the visual information needed to provide optimal answers. However, despite significant progress in model performance, few studies have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Chenyang Lyu , Tianbo Ji , Yvette Graham , Jennifer Foster

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo , Lianwen Jin , Chee Seng Chan , Anton van den Hengel , Liangwei Wang

The cognitive faculty of visual reasoning necessitates the integration of multimodal perceptual processing and commonsense and external knowledge of the world. In recent years, a plethora of large vision-language models (LVLMs) have been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Tien-Huy Nguyen , Quang-Khai Tran , Anh-Tuan Quang-Hoang

A reliable driving assistant should provide consistent responses based on temporally grounded reasoning derived from observed information. In this work, we investigate whether Vision-Language Models (VLMs), when applied as driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Chun-Peng Chang , Chen-Yu Wang , Holger Caesar , Alain Pagani