English
Related papers

Related papers: Deep Reason: A Strong Baseline for Real-World Visu…

200 papers

Video quality assessment (VQA) is an important processing task, aiming at predicting the quality of videos in a manner highly consistent with human judgments of perceived quality. Traditional VQA models based on natural image and/or video…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Qi Zheng , Yibo Fan , Leilei Huang , Tianyu Zhu , Jiaming Liu , Zhijian Hao , Shuo Xing , Chia-Ju Chen , Xiongkuo Min , Alan C. Bovik , Zhengzhong Tu

We present M$^3$-VQA, a novel knowledge-based Visual Question Answering (VQA) benchmark, to enhance the evaluation of multimodal large language models (MLLMs) in fine-grained multimodal entity understanding and complex multi-hop reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiatong Ma , Longteng Guo , Yuchen Liu , Zijia Zhao , Dongze Hao , Xuanxu Lin , Jing Liu

Visual question answering (VQA) requires joint comprehension of images and natural language questions, where many questions can't be directly or clearly answered from visual content but require reasoning from structured human knowledge with…

Computer Vision and Pattern Recognition · Computer Science 2018-06-14 Zhou Su , Chen Zhu , Yinpeng Dong , Dongqi Cai , Yurong Chen , Jianguo Li

Visual question answering is an important task in both natural language and vision understanding. However, in most of the public visual question answering datasets such as VQA, CLEVR, the questions are human generated that specific to the…

Computation and Language · Computer Science 2022-08-08 Bingning Wang , Feiyang Lv , Ting Yao , Yiming Yuan , Jin Ma , Yu Luo , Haijin Liang

Deep neural networks have been playing an essential role in many computer vision tasks including Visual Question Answering (VQA). Until recently, the study of their accuracy was the main focus of research but now there is a trend toward…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Jia-Hong Huang , Cuong Duc Dao , Modar Alfadly , Bernard Ghanem

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

Computer Vision and Pattern Recognition · Computer Science 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

Embodied Question Answering (EQA) connects perception, reasoning, and interaction within embodied environments. However, existing datasets and benchmarks remain fragmented, each focusing on a limited subset of reasoning skills such as…

Robotics · Computer Science 2026-05-26 Xicheng Gong , Qiwei Li , Peiran Xu , Yadong Mu

Vision-language reinforcement learning (RL) has primarily focused on narrow domains (e.g. geometry or chart reasoning). This leaves broader training scenarios and resources underexplored, limiting the exploration and learning of Vision…

Visual question answering is the task of answering questions about images. We introduce the VizWiz-VQA-Grounding dataset, the first dataset that visually grounds answers to visual questions asked by people with visual impairments. We…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Chongyan Chen , Samreen Anjum , Danna Gurari

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jie Ma , Pinghui Wang , Dechen Kong , Zewei Wang , Jun Liu , Hongbin Pei , Junzhou Zhao

Visual Query Answering (VQA) is of great significance in offering people convenience: one can raise a question for details of objects, or high-level understanding about the scene, over an image. This paper proposes a novel method to address…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Peixi Xiong , Huayi Zhan , Xin Wang , Baivab Sinha , Ying Wu

Deep Neural Networks have been successfully used for the task of Visual Question Answering for the past few years owing to the availability of relevant large scale datasets. However these datasets are created in artificial settings and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Shaunak Halbe

Multimodal Large Language Models struggle to maintain reliable performance under extreme real-world visual degradations, which impede their practical robustness. Existing robust MLLMs predominantly rely on implicit training/adaptation that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Jiaqi Tang , Jianmin Chen , Wei Wei , Xiaogang Xu , Runtao Liu , Xiangyu Wu , Qipeng Xie , Jiafei Wu , Lei Zhang , Qifeng Chen

Visual Question Answering (VQA) is the task of taking as input an image and a free-form natural language question about the image, and producing an accurate answer. In this work we view VQA as a "feature extraction" module to extract image…

Computer Vision and Pattern Recognition · Computer Science 2016-09-02 Xiao Lin , Devi Parikh

Visual question answering (VQA) task not only bridges the gap between images and language, but also requires that specific contents within the image are understood as indicated by linguistic context of the question, in order to generate the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Kuniaki Saito , Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada

DeepSeek-R1 has demonstrated remarkable effectiveness in incentivizing reasoning and generalization capabilities of large language models (LLMs) through reinforcement learning. Nevertheless, the potential of reasoning-induced computation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tianhe Wu , Jian Zou , Jie Liang , Lei Zhang , Kede Ma

With the rapid advancement of video generation models such as Sora, video quality assessment (VQA) is becoming increasingly crucial for selecting high-quality videos from large-scale datasets used in pre-training. Traditional VQA methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Yanyun Pu , Kehan Li , Zeyi Huang , Zhijie Zhong , Kaixiang Yang

Visual question answering on document images that contain textual, visual, and layout information, called document VQA, has received much attention recently. Although many datasets have been proposed for developing document VQA systems,…

Computation and Language · Computer Science 2023-01-13 Ryota Tanaka , Kyosuke Nishida , Kosuke Nishida , Taku Hasegawa , Itsumi Saito , Kuniko Saito

Large Language Models (LLMs) and Large Multimodal Models (LMMs) exhibit impressive problem-solving skills in many tasks and domains, but their ability in mathematical reasoning in visual contexts has not been systematically studied. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Pan Lu , Hritik Bansal , Tony Xia , Jiacheng Liu , Chunyuan Li , Hannaneh Hajishirzi , Hao Cheng , Kai-Wei Chang , Michel Galley , Jianfeng Gao

Visual Question Answering (VQA) is increasingly used in diverse applications ranging from general visual reasoning to safety-critical domains such as medical imaging and autonomous systems, where models must provide not only accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xingjian Diao , Weiyi Wu , Keyi Kong , Peijun Qing , Xinwen Xu , Ming Cheng , Soroush Vosoughi , Jiang Gui