中文
相关论文

相关论文: Automated Generation of Challenging Multiple-Choic…

200 篇论文

In question-answering scenarios, humans can assess whether the available information is sufficient and seek additional information if necessary, rather than providing a forced answer. In contrast, Vision Language Models (VLMs) typically…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Li Liu , Diji Yang , Sijia Zhong , Kalyana Suma Sree Tholeti , Lei Ding , Yi Zhang , Leilani H. Gilpin

Visual Question Answering (VQA) is a core task for evaluating the capabilities of Vision-Language Models (VLMs). Existing VQA benchmarks primarily feature clear and unambiguous image-question pairs, whereas real-world scenarios often…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jihyoung Jang , Hyounghun Kim

This study explores innovative methods for improving Visual Question Answering (VQA) using Generative Adversarial Networks (GANs), autoencoders, and attention mechanisms. Leveraging a balanced VQA dataset, we investigate three distinct…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Panfeng Li , Qikai Yang , Xieming Geng , Wenjing Zhou , Zhicheng Ding , Yi Nian

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

计算与语言 · 计算机科学 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Medical Visual Question Answering (VQA) is an important challenge, as it would lead to faster and more accurate diagnoses and treatment decisions. Most existing methods approach it as a multi-class classification problem, which restricts…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Tom van Sonsbeek , Mohammad Mahdi Derakhshani , Ivona Najdenkoska , Cees G. M. Snoek , Marcel Worring

Vision Language Models (VLMs) are increasingly deployed in autonomous vehicles and mobile systems, making it crucial to evaluate their ability to support safer decision-making in complex environments. However, existing benchmarks…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Takara Taniguchi , Kuniaki Saito , Atsushi Hashimoto

Visual Question Answering (VQA) is an interdisciplinary field that bridges the gap between computer vision (CV) and natural language processing(NLP), enabling Artificial Intelligence(AI) systems to answer questions about images. Since its…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Anupam Pandey , Deepjyoti Bodo , Arpan Phukan , Asif Ekbal

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

The increasing availability of multimodal data across text, tables, and images presents new challenges for developing models capable of complex cross-modal reasoning. Existing methods for Multimodal Multi-hop Question Answering (MMQA) often…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Qi Zhi Lim , Chin Poo Lee , Kian Ming Lim , Kalaiarasi Sonai Muthu Anbananthen

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential…

人工智能 · 计算机科学 2024-04-10 Saikat Barua

Question decomposition has emerged as an effective strategy for prompting Large Language Models (LLMs) to answer complex questions. However, while existing methods primarily focus on unimodal language models, the question decomposition…

计算与语言 · 计算机科学 2024-10-08 Haowei Zhang , Jianzhe Liu , Zhen Han , Shuo Chen , Bailan He , Volker Tresp , Zhiqiang Xu , Jindong Gu

We show that multi-agent systems guided by vision-language models (VLMs) improve end-to-end autonomous scientific discovery. By treating plots as verifiable checkpoints, a VLM-as-a-judge evaluates figures against dynamically generated…

计算与语言 · 计算机科学 2025-11-19 Kahaan Gandhi , Boris Bolliet , Inigo Zubeldia

We propose the inverse problem of Visual question answering (iVQA), and explore its suitability as a benchmark for visuo-linguistic understanding. The iVQA task is to generate a question that corresponds to a given image and answer pair.…

计算机视觉与模式识别 · 计算机科学 2018-03-19 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Visual Question Answering (VQA) is a challenging task of natural language processing (NLP) and computer vision (CV), attracting significant attention from researchers. English is a resource-rich language that has witnessed various…

计算与语言 · 计算机科学 2024-04-18 Ngan Luu-Thuy Nguyen , Nghia Hieu Nguyen , Duong T. D Vo , Khanh Quoc Tran , Kiet Van Nguyen

Reliable evaluation of AI models is critical for scientific progress and practical application. While existing VLM benchmarks provide general insights into model capabilities, their heterogeneous designs and limited focus on a few imaging…

Vision-Language Translation (VLT) is a challenging task that requires accurately recognizing multilingual text embedded in images and translating it into the target language with the support of visual context. While recent Large…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Xintong Wang , Jingheng Pan , Yixiao Liu , Xiaohu Zhao , Chenyang Lyu , Minghao Wu , Chris Biemann , Longyue Wang , Linlong Xu , Weihua Luo , Kaifu Zhang

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

计算与语言 · 计算机科学 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

计算机视觉与模式识别 · 计算机科学 2017-09-26 Supriya Pandhre , Shagun Sodhani

Recent innovations in multimodal action models represent a promising direction for developing general-purpose agentic systems, combining visual understanding, language comprehension, and action generation. We introduce MultiNet - a novel,…

机器学习 · 计算机科学 2025-06-18 Pranav Guruprasad , Yangyue Wang , Sudipta Chowdhury , Jaewoo Song , Harshvardhan Sikka

Existing benchmarks for Vision-Language Model (VLM) on autonomous driving (AD) primarily assess interpretability through open-form visual question answering (QA) within coarse-grained tasks, which remain insufficient to assess capabilities…

计算与语言 · 计算机科学 2025-03-28 Yue Li , Meng Tian , Zhenyu Lin , Jiangtong Zhu , Dechang Zhu , Haiqiang Liu , Zining Wang , Yueyi Zhang , Zhiwei Xiong , Xinhai Zhao