中文
相关论文

相关论文: Questions beyond Pixels: Integrating Commonsense K…

200 篇论文

Conversational recommender systems (CRSs) have revolutionized the conventional recommendation paradigm by embracing dialogue agents to dynamically capture the fine-grained user preference. In a typical conversational recommendation…

人工智能 · 计算机科学 2021-05-12 Xuhui Ren , Hongzhi Yin , Tong Chen , Hao Wang , Zi Huang , Kai Zheng

Recent developments in pre-trained neural language modeling have led to leaps in accuracy on commonsense question-answering benchmarks. However, there is increasing concern that models overfit to specific tasks, without learning to utilize…

计算与语言 · 计算机科学 2020-12-16 Kaixin Ma , Filip Ilievski , Jonathan Francis , Yonatan Bisk , Eric Nyberg , Alessandro Oltramari

This work aims to address the problem of image-based question-answering (QA) with new models and datasets. In our work, we propose to use neural networks and visual semantic embeddings, without intermediate stages such as object detection…

机器学习 · 计算机科学 2015-12-01 Mengye Ren , Ryan Kiros , Richard Zemel

In the field of computer graphics, the use of vector graphics, particularly Scalable Vector Graphics (SVG), represents a notable development from traditional pixel-based imagery. SVGs, with their XML-based format, are distinct in their…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Tong Zhang , Haoyang Liu , Peiyan Zhang , Yuxuan Cheng , Haohan Wang

We introduce the task of Image-Set Visual Question Answering (ISVQA), which generalizes the commonly studied single-image VQA problem to multi-image settings. Taking a natural language question and a set of images as input, it aims to…

计算机视觉与模式识别 · 计算机科学 2020-08-28 Ankan Bansal , Yuting Zhang , Rama Chellappa

Most existing research on visual question answering (VQA) is limited to information explicitly present in an image or a video. In this paper, we take visual understanding to a higher level where systems are challenged to answer questions…

计算机视觉与模式识别 · 计算机科学 2021-04-14 Shailaja Keyur Sampat , Akshay Kumar , Yezhou Yang , Chitta Baral

Visual question answering (VQA) has the potential to make the Internet more accessible in an interactive way, allowing people who cannot see images to ask questions about them. However, multiple studies have shown that people who are blind…

计算与语言 · 计算机科学 2023-08-31 Nandita Naik , Christopher Potts , Elisa Kreiss

This paper presents the ISRGC-Q Challenge, built upon the Image Super-Resolution Generated Content Quality Assessment (ISRGen-QA) dataset, and organized as part of the Visual Quality Assessment (VQualA) Competition at the ICCV 2025…

Visual commonsense reasoning task aims at leading the research field into solving cognition-level reasoning with the ability of predicting correct answers and meanwhile providing convincing reasoning paths, resulting in three sub-tasks…

计算机视觉与模式识别 · 计算机科学 2019-10-28 Weijiang Yu , Jingwen Zhou , Weihao Yu , Xiaodan Liang , Nong Xiao

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Param Ahir , Hiteishi M. Diwanji

Visual Question Answering (VQA) focuses on providing answers to natural language questions by utilizing information from images. Although cutting-edge multimodal large language models (MLLMs) such as GPT-4o achieve strong performance on VQA…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Zhengxuan Zhang , Yin Wu , Yuyu Luo , Nan Tang

The remarkable achievements of ChatGPT and GPT-4 have sparked a wave of interest and research in the field of large language models for Artificial General Intelligence (AGI). These models provide intelligent solutions close to human…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Xiang Li , Congcong Wen , Yuan Hu , Zhenghang Yuan , Xiao Xiang Zhu

Multi-modal Knowledge Graphs (MMKGs) have been widely applied across various domains for knowledge representation. However, the existing MMKGs are significantly fewer than required, and their construction faces numerous challenges,…

人工智能 · 计算机科学 2025-04-21 Yajing Xu , Zhiqiang Liu , Jiaoyan Chen , Mingchen Tu , Zhuo Chen , Jeff Z. Pan , Yichi Zhang , Yushan Zhu , Wen Zhang , Huajun Chen

We tackle the challenge of Visual Question Answering in multi-image setting for the ISVQA dataset. Traditional VQA tasks have focused on a single-image setting where the target answer is generated from a single image. Image set VQA,…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Abhinav Khattar , Aviral Joshi , Har Simrat Singh , Pulkit Goel , Rohit Prakash Barnwal

This paper focuses on analyzing and improving the commonsense ability of recent popular vision-language (VL) models. Despite the great success, we observe that existing VL-models still lack commonsense knowledge/reasoning ability (e.g.,…

计算机视觉与模式识别 · 计算机科学 2022-11-30 Shuquan Ye , Yujia Xie , Dongdong Chen , Yichong Xu , Lu Yuan , Chenguang Zhu , Jing Liao

Zero-shot visual question answering (ZS-VQA), an emerged critical research area, intends to answer visual questions without providing training samples. Existing research in ZS-VQA has proposed to leverage knowledge graphs or large language…

计算机视觉与模式识别 · 计算机科学 2025-01-23 Qian Tao , Xiaoyang Fan , Yong Xu , Xingquan Zhu , Yufei Tang

Humans apprehend the world through various sensory modalities, yet language is their predominant communication channel. Machine learning systems need to draw on the same multimodal richness to have informed discourses with humans in natural…

计算机视觉与模式识别 · 计算机科学 2022-08-25 Min Wang , Ata Mahjoubfar , Anupama Joshi

Recently, deep learning based methods have revolutionized remote sensing image segmentation. However, these methods usually rely on a pre-defined semantic class set, thus needing additional image annotation and model training when adapting…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Chengyang Ye , Yunzhi Zhuge , Pingping Zhang

Knowledge graph simple question answering (KGSQA), in its standard form, does not take into account that human-curated question answering training data only cover a small subset of the relations that exist in a Knowledge Graph (KG), or even…

计算与语言 · 计算机科学 2020-05-26 Georgios Sidiropoulos , Nikos Voskarides , Evangelos Kanoulas

Collaborative reasoning for understanding image-question pairs is a very critical but underexplored topic in interpretable visual question answering systems. Although very recent studies have attempted to use explicit compositional…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Qingxing Cao , Bailin Li , Xiaodan Liang , Liang Lin