English
Related papers

Related papers: End-to-End Video Question-Answer Generation with G…

200 papers

Creating multiple-choice questions to assess reading comprehension of a given article involves generating question-answer pairs (QAPs) and adequate distractors. We present two methods to tackle the challenge of QAP generations: (1) A…

Computation and Language · Computer Science 2023-03-28 Cheng Zhang

Automatic question generation is an important technique that can improve the training of question answering, help chatbots to start or continue a conversation with humans, and provide assessment materials for educational purposes. Existing…

Computation and Language · Computer Science 2019-02-28 Bang Liu , Mingjun Zhao , Di Niu , Kunfeng Lai , Yancheng He , Haojie Wei , Yu Xu

Automatic question generation (QG) is a useful yet challenging task in NLP. Recent neural network-based approaches represent the state-of-the-art in this task. In this work, we attempt to strengthen them significantly by adopting a holistic…

Computation and Language · Computer Science 2019-09-17 Vishwajeet Kumar , Ganesh Ramakrishnan , Yuan-Fang Li

Existing question answering (QA) systems owe much of their success to large, high-quality training data. Such annotation efforts are costly, and the difficulty compounds in the cross-lingual setting. Therefore, prior cross-lingual QA work…

Computation and Language · Computer Science 2023-10-18 Bryan Li , Chris Callison-Burch

Answering visual questions need acquire daily common knowledge and model the semantic connection among different parts in images, which is too difficult for VQA systems to learn from images with the only supervision from answers. Meanwhile,…

Computation and Language · Computer Science 2018-05-23 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

Video Question Answering (VideoQA) is a task that requires a model to analyze and understand both the visual content given by the input video and the textual part given by the question, and the interaction between them in order to produce a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Alex Falcon , Oswald Lanz , Giuseppe Serra

Visual Question Answering (VQA) has attracted attention from both computer vision and natural language processing communities. Most existing approaches adopt the pipeline of representing an image via pre-trained CNNs, and then using the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Qing Li , Jianlong Fu , Dongfei Yu , Tao Mei , Jiebo Luo

Visual Question Generation (VQG) is a task to generate questions from images. When humans ask questions about an image, their goal is often to acquire some new knowledge. However, existing studies on VQG have mainly addressed question…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Kohei Uehara , Tatsuya Harada

The development of Automatic Question Generation (QG) models has the potential to significantly improve educational practices by reducing the teacher workload associated with creating educational content. This paper introduces a novel…

Computers and Society · Computer Science 2025-01-10 Ziqing Li , Mutlu Cukurova , Sahan Bulathwela

Recent advances in text-to-video (T2V) generation highlight the critical role of high-quality video-text pairs in training models capable of producing coherent and instruction-aligned videos. However, strategies for optimizing video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Yang Du , Zhuoran Lin , Kaiqiang Song , Biao Wang , Zhicheng Zheng , Tiezheng Ge , Bo Zheng , Qin Jin

We propose a new two-stage pre-training framework for video-to-text generation tasks such as video captioning and video question answering: A generative encoder-decoder model is first jointly pre-trained on massive image-text data to learn…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Xilun Chen , Lili Yu , Wenhan Xiong , Barlas Oğuz , Yashar Mehdad , Wen-tau Yih

Growing interest in conversational agents promote twoway human-computer communications involving asking and answering visual questions have become an active area of research in AI. Thus, generation of visual questionanswer pair(s) becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Charani Alampalle , Shamanthak Hegde , Soumya Jahagirdar , Shankar Gangisetty

Video Question Answering (VideoQA) aims to answer natural language questions according to the given videos. It has earned increasing attention with recent research trends in joint vision and language understanding. Yet, compared with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Yaoyao Zhong , Junbin Xiao , Wei Ji , Yicong Li , Weihong Deng , Tat-Seng Chua

Text-VQA aims at answering questions that require understanding the textual cues in an image. Despite the great progress of existing Text-VQA methods, their performance suffers from insufficient human-labeled question-answer (QA) pairs.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jun Wang , Mingfei Gao , Yuqian Hu , Ramprasaath R. Selvaraju , Chetan Ramaiah , Ran Xu , Joseph F. JaJa , Larry S. Davis

Document-based Visual Question Answering poses a challenging task between linguistic sense disambiguation and fine-grained multimodal retrieval. Although there has been encouraging progress in document-based question answering due to the…

Computation and Language · Computer Science 2023-10-20 Jieting Long , Zewei Shi , Penghao Jiang , Yidong Gan

Due to the rapid emergence of short videos and the requirement for content understanding and creation, the video captioning task has received increasing attention in recent years. In this paper, we convert traditional video captioning task…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Ziqi Zhang , Zhongang Qi , Chunfeng Yuan , Ying Shan , Bing Li , Ying Deng , Weiming Hu

Multi-hop question generation (MQG) aims to generate complex questions which require reasoning over multiple pieces of information of the input passage. Most existing work on MQG has focused on exploring graph-based networks to equip the…

Computation and Language · Computer Science 2022-02-15 Dan Su , Peng Xu , Pascale Fung

Deep neural networks facilitate video question answering (VideoQA), but the real-world applications on video streams such as CCTV and live cast place higher demands on the solver. To address the challenges of VideoQA on long videos of…

Multimedia · Computer Science 2023-03-08 Weikai Kong , Shuhong Ye , Chenglin Yao , Jianfeng Ren

A number of visual question answering approaches have been proposed recently, aiming at understanding the visual scenes by answering the natural language questions. While the image question answering has drawn significant attention, video…

Computer Vision and Pattern Recognition · Computer Science 2017-05-04 Hongyang Xue , Zhou Zhao , Deng Cai

While exam-style questions are a fundamental educational tool serving a variety of purposes, manual construction of questions is a complex process that requires training, experience and resources. Automatic question generation (QG)…

Machine Learning · Computer Science 2022-04-08 Fatih Cagatay Akyon , Devrim Cavusoglu , Cemil Cengiz , Sinan Onur Altinuc , Alptekin Temizel