English
Related papers

Related papers: MMM: Multi-stage Multi-task Learning for Multi-cho…

200 papers

Previous machine comprehension (MC) datasets are either too small to train end-to-end deep learning models, or not difficult enough to evaluate the ability of current MC techniques. The newly released SQuAD dataset alleviates these…

Computation and Language · Computer Science 2016-12-14 Zhiguo Wang , Haitao Mi , Wael Hamza , Radu Florian

Multimodal systems have great potential to assist humans in procedural activities, where people follow instructions to achieve their goals. Despite diverse application scenarios, systems are typically evaluated on traditional classification…

Computation and Language · Computer Science 2025-11-05 Kimihiro Hasegawa , Wiradee Imrattanatrai , Zhi-Qi Cheng , Masaki Asada , Susan Holm , Yuran Wang , Ken Fukuda , Teruko Mitamura

The widespread adoption of Large Language Models (LLMs) has become commonplace, particularly with the emergence of open-source models. More importantly, smaller models are well-suited for integration into consumer devices and are frequently…

Computation and Language · Computer Science 2024-08-16 Aisha Khatun , Daniel G. Brown

Understanding unstructured text is a major goal within natural language processing. Comprehension tests pose questions based on short text passages to evaluate such understanding. In this work, we investigate machine comprehension on the…

Computation and Language · Computer Science 2016-03-30 Adam Trischler , Zheng Ye , Xingdi Yuan , Jing He , Phillip Bachman , Kaheer Suleman

Video question answering (VideoQA) is challenging given its multimodal combination of visual understanding and natural language processing. While most existing approaches ignore the visual appearance-motion information at different temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Min Peng , Chongyang Wang , Yuan Gao , Yu Shi , Xiang-Dong Zhou

The Mental Health Question Answer (MHQA) task requires the seeker and supporter to complete the support process in one-turn dialogue. Given the richness of help-seeker posts, supporters must thoroughly understand the content and provide…

Computation and Language · Computer Science 2025-01-28 Qi Chen , Dexi Liu

Multi-choice Machine Reading Comprehension (MRC) is a major and challenging task for machines to answer questions according to provided options. Answers in multi-choice MRC cannot be directly extracted in the given passages, and essentially…

Computation and Language · Computer Science 2023-10-30 Yilin Zhao , Hai Zhao , Sufeng Duan

Multimedia or spoken content presents more attractive information than plain text content, but the former is more difficult to display on a screen and be selected by a user. As a result, accessing large collections of the former is much…

Computation and Language · Computer Science 2017-01-03 Wei Fang , Jui-Yang Hsu , Hung-yi Lee , Lin-Shan Lee

Machine comprehension (MC), answering a query about a given context paragraph, requires modeling complex interactions between the context and the query. Recently, attention mechanisms have been successfully extended to MC. Typically these…

Computation and Language · Computer Science 2018-06-22 Minjoon Seo , Aniruddha Kembhavi , Ali Farhadi , Hannaneh Hajishirzi

Machine reading comprehension (MRC) has received considerable attention as a benchmark for natural language understanding. However, the conventional task design of MRC lacks explainability beyond the model interpretation, i.e., reading…

Computation and Language · Computer Science 2021-01-27 Saku Sugawara , Pontus Stenetorp , Akiko Aizawa

Visual Question Answering (VQA) requires reasoning across visual and textual modalities, yet Large Vision-Language Models (LVLMs) often lack integrated commonsense knowledge, limiting their robustness in real-world scenarios. To address…

Computation and Language · Computer Science 2025-06-12 Shuo Yang , Siwen Luo , Soyeon Caren Han , Eduard Hovy

Artificial intelligence (AI) is transforming society, making it crucial to prepare the next generation through AI literacy in K-12 education. However, scalable and reliable AI literacy materials and assessment resources are lacking. To…

Human-Computer Interaction · Computer Science 2024-12-03 Jiayi Wang , Ruiwei Xiao , Ying-Jui Tseng

Understanding open-domain text is one of the primary challenges in natural language processing (NLP). Machine comprehension benchmarks evaluate the system's ability to understand text based on the text content only. In this work, we…

Computation and Language · Computer Science 2016-02-16 Wenpeng Yin , Sebastian Ebert , Hinrich Schütze

We propose a machine reading comprehension model based on the compare-aggregate framework with two-staged attention that achieves state-of-the-art results on the MovieQA question answering dataset. To investigate the limitations of our…

Computation and Language · Computer Science 2018-08-28 Matthias Blohm , Glorianna Jagfeld , Ekta Sood , Xiang Yu , Ngoc Thang Vu

Humans observe and interact with the world to acquire knowledge. However, most existing machine reading comprehension (MRC) tasks miss the interactive, information-seeking component of comprehension. Such tasks present models with static…

Computation and Language · Computer Science 2019-08-30 Xingdi Yuan , Marc-Alexandre Cote , Jie Fu , Zhouhan Lin , Christopher Pal , Yoshua Bengio , Adam Trischler

Multiple choice question answering (MCQA) is popular for LLM evaluation due to its simplicity and human-like testing, but we argue for its reform. We first reveal flaws in MCQA's format, as it struggles to: 1) test generation/subjectivity;…

Computation and Language · Computer Science 2025-06-03 Nishant Balepur , Rachel Rudinger , Jordan Lee Boyd-Graber

Multiple-choice questions (MCQs) are widely used in the evaluation of large language models (LLMs) due to their simplicity and efficiency. However, there are concerns about whether MCQs can truly measure LLM's capabilities, particularly in…

Computation and Language · Computer Science 2024-05-24 Wangyue Li , Liangzhi Li , Tong Xiang , Xiao Liu , Wei Deng , Noa Garcia

Recent studies on machine reading comprehension have focused on text-level understanding but have not yet reached the level of human understanding of the visual layout and content of real-world documents. In this study, we introduce a new…

Computation and Language · Computer Science 2021-05-11 Ryota Tanaka , Kyosuke Nishida , Sen Yoshida

This study aims at solving the Machine Reading Comprehension problem where questions have to be answered given a context passage. The challenge is to develop a computationally faster model which will have improved inference time. State of…

Computation and Language · Computer Science 2019-04-02 Debajyoti Chatterjee

Multiple-choice Reading Comprehension (MCRC) models aim to select the correct answer from a set of candidate options for a given question. However, they typically lack the ability to explain the reasoning behind their choices. In this…

Computation and Language · Computer Science 2026-03-02 Trung Tien Cao , Lam Minh Thai , Nghia Hieu Nguyen , Duc-Vu Nguyen , Ngan Luu-Thuy Nguyen