English
Related papers

Related papers: ORB: An Open Reading Benchmark for Comprehensive E…

200 papers

Multiple-choice reading comprehension (MCRC) is the task of selecting the correct answer from multiple options given a question and an article. Existing MCRC models typically either read each option independently or compute a fixed-length…

Computation and Language · Computer Science 2019-03-08 Qiu Ran , Peng Li , Weiwei Hu , Jie Zhou

Performance of NLP systems is typically evaluated by collecting a large-scale dataset by means of crowd-sourcing to train a data-driven model and evaluate it on a held-out portion of the data. This approach has been shown to suffer from…

Computation and Language · Computer Science 2024-08-12 Viktor Schlegel , Goran Nenadic , Riza Batista-Navarro

Many tasks aim to measure machine reading comprehension (MRC), often focusing on question types presumed to be difficult. Rarely, however, do task designers start by considering what systems should in fact comprehend. In this paper we make…

Computation and Language · Computer Science 2020-05-12 Jesse Dunietz , Gregory Burnham , Akash Bharadwaj , Owen Rambow , Jennifer Chu-Carroll , David Ferrucci

Recent studies on machine reading comprehension have focused on text-level understanding but have not yet reached the level of human understanding of the visual layout and content of real-world documents. In this study, we introduce a new…

Computation and Language · Computer Science 2021-05-11 Ryota Tanaka , Kyosuke Nishida , Sen Yoshida

Comprehending meaning from natural language is a primary objective of Natural Language Processing (NLP), and text comprehension is the cornerstone for achieving this objective upon which all other problems like chat bots, language…

Computation and Language · Computer Science 2018-03-06 Long-Huei Chen , Kshitiz Tripathi

Vision-Language Translation (VLT) is a challenging task that requires accurately recognizing multilingual text embedded in images and translating it into the target language with the support of visual context. While recent Large…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Xintong Wang , Jingheng Pan , Yixiao Liu , Xiaohu Zhao , Chenyang Lyu , Minghao Wu , Chris Biemann , Longyue Wang , Linlong Xu , Weihua Luo , Kaifu Zhang

With the rapid development of large language models (LLMs), the applications of LLMs have grown substantially. In the education domain, LLMs demonstrate significant potential, particularly in automatic text generation, which enables the…

Computation and Language · Computer Science 2025-11-25 Xingyu Huang , Fei Jiang , Jianli Xiao

Automated scoring of open-ended student responses has the potential to significantly reduce human grader effort. Recent advances in automated scoring often leverage textual representations based on pre-trained language models such as BERT…

Machine Learning · Computer Science 2023-06-16 Nigel Fernandez , Aritra Ghosh , Naiming Liu , Zichao Wang , Benoît Choffin , Richard Baraniuk , Andrew Lan

Despite recent work in Reading Comprehension (RC), progress has been mostly limited to English due to the lack of large-scale datasets in other languages. In this work, we introduce the first RC system for languages without RC training…

Computation and Language · Computer Science 2018-11-06 Akari Asai , Akiko Eriguchi , Kazuma Hashimoto , Yoshimasa Tsuruoka

The ability to identify whether or not a test sample belongs to one of the semantic classes in a classifier's training set is critical to practical deployment of the model. This task is termed open-set recognition (OSR) and has received…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Sagar Vaze , Kai Han , Andrea Vedaldi , Andrew Zisserman

Machine reading comprehension (MRC) is a crucial task in natural language processing and has achieved remarkable advancements. However, most of the neural MRC models are still far from robust and fail to generalize well in real-world…

Computation and Language · Computer Science 2021-07-22 Hongxuan Tang , Hongyu Li , Jing Liu , Yu Hong , Hua Wu , Haifeng Wang

Multimedia or spoken content presents more attractive information than plain text content, but it's more difficult to display on a screen and be selected by a user. As a result, accessing large collections of the former is much more…

Computation and Language · Computer Science 2016-08-24 Bo-Hsiang Tseng , Sheng-Syun Shen , Hung-Yi Lee , Lin-Shan Lee

Reading comprehension, a fundamental cognitive ability essential for knowledge acquisition, is a complex skill, with a notable number of learners lacking proficiency in this domain. This study introduces innovative tasks for Brain-Computer…

Human-Computer Interaction · Computer Science 2024-01-30 Yuhong Zhang , Shilai Yang , Gert Cauwenberghs , Tzyy-Ping Jung

Object recognition is among the fundamental tasks in the computer vision applications, paving the path for all other image understanding operations. In every stage of progress in object recognition research, efforts have been made to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Aria Salari , Abtin Djavadifar , Xiangrui Liu , Homayoun Najjaran

Achieving human-level performance on some of the Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, the internal mechanism of these artifacts remains…

Computation and Language · Computer Science 2024-10-29 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhigang Chen , Shijin Wang

Textual Question Answering (QA) aims to provide precise answers to user's questions in natural language using unstructured data. One of the most popular approaches to this goal is machine reading comprehension(MRC). In recent years, many…

Computation and Language · Computer Science 2022-02-07 Yang Bai , Daisy Zhe Wang

Multilingual OCR and information extraction from receipts remains challenging, particularly for complex scripts like Arabic. We introduce \dataset, a comprehensive dataset designed for Arabic-English receipt understanding comprising 20,000…

Machine Reading Comprehension (MRC) is an important testbed for evaluating models' natural language understanding (NLU) ability. There has been rapid progress in this area, with new models achieving impressive performance on various…

Computation and Language · Computer Science 2021-05-27 Chenglei Si , Ziqing Yang , Yiming Cui , Wentao Ma , Ting Liu , Shijin Wang

The rapid advancement of large vision-language models (LVLMs) has significantly propelled applications in document understanding, particularly in optical character recognition (OCR) and multilingual translation. However, current evaluations…

Machine Learning · Computer Science 2025-05-20 Zhanglin Wu , Tengfei Song , Ning Xie , Mengli Zhu , Weidong Zhang , Shuang Wu , Pengfei Li , Chong Li , Junhao Zhu , Hao Yang , Shiliang Sun

Large Language Models (LLMs) have demonstrated remarkable performance on various quantitative reasoning and knowledge benchmarks. However, many of these benchmarks are losing utility as LLMs get increasingly high scores, despite not yet…