English
Related papers

Related papers: R3: A Reading Comprehension Benchmark Requiring Re…

200 papers

Large-scale, pre-trained language models (LMs) have achieved human-level performance on a breadth of language understanding tasks. However, evaluations only based on end task performance shed little light on machines' true ability in…

Computation and Language · Computer Science 2022-05-11 Shane Storks , Qiaozi Gao , Yichi Zhang , Joyce Chai

Semantic Role Labeling (SRL) aims at recognizing the predicate-argument structure of a sentence and can be decomposed into two subtasks: predicate disambiguation and argument labeling. Prior work deals with these two tasks independently,…

Computation and Language · Computer Science 2022-09-07 Nan Wang , Jiwei Li , Yuxian Meng , Xiaofei Sun , Han Qiu , Ziyao Wang , Guoyin Wang , Jun He

This paper presents a semantic parsing approach for unrestricted texts. Semantic parsing is one of the major bottlenecks of Natural Language Understanding (NLU) systems and usually requires building expensive resources not easily portable…

Computation and Language · Computer Science 2007-05-23 Jordi Atserias , Irene Castellon , Montse Civit , German Rigau

In recent years, text-aware collaborative filtering methods have been proposed to address essential challenges in recommendations such as data sparsity, cold start problem, and long-tail distribution. However, many of these text-oriented…

Information Retrieval · Computer Science 2020-09-01 Zhimeng Pan , Wenzheng Tao , Qingyao Ai

Understanding how events are semantically related to each other is the essence of reading comprehension. Recent event-centric reading comprehension datasets focus mostly on event arguments or temporal relations. While these tasks partially…

Computation and Language · Computer Science 2021-09-14 Rujun Han , I-Hung Hsu , Jiao Sun , Julia Baylon , Qiang Ning , Dan Roth , Nanyun Peng

Open-retrieval conversational machine reading comprehension (OCMRC) simulates real-life conversational interaction scenes. Machines are required to make a decision of "Yes/No/Inquire" or generate a follow-up question when the decision is…

Computation and Language · Computer Science 2022-12-20 Xiao Zhang , Heyan Huang , Zewen Chi , Xian-Ling Mao

The multi-answer phenomenon, where a question may have multiple answers scattered in the document, can be well handled by humans but is challenging enough for machine reading comprehension (MRC) systems. Despite recent progress in…

Computation and Language · Computer Science 2023-06-02 Chen Zhang , Jiuheng Lin , Xiao Liu , Yuxuan Lai , Yansong Feng , Dongyan Zhao

A challenge in creating a dataset for machine reading comprehension (MRC) is to collect questions that require a sophisticated understanding of language to answer beyond using superficial cues. In this work, we investigate what makes…

Computation and Language · Computer Science 2018-08-29 Saku Sugawara , Kentaro Inui , Satoshi Sekine , Akiko Aizawa

While there is increasing concern about the interpretability of neural models, the evaluation of interpretability remains an open problem, due to the lack of proper evaluation datasets and metrics. In this paper, we present a novel…

Computation and Language · Computer Science 2022-11-16 Lijie Wang , Yaozong Shen , Shuyuan Peng , Shuai Zhang , Xinyan Xiao , Hao Liu , Hongxuan Tang , Ying Chen , Hua Wu , Haifeng Wang

Large reasoning models (LRMs) generate complex reasoning traces with planning, reflection, verification, and backtracking. In this work, we introduce ReasoningFlow, a unified schema for analyzing the semantic structures of these complex…

Computation and Language · Computer Science 2025-06-04 Jinu Lee , Sagnik Mukherjee , Dilek Hakkani-Tur , Julia Hockenmaier

Understanding research papers remains challenging for foundation models due to specialized scientific discourse and complex figures and tables, yet existing benchmarks offer limited fine-grained evaluation at scale. To address this gap, we…

Computation and Language · Computer Science 2026-05-01 Yelin Chen , Fanjin Zhang , Suping Sun , Yunhe Pang , Yuanchun Wang , Jian Song , Xiaoyan Li , Lei Hou , Shu Zhao , Jie Tang , Juanzi Li

Deep text understanding, which requires the connections between a given document and prior knowledge beyond its text, has been highlighted by many benchmarks in recent years. However, these benchmarks have encountered two major limitations.…

Computation and Language · Computer Science 2023-07-07 Zijun Yao , Yantao Liu , Xin Lv , Shulin Cao , Jifan Yu , Lei Hou , Juanzi Li

Recent advances in Large Reasoning Models (LRMs), particularly those leveraging Chain-of-Thought reasoning (CoT), have opened brand new possibility for Machine Translation (MT). This position paper argues that LRMs substantially transformed…

Computation and Language · Computer Science 2025-03-17 Sinuo Liu , Chenyang Lyu , Minghao Wu , Longyue Wang , Weihua Luo , Kaifu Zhang , Zifu Shang

The growing prevalence of tampered images poses serious security threats, highlighting the urgent need for reliable detection methods. Multimodal large language models (MLLMs) demonstrate strong potential in analyzing tampered images and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Chenfan Qu , Yiwu Zhong , Jian Liu , Xuekang Zhu , Bohan Yu , Lianwen Jin

This paper explores the system 1 thinking capability of Large Reasoning Models (LRMs), the intuitive ability to respond efficiently with minimal token usage. While existing LRMs rely on long-chain reasoning and excel at complex tasks, their…

Computation and Language · Computer Science 2026-05-04 Wenyuan Zhang , Shuaiyi Nie , Xinghua Zhang , Zefeng Zhang , Tingwen Liu

The recent work of Clark et al. introduces the AI2 Reasoning Challenge (ARC) and the associated ARC dataset that partitions open domain, complex science questions into an Easy Set and a Challenge Set. That paper includes an analysis of 100…

Language models (LMs) are said to be exhibiting reasoning, but what does this entail? We assess definitions of reasoning and how key papers in the field of natural language processing (NLP) use the notion and argue that the definitions…

Computation and Language · Computer Science 2025-11-18 Bertram Højer

Meaning Representations (AMRs) are broad-coverage sentence-level semantic graphs. Existing approaches to generating text from AMR have focused on training sequence-to-sequence or graph-to-sequence models on AMR annotated data only. In this…

Computation and Language · Computer Science 2020-05-28 Manuel Mager , Ramon Fernandez Astudillo , Tahira Naseem , Md Arafat Sultan , Young-Suk Lee , Radu Florian , Salim Roukos

Pre-trained language models achieves high performance on machine reading comprehension (MRC) tasks but the results are hard to explain. An appealing approach to make models explainable is to provide rationales for its decision. To…

Computation and Language · Computer Science 2022-03-25 Jiajie Zou , Yuran Zhang , Peiqing Jin , Cheng Luo , Xunyi Pan , Nai Ding

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang