English
Related papers

Related papers: Did the Models Understand Documents? Benchmarking …

200 papers

Towards real-world information extraction scenario, research of relation extraction is advancing to document-level relation extraction(DocRE). Existing approaches for DocRE aim to extract relation by encoding various information sources in…

Computation and Language · Computer Science 2022-05-24 Yangkai Du , Tengfei Ma , Lingfei Wu , Yiming Wu , Xuhong Zhang , Bo Long , Shouling Ji

Document Understanding is a foundational AI capability with broad applications, and Document Question Answering (DocQA) is a key evaluation task. Traditional methods convert the document into text for processing by Large Language Models…

Computation and Language · Computer Science 2025-09-10 Xixi Wu , Yanchao Tan , Nan Hou , Ruiyang Zhang , Hong Cheng

A distinction is often drawn between a model's ability to predict a label for an evaluation sample that is directly memorised from highly similar training samples versus an ability to predict the label via some method of generalisation. In…

Computation and Language · Computer Science 2023-11-22 Tim Hartill , Joshua Bensemann , Michael Witbrock , Patricia J. Riddle

Relation extraction (RE) involves identifying the relations between entities from underlying content. RE serves as the foundation for many natural language processing (NLP) and information retrieval applications, such as knowledge graph…

Computation and Language · Computer Science 2024-06-25 Xiaoyan Zhao , Yang Deng , Min Yang , Lingzhi Wang , Rui Zhang , Hong Cheng , Wai Lam , Ying Shen , Ruifeng Xu

Despite the superior performance of Large Reasoning Models (LRMs), their reasoning behaviors are often counterintuitive, leading to suboptimal reasoning capabilities. To theoretically formalize the desired reasoning behaviors, this paper…

Artificial Intelligence · Computer Science 2025-12-22 Junyu Zhang , Yifan Sun , Tianang Leng , Jingyan Shen , Liu Ziyin , Paul Pu Liang , Huan Zhang

Along with the successful deployment of deep neural networks in several application domains, the need to unravel the black-box nature of these networks has seen a significant increase recently. Several methods have been introduced to…

Machine Learning · Computer Science 2023-07-06 Adam Ivankay , Mattia Rigotti , Pascal Frossard

Dialogue relation extraction (DRE) aims to extract relations between two arguments within a dialogue, which is more challenging than standard RE due to the higher person pronoun frequency and lower information density in dialogues. However,…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Zijie Xu , Ziyu Shang , Jiajun Liu , Ke Ji , Yikai Guo

Document-level relation extraction aims to categorize the association between any two entities within a document. We find that previous methods for document-level relation extraction are ineffective in exploiting the full potential of large…

Computation and Language · Computer Science 2024-06-11 Chufan Gao , Xuan Wang , Jimeng Sun

Relation extraction (RE) has recently moved from the sentence-level to document-level, which requires aggregating document information and using entities and mentions for reasoning. Existing works put entity nodes and mention nodes with…

Computation and Language · Computer Science 2023-03-08 Hongfei Liu , Zhao Kang , Lizong Zhang , Ling Tian , Fujun Hua

Reasoning has emerged as the next major frontier for language models (LMs), with rapid advances from both academic and industrial labs. However, this progress often outpaces methodological rigor, with many evaluations relying on…

Machine Learning · Computer Science 2025-10-08 Andreas Hochlehnert , Hardik Bhatnagar , Vishaal Udandarao , Samuel Albanie , Ameya Prabhu , Matthias Bethge

Most existing multi-document machine reading comprehension models mainly focus on understanding the interactions between the input question and documents, but ignore following two kinds of understandings. First, to understand the semantic…

Computation and Language · Computer Science 2022-04-08 Feiliang Ren , Yongkang Liu , Bochao Li , Zhibo Wang , Yu Guo , Shilei Liu , Huimin Wu , Jiaqi Wang , Chunchao Liu , Bingchao Wang

The automated extraction of structured questions from paper-based mathematics exams is fundamental to intelligent education, yet remains challenging in real-world settings due to severe visual noise. Existing benchmarks mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Chenyue Zhou , Jiayi Tuo , Shitong Qin , Wei Dai , Mingxuan Wang , Ziwei Zhao , Duoyang Li , Shiyang Su , Yanxi Lu , Yanbiao Ma

The adoption of machine learning in high-stakes applications such as healthcare and law has lagged in part because predictions are not accompanied by explanations comprehensible to the domain user, who often holds the ultimate…

Extracting structured information from unstructured text is critical for many downstream NLP applications and is traditionally achieved by closed information extraction (cIE). However, existing approaches for cIE suffer from two…

Computation and Language · Computer Science 2024-04-22 Nacime Bouziani , Shubhi Tyagi , Joseph Fisher , Jens Lehmann , Andrea Pierleoni

Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large-scale corpora does benefit MRC, the poor support…

Computation and Language · Computer Science 2021-05-19 Fangkai Jiao , Yangyang Guo , Yilin Niu , Feng Ji , Feng-Lin Li , Liqiang Nie

Dense Retrieval (DR) models have proven to be effective for Document Retrieval and Information Grounding tasks. Usually, these models are trained and optimized for improving the relevance of top-ranked documents for a given query. Previous…

Information Retrieval · Computer Science 2025-08-12 Stefano Campese , Alessandro Moschitti , Ivano Lauriola

Documents are a core part of many businesses in many fields such as law, finance, and technology among others. Automatic understanding of documents such as invoices, contracts, and resumes is lucrative, opening up many new avenues of…

Computation and Language · Computer Science 2021-02-08 Nishant Subramani , Alexandre Matton , Malcolm Greaves , Adrian Lam

Explainability has become a crucial concern in today's world, aiming to enhance transparency in machine learning and deep learning models. Information retrieval is no exception to this trend. In existing literature on explainability of…

Information Retrieval · Computer Science 2026-04-15 Bhavik Chandna , Procheta Sen

Machine translation (MT) is an important task in natural language processing (NLP) as it automates the translation process and reduces the reliance on human translators. With the resurgence of neural networks, the translation quality…

Computation and Language · Computer Science 2021-01-14 Sameen Maruf , Fahimeh Saleh , Gholamreza Haffari

Language Models and Vision Language Models have recently demonstrated unprecedented capabilities in terms of understanding human intentions, reasoning, scene understanding, and planning-like behaviour, in text form, among many others. In…