English
Related papers

Related papers: Document Understanding Dataset and Evaluation (DUD…

200 papers

Multimodal Large Language Models (MLLMs) can directly consume exam documents, threatening conventional assessments and academic integrity. We present DoPE (Decoy-Oriented Perturbation Encapsulation), a document-layer defense framework that…

Computation and Language · Computer Science 2026-01-21 Ashish Raj Shekhar , Shiven Agarwal , Priyanuj Bordoloi , Yash Shah , Tejas Anvekar , Vivek Gupta

Document layout analysis is a crucial prerequisite for document understanding, including document retrieval and conversion. Most public datasets currently contain only PDF documents and lack realistic documents. Models trained on these…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Hiuyi Cheng , Peirong Zhang , Sihang Wu , Jiaxin Zhang , Qiyuan Zhu , Zecheng Xie , Jing Li , Kai Ding , Lianwen Jin

As LLMs are globally deployed, aligning their cultural value orientations is critical for safety and user engagement. However, existing benchmarks face the Construct-Composition-Context ($C^3$) challenge: relying on discriminative,…

Computation and Language · Computer Science 2026-04-10 Jaehyeok Lee , Xiaoyuan Yi , Jing Yao , Hyunjin Hwang , Roy Ka-Wei Lee , Xing Xie , JinYeong Bak

Expanding visual categorization into a novel domain without the need of extra annotation has been a long-term interest for multimedia intelligence. Previously, this challenge has been approached by unsupervised domain adaptation (UDA).…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jie Wang , Kaibin Tian , Dayong Ding , Gang Yang , Xirong Li

Comprehending long visual documents, where information is distributed across extensive pages of text and visual elements, is a critical but challenging task for modern Vision-Language Models (VLMs). Existing approaches falter on a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Dawei Zhu , Rui Meng , Jiefeng Chen , Sujian Li , Tomas Pfister , Jinsung Yoon

Vietnamese document analysis and recognition (DAR) is a crucial field with applications in digitization, information retrieval, and automation. Despite advancements in OCR and NLP, Vietnamese text recognition faces unique challenges due to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Anh Le , Thanh Lam , Dung Nguyen

Multimodal pre-training with text, layout, and image has made significant progress for Visually Rich Document Understanding (VRDU), especially the fixed-layout documents such as scanned document images. While, there are still a large number…

Computation and Language · Computer Science 2022-03-14 Junlong Li , Yiheng Xu , Lei Cui , Furu Wei

The recognition of named entities in visually-rich documents (VrD-NER) plays a critical role in various real-world scenarios and applications. However, the research in VrD-NER faces three major challenges: complex document layouts,…

Computation and Language · Computer Science 2024-08-13 Yi Tu , Chong Zhang , Ya Guo , Huan Chen , Jinyang Tang , Huijia Zhu , Qi Zhang

Before developing a Document Layout Analysis (DLA) model in real-world applications, conducting comprehensive robustness testing is essential. However, the robustness of DLA models remains underexplored in the literature. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yufan Chen , Jiaming Zhang , Kunyu Peng , Junwei Zheng , Ruiping Liu , Philip Torr , Rainer Stiefelhagen

Although deep neural networks have made remarkable achievements in the field of automatic modulation recognition (AMR), these models often require a large amount of labeled data for training. However, in many practical scenarios, the…

Machine Learning · Computer Science 2025-07-17 Yao Lu , Hongyu Gao , Zhuangzhi Chen , Dongwei Xu , Yun Lin , Qi Xuan , Guan Gui

Deep language models learning a hierarchical representation proved to be a powerful tool for natural language processing, text mining and information retrieval. However, representations that perform well for retrieval must capture semantic…

Information Retrieval · Computer Science 2019-05-24 Tolgahan Cakaloglu , Xiaowei Xu

The development of Urdu scene text detection, recognition, and Visual Question Answering (VQA) technologies is crucial for advancing accessibility, information retrieval, and linguistic diversity in digital content, facilitating better…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hiba Maryam , Ling Fu , Jiajun Song , Tajrian ABM Shafayet , Qidi Luo , Xiang Bai , Yuliang Liu

Autonomous vehicle (AV) systems rely on robust perception models as a cornerstone of safety assurance. However, objects encountered on the road exhibit a long-tailed distribution, with rare or unseen categories posing challenges to a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mingfu Liang , Jong-Chyi Su , Samuel Schulter , Sparsh Garg , Shiyu Zhao , Ying Wu , Manmohan Chandraker

Transforming documents into machine-processable representations is a challenging task due to their complex structures and variability in formats. Recovering the layout structure and content from PDF files or scanned material has remained a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Christoph Auer , Ahmed Nassar , Maksym Lysak , Michele Dolfi , Nikolaos Livathinos , Peter Staar

Document AI has advanced rapidly and is attracting increasing attention. Yet, while most efforts have focused on document layout analysis (DLA), its generative counterpart, layout generation, remains underexplored. Distinct from traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Hengrui Kang , Zhuangcheng Gu , Zhiyuan Zhao , Zichen Wen , Bin Wang , Weijia Li , Conghui He

Document AI is a growing research field that focuses on the comprehension and extraction of information from scanned and digital documents to make everyday business operations more efficient. Numerous downstream tasks and datasets have been…

Computation and Language · Computer Science 2024-01-29 Ahmed Masry , Amir Hajian

Clinical diagnosis is a highly specialized discipline requiring both domain expertise and strict adherence to rigorous guidelines. While current AI-driven medical research predominantly focuses on knowledge graphs or natural text…

Machine Learning · Computer Science 2025-12-12 Haolin Li , Tianjie Dai , Zhe Chen , Siyuan Du , Jiangchao Yao , Ya Zhang , Yanfeng Wang

With over 200 million published academic documents and millions of new documents being written each year, academic researchers face the challenge of searching for information within this vast corpus. However, existing retrieval systems…

Information Retrieval · Computer Science 2024-05-21 Gengchen Wei , Xinle Pang , Tianning Zhang , Yu Sun , Xun Qian , Chen Lin , Han-Sen Zhong , Wanli Ouyang

Text discourse parsing weighs importantly in understanding information flow and argumentative structure in natural language, making it beneficial for downstream tasks. While previous work significantly improves the performance of RST…

Computation and Language · Computer Science 2021-10-12 Zhengyuan Liu , Ke Shi , Nancy F. Chen

Recently, a new paradigm called Differentiable Search Index (DSI) has been proposed for document retrieval, wherein a sequence-to-sequence model is learned to directly map queries to relevant document identifiers. The key idea behind DSI is…

Information Retrieval · Computer Science 2023-05-25 Yubao Tang , Ruqing Zhang , Jiafeng Guo , Jiangui Chen , Zuowei Zhu , Shuaiqiang Wang , Dawei Yin , Xueqi Cheng