English
Related papers

Related papers: IndicDLP: A Foundational Dataset for Multi-Lingual…

200 papers

We introduce COMI-LINGUA, the largest manually annotated Hindi-English code-mixed dataset, comprising 125K+ high-quality instances across five core NLP tasks: Matrix Language Identification, Token-level Language Identification,…

Computation and Language · Computer Science 2025-09-18 Rajvee Sheth , Himanshu Beniwal , Mayank Singh

Natural language inference (NLI) is formulated as a unified framework for solving various NLP problems such as relation extraction, question answering, summarization, etc. It has been studied intensively in the past few years thanks to the…

Computation and Language · Computer Science 2021-06-18 Wenpeng Yin , Dragomir Radev , Caiming Xiong

Most existing medical dialogue systems operate in a single-turn question--answering paradigm or rely on template-based datasets, limiting conversational realism and multilingual applicability. We introduce IndicMedDialog, a parallel…

Computation and Language · Computer Science 2026-05-14 Shubham Kumar Nigam , Suparnojit Sarkar , Piyush Patel

The effectiveness of Large Language Models (LLMs) depends heavily on the availability of high-quality post-training data, particularly instruction-tuning and preference-based examples. Existing open-source datasets, however, often lack…

Computation and Language · Computer Science 2025-10-09 Neel Prabhanjan Rachamalla , Aravind Konakalla , Gautam Rajeev , Ashish Kulkarni , Chandra Khatri , Shubham Agarwal

Automated parsing of scanned documents into richly structured, machine-readable formats remains a critical bottleneck in Document AI, as traditional multi-stage pipelines suffer from error propagation and limited adaptability to diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Baode Wang , Biao Wu , Weizhen Li , Meng Fang , Zuming Huang , Jun Huang , Haozhe Wang , Yanjie Liang , Ling Chen , Wei Chu , Yuan Qi

Cross-lingual document alignment aims to identify pairs of documents in two distinct languages that are of comparable content or translations of each other. In this paper, we exploit the signals embedded in URLs to label web documents at…

Computation and Language · Computer Science 2020-10-13 Ahmed El-Kishky , Vishrav Chaudhary , Francisco Guzman , Philipp Koehn

We present a novel, open-access dataset designed for semantic layout analysis, built to support document recreation workflows through mapping with the Text Encoding Initiative (TEI) standard. This dataset includes 7,254 annotated pages…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Thibault Clérice , Juliette Janes , Hugo Scheithauer , Sarah Bénière , Florian Cafiero , Laurent Romary , Simon Gabay , Benoît Sagot

The document layout analysis (DLA) aims to decompose document images into high-level semantic areas (i.e., figures, tables, texts, and background). Creating a DLA framework with strong generalization capabilities is a challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Xingjiao Wu , Luwei Xiao , Xiangcheng Du , Yingbin Zheng , Xin Li , Tianlong Ma , Cheng Jin , Liang He

We introduce Multilingual Document Parsing Benchmark, the first benchmark for multilingual digital and photographed document parsing. Document parsing has made remarkable strides, yet almost exclusively on clean, digital, well-formatted…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhang Li , Zhibo Lin , Qiang Liu , Ziyang Zhang , Shuo Zhang , Zidun Guo , Jiajun Song , Jiarui Zhang , Xiang Bai , Yuliang Liu

Recently, leveraging large language models (LLMs) or multimodal large language models (MLLMs) for document understanding has been proven very promising. However, previous works that employ LLMs/MLLMs for document understanding have not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Chuwei Luo , Yufan Shen , Zhaoqing Zhu , Qi Zheng , Zhi Yu , Cong Yao

Semantic evaluation in low-resource languages remains a major challenge in NLP. While sentence transformers have shown strong performance in high-resource settings, their effectiveness in Indic languages is underexplored due to a lack of…

Computation and Language · Computer Science 2025-09-03 Nishant Tanksale , Tanmay Kokate , Darshan Gohad , Sarvadnyaa Barate , Raviraj Joshi

Large language models (LLMs) have shown impressive performance on general-purpose tasks, yet adapting them to specific domains remains challenging due to the scarcity of high-quality domain data. Existing data synthesis tools often struggle…

Computation and Language · Computer Science 2025-07-08 Ziyang Miao , Qiyu Sun , Jingyuan Wang , Yuchen Gong , Yaowei Zheng , Shiqi Li , Richong Zhang

In text-driven 3D scene generation, object layout serves as a crucial intermediate representation that bridges high-level language instructions with detailed geometric output. It not only provides a structural blueprint for ensuring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yiheng Zhang , Zhuojiang Cai , Mingdao Wang , Meitong Guo , Tianxiao Li , Li Lin , Yuwang Wang

Understanding and extracting structured insights from unstructured documents remains a foundational challenge in industrial NLP. While Large Language Models (LLMs) enable zero-shot extraction, traditional pipelines often fail to handle…

Document Layout Analysis (DLA) is a fundamental task in document understanding. However, existing DLA and adaptation methods often require access to large-scale source data and target labels. This requirements severely limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Sebastian Tewes , Yufan Chen , Omar Moured , Jiaming Zhang , Rainer Stiefelhagen

Building document-grounded dialogue systems have received growing interest as documents convey a wealth of human knowledge and commonly exist in enterprises. Wherein, how to comprehend and retrieve information from documents is a…

Computation and Language · Computer Science 2022-07-15 Zhenyu Zhang , Bowen Yu , Haiyang Yu , Tingwen Liu , Cheng Fu , Jingyang Li , Chengguang Tang , Jian Sun , Yongbin Li

We call on the Document AI (DocAI) community to reevaluate current methodologies and embrace the challenge of creating more practically-oriented benchmarks. Document Understanding Dataset and Evaluation (DUDE) seeks to remediate the halted…

Document digitization is vital for preserving historical records, efficient document management, and advancing OCR (Optical Character Recognition) research. Document Layout Analysis (DLA) involves segmenting documents into meaningful units…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Md Ataullha , Mahedi Hassan Rabby , Mushfiqur Rahman , Tahsina Bintay Azam

When designing circuits, engineers obtain the information of electronic devices by browsing a large number of documents, which is low efficiency and heavy workload. The use of artificial intelligence technology to automatically parse…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Hong Cai Chen , Longchang Wu , Yang Zhang

Image Difference Captioning (IDC) aims to generate natural language descriptions of subtle differences between image pairs, requiring both precise visual change localization and coherent semantic expression. Despite recent advancements,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yuan Liu , Saihui Hou , Saijie Hou , Jiabao Du , Shibei Meng , Yongzhen Huang