English
Related papers

Related papers: SynthDoc: Bilingual Documents Synthesis for Visual…

200 papers

Document intelligence automates the extraction of information from documents and supports many business applications. Recent self-supervised learning methods on large-scale unlabeled document datasets have opened up promising directions…

Computation and Language · Computer Science 2022-04-29 Jiuxiang Gu , Jason Kuen , Vlad I. Morariu , Handong Zhao , Nikolaos Barmpalios , Rajiv Jain , Ani Nenkova , Tong Sun

In the biomedical domain, visualizing the document embeddings of an extensive corpus has been widely used in information-seeking tasks. However, three key challenges with existing visualizations make it difficult for clinicians to find…

Human-Computer Interaction · Computer Science 2025-04-09 Rui Qiu , Yamei Tu , Po-Yin Yen , Han-Wei Shen

The robustness of a model for real-world deployment is decided by how well it performs on unseen data and distinguishes between in-domain and out-of-domain samples. Visual document classifiers have shown impressive performance on…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Fnu Mohbat , Mohammed J. Zaki , Catherine Finegan-Dollak , Ashish Verma

This paper presents a groundbreaking multimodal, multi-task, multi-teacher joint-grained knowledge distillation model for visually-rich form document understanding. The model is designed to leverage insights from both fine-grained and…

Computation and Language · Computer Science 2024-07-29 Yihao Ding , Lorenzo Vaiani , Caren Han , Jean Lee , Paolo Garza , Josiah Poon , Luca Cagliero

We propose DocFormerv2, a multi-modal transformer for Visual Document Understanding (VDU). The VDU domain entails understanding documents (beyond mere OCR predictions) e.g., extracting information from a form, VQA for documents and other…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Srikar Appalaraju , Peng Tang , Qi Dong , Nishant Sankaran , Yichu Zhou , R. Manmatha

Understanding information from a collection of multiple documents, particularly those with visually rich elements, is important for document-grounded question answering. This paper introduces VisDoMBench, the first comprehensive benchmark…

Computation and Language · Computer Science 2025-02-12 Manan Suri , Puneet Mathur , Franck Dernoncourt , Kanika Goswami , Ryan A. Rossi , Dinesh Manocha

Despite recent progress, video diffusion models still struggle to synthesize realistic videos involving highly dynamic motions or requiring fine-grained motion controllability. A central limitation lies in the scarcity of such examples in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Wonjoon Jin , Jiyun Won , Janghyeok Han , Qi Dai , Chong Luo , Seung-Hwan Baek , Sunghyun Cho

Large Language Models (LLMs) have achieved remarkable success but remain data-inefficient, especially when learning from small, specialized corpora with limited and proprietary data. Existing synthetic data generation methods for continue…

Computation and Language · Computer Science 2025-09-16 Shengjie Ma , Xuhui Jiang , Chengjin Xu , Cehao Yang , Liyu Zhang , Jian Guo

In large technology companies, the requirements for managing and organizing technical documents created by engineers and managers have increased dramatically in recent years, which has led to a higher demand for more scalable, accurate, and…

Machine Learning · Computer Science 2025-10-31 Shuo Jiang , Jie Hu , Christopher L. Magee , Jianxi Luo

Document parsing (DP) transforms unstructured or semi-structured documents into structured, machine-readable representations, enabling downstream applications such as knowledge base construction and retrieval-augmented generation (RAG).…

Accurate and comprehensive clinical documentation is crucial for delivering high-quality healthcare, facilitating effective communication among providers, and ensuring compliance with regulatory requirements. However, manual transcription…

Computation and Language · Computer Science 2024-06-12 Anjanava Biswas , Wrick Talukdar

Recent years have witnessed remarkable progress in multi-view diffusion models for 3D content creation. However, there remains a significant gap in image quality and prompt-following ability compared to 2D diffusion models. A critical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Zeyi Sun , Tong Wu , Pan Zhang , Yuhang Zang , Xiaoyi Dong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

We present a method for synthesizing naturally looking images of multiple people interacting in a specific scenario. These images benefit from the advantages of synthetic data: being fully controllable and fully annotated with any type of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Igor Kviatkovsky , Nadav Bhonker , Gerard Medioni

Large language models (LLMs) have shown impressive performance on general-purpose tasks, yet adapting them to specific domains remains challenging due to the scarcity of high-quality domain data. Existing data synthesis tools often struggle…

Computation and Language · Computer Science 2025-07-08 Ziyang Miao , Qiyu Sun , Jingyuan Wang , Yuchen Gong , Yaowei Zheng , Shiqi Li , Richong Zhang

The development of synthesis procedures remains a fundamental challenge in materials discovery, with procedural knowledge scattered across decades of scientific literature in unstructured formats that are challenging for systematic…

Businesses need to query visually rich documents (VRDs) like receipts, medical records, and insurance forms to make decisions. Existing techniques for extracting entities from VRDs struggle with new layouts or require extensive pre-training…

Artificial Intelligence · Computer Science 2024-07-10 Thanh-Dat Nguyen , Tung Do-Viet , Hung Nguyen-Duy , Tuan-Hai Luu , Hung Le , Bach Le , Patanamon , Thongtanunam

We describe SynthPix, a synthetic image generator for Particle Image Velocimetry (PIV) with a focus on performance and parallelism on accelerators, implemented in JAX. SynthPix produces PIV image pairs from prescribed flow fields while…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-15 Antonio Terpin , Alan Bonomi , Francesco Banelli , Raffaello D'Andrea

LLM-based translation agents have achieved highly human-like translation results and are capable of handling longer and more complex contexts with greater efficiency. However, they are typically limited to text-only inputs. In this paper,…

Artificial Intelligence · Computer Science 2025-07-11 Yichen Lu , Wei Dai , Jiaen Liu , Ching Wing Kwok , Zongheng Wu , Xudong Xiao , Ao Sun , Sheng Fu , Jianyuan Zhan , Yian Wang , Takatomo Saito , Sicheng Lai

Interactive articles help readers engage with complex ideas through exploration, yet creating them remains costly, requiring both domain expertise and web development skills. Recent LLM-based agents can automate content creation, but…

Computation and Language · Computer Science 2026-03-03 Yinghao Tang , Yupeng Xie , Yingchaojie Feng , Tingfeng Lan , Wei Chen

Computer-assisted surgical (CAS) systems enhance surgical execution and outcomes by providing advanced support to surgeons. These systems often rely on deep learning models trained on complex, challenging-to-annotate data. While synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Sabina Martyniak , Joanna Kaleta , Diego Dall'Alba , Michał Naskręt , Szymon Płotka , Przemysław Korzeniowski