English
Related papers

Related papers: Document AI: A Comparative Study of Transformer-Ba…

200 papers

Documents are composed of smaller pieces - paragraphs, sentences, and tokens - that have complex relationships between one another. Sentiment classification models that take into account the structure inherent in these documents have a…

Computation and Language · Computer Science 2022-02-03 Jeremy Barnes , Vinit Ravishankar , Lilja Øvrelid , Erik Velldal

Despite the great success of large-scale text-to-image diffusion models in image generation and image editing, existing methods still struggle to edit the layout of real images. Although a few works have been proposed to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Tao Xia , Yudi Zhang , Ting Liu Lei Zhang

We introduce a neural method for transfer learning between two (source and target) classification tasks or aspects over the same domain. Rather than training on target labels, we use a few keywords pertaining to source and target aspects…

Computation and Language · Computer Science 2017-09-26 Yuan Zhang , Regina Barzilay , Tommi Jaakkola

Understanding convergent learning -- the degree to which independently trained neural systems -- whether multiple artificial networks or brains and models -- arrive at similar internal representations -- is crucial for both neuroscience and…

Neurons and Cognition · Quantitative Biology 2026-01-26 Chaitanya Kapoor , Sudhanshu Srivastava , Meenakshi Khosla

We propose a new approach to natural language understanding in which we consider the input text as an image and apply 2D Convolutional Neural Networks to learn the local and global semantics of the sentences from the variations ofthe visual…

An important task for the design of Question Answering systems is the selection of the sentence containing (or constituting) the answer from documents relevant to the asked question. Most previous work has only used the target sentence to…

Computation and Language · Computer Science 2020-06-03 Ivano Lauriola , Alessandro Moschitti

Comparing document semantics is one of the toughest tasks in both Natural Language Processing and Information Retrieval. To date, on one hand, the tools for this task are still rare. On the other hand, most relevant methods are devised from…

Computation and Language · Computer Science 2020-12-09 Yuqi Kong , Fanchao Meng , Benjamin Carterette

The advent of large pre-trained language models has made it possible to make high-quality predictions on how to add or change a sentence in a document. However, the high branching factor inherent to text generation impedes the ability of…

Computation and Language · Computer Science 2021-06-15 Zeqiu Wu , Michel Galley , Chris Brockett , Yizhe Zhang , Bill Dolan

Adapting large language models to full document translation remains challenging due to the difficulty of capturing long-range dependencies and preserving discourse coherence throughout extended texts. While recent agentic machine…

Computation and Language · Computer Science 2025-11-11 Viet-Thanh Pham , Minghan Wang , Hao-Han Liao , Thuy-Trang Vu

Understanding information-dense documents like recipes and scientific papers requires readers to find, interpret, and connect details scattered across text, figures, tables, and other visual elements. These documents are often long and…

Human-Computer Interaction · Computer Science 2026-02-20 Alyssa Hwang , Hita Kambhamettu , Yue Yang , Ajay Patel , Joseph Chee Chang , Andrew Head

We introduce _transparent documents_, interactive web-based scholarly articles which allow readers to explore the relationship to the underlying data by hovering over fragments of text, and present an LLM-based tool for authoring…

Human-Computer Interaction · Computer Science 2026-01-13 Alfonso Piscitelli , Cristina David , Mattia De Rosa , Ali Mohammed , Federico Nanni , Jacob Pake , Roly Perera , Jessy Sodimu , Chenyiqiu Zheng

To provide AI researchers with modern tools for dealing with the explosive growth of the research literature in their field, we introduce a new platform, AI Research Navigator, that combines classical keyword search with neural retrieval to…

Computation and Language · Computer Science 2020-11-03 Marzieh Fadaee , Olga Gureenkova , Fernando Rejon Barrera , Carsten Schnober , Wouter Weerkamp , Jakub Zavrel

Artificial Intelligence, especially Large Language Models (LLMs), has transformed domains such as software engineering, journalism, creative writing, academia, and media (Naveed et al. 2025; arXiv:2307.06435). Diffusion models like Stable…

Computation and Language · Computer Science 2025-11-11 Trivikram Satharasi , S Sitharama Iyengar

Text classification is one of the most widely studied tasks in natural language processing. Motivated by the principle of compositionality, large multilayer neural network models have been employed for this task in an attempt to effectively…

Computation and Language · Computer Science 2018-08-07 Devendra Singh Sachan , Manzil Zaheer , Ruslan Salakhutdinov

The application of AI tools to the legal field feels natural: large legal document collections could be used with specialized AI to improve workflow efficiency for lawyers and ameliorate the "justice gap" for underserved clients. However,…

Computation and Language · Computer Science 2025-04-03 Allison Koenecke , Jed Stiglitz , David Mimno , Matthew Wilkens

Learning to fuse vision and language information and representing them is an important research problem with many applications. Recent progresses have leveraged the ideas of pre-training (from language modeling) and attention layers in…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Bowen Zhang , Hexiang Hu , Vihan Jain , Eugene Ie , Fei Sha

Extraction of text regions and individual text lines from historic documents is necessary for automatic transcription. We propose extending a CNN-based text baseline detection system by adding line height and text block boundary predictions…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Oldřich Kodym , Michal Hradiš

Document Layout analysis (DLA), is the process by which a page is parsed into meaningful elements, often using machine learning models. Typically, the quality of a model is judged using general object detection metrics such as IoU, F1 or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jonathan Bourne , Mwiza Simbeye , Ishtar Govia

In this paper, we develop a neural summarization model which can effectively process multiple input documents and distill Transformer architecture with the ability to encode documents in a hierarchical manner. We represent cross-document…

Computation and Language · Computer Science 2019-05-31 Yang Liu , Mirella Lapata

Recent advances in machine learning, particularly Large Language Models (LLMs) such as BERT and GPT, provide rich contextual embeddings that improve text representation. However, current document clustering approaches often ignore the…

Computation and Language · Computer Science 2024-12-20 Imed Keraghel , Mohamed Nadif