English
Related papers

Related papers: Spatial ModernBERT: Spatial-Aware Transformer for …

200 papers

Foundation models, particularly those that incorporate Transformer architectures, have demonstrated exceptional performance in domains such as natural language processing and image processing. Adapting these models to structured data, like…

Machine Learning · Computer Science 2025-01-08 Tassilo Klein , Clemens Biehl , Margarida Costa , Andre Sres , Jonas Kolk , Johannes Hoffart

Financial dialogue transcripts pose a unique challenge for sentence-level information extraction due to their informal structure, domain-specific vocabulary, and variable intent density. We introduce Fin-ExBERT, a lightweight and modular…

Computation and Language · Computer Science 2025-09-30 Soumick Sarker , Abhijit Kumar Rai

Table extraction from PDF and image documents is a ubiquitous task in the real-world. Perfect extraction quality is difficult to achieve with one single out-of-box model due to (1) the wide variety of table styles, (2) the lack of training…

Human-Computer Interaction · Computer Science 2021-02-18 Nancy Xin Ru Wang , Douglas Burdick , Yunyao Li

Understanding the semantics of tables at scale is crucial for tasks like data integration, preparation, and search. Table understanding methods aim at detecting a table's topic, semantic column types, column relations, or entities. With the…

Databases · Computer Science 2021-09-14 Madelon Hulsebos , Sneha Gathani , James Gale , Isil Dillig , Paul Groth , Çağatay Demiralp

Document-level event extraction is a long-standing challenging information retrieval problem involving a sequence of sub-tasks: entity extraction, event type judgment, and event type-specific multi-event extraction. However, addressing the…

Computation and Language · Computer Science 2023-07-03 Qizhi Wan , Changxuan Wan , Keli Xiao , Hui Xiong , Dexi Liu , Xiping Liu

Protecting privileged communications and data from inadvertent disclosure is a paramount task in the US legal practice. Traditionally counsels rely on keyword searching and manual review to identify privileged documents in cases. As data…

Information Retrieval · Computer Science 2021-12-17 Haozhen Zhao , Shi Ye , Jingchao Yang

Information extraction from semi-structured webpages provides valuable long-tailed facts for augmenting knowledge graph. Relational Web tables are a critical component containing additional entities and attributes of rich and diverse…

Information Retrieval · Computer Science 2021-02-19 Daheng Wang , Prashant Shiralkar , Colin Lockard , Binxuan Huang , Xin Luna Dong , Meng Jiang

As global trends are shifting towards data-driven industries, the demand for automated algorithms that can convert digital images of scanned documents into machine readable information is rapidly growing. Besides the opportunity of data…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Pascal Fischer , Alen Smajic , Alexander Mehler , Giuseppe Abrami

Many joint entity relation extraction models setup two separated label spaces for the two sub-tasks (i.e., entity detection and relation classification). We argue that this setting may hinder the information interaction between entities and…

Computation and Language · Computer Science 2021-07-12 Yijun Wang , Changzhi Sun , Yuanbin Wu , Hao Zhou , Lei Li , Junchi Yan

We introduce SpERT, an attention model for span-based joint entity and relation extraction. Our key contribution is a light-weight reasoning on BERT embeddings, which features entity recognition and filtering, as well as relation…

Computation and Language · Computer Science 2021-06-30 Markus Eberts , Adrian Ulges

This paper presents a practical approach to fine-grained information extraction. Through plenty of experiences of authors in practically applying information extraction to business process automation, there can be found a couple of…

Information Retrieval · Computer Science 2020-06-09 Minh-Tien Nguyen , Viet-Anh Phan , Le Thai Linh , Nguyen Hong Son , Le Tien Dung , Miku Hirano , Hajime Hotta

Transformers achieve promising performance in document understanding because of their high effectiveness and still suffer from quadratic computational complexity dependency on the sequence length. General efficient transformers are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Mingliang Zhai , Yulin Li , Xiameng Qin , Chen Yi , Qunyi Xie , Chengquan Zhang , Kun Yao , Yuwei Wu , Yunde Jia

The major task of any e-commerce search engine is to retrieve the most relevant inventory items, which best match the user intent reflected in a query. This task is non-trivial due to many reasons, including ambiguous queries, misaligned…

Machine Learning · Computer Science 2025-07-15 Md. Ahsanul Kabir , Mohammad Al Hasan , Aritra Mandal , Liyang Hao , Ishita Khan , Daniel Tunkelang , Zhe Wu

The digital conversion of information stored in documents is a great source of knowledge. In contrast to the documents text, the conversion of the embedded documents graphics, such as charts and plots, has been much less explored. We…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Joseph Shtok , Sivan Harary , Ophir Azulai , Adi Raz Goldfarb , Assaf Arbelle , Leonid Karlinsky

In this paper, we fill the research gap by adopting state-of-the-art computer vision techniques for the data extraction stage in a data mining system. As shown in Fig.1, this stage contains two subtasks, namely, plot element detection and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Weihong Ma , Hesuo Zhang , Shuang Yan , Guangshun Yao , Yichao Huang , Hui Li , Yaqiang Wu , Lianwen Jin

Extracting precise geographical information from textual contents is crucial in a plethora of applications. For example, during hazardous events, a robust and unbiased toponym extraction framework can provide an avenue to tie the location…

Computation and Language · Computer Science 2023-02-06 Bing Zhou , Lei Zou , Yingjie Hu , Yi Qiang , Daniel Goldberg

Table annotation is crucial for making web and enterprise tables usable in downstream NLP applications. Unlike textual data where learning semantically rich token or sentence embeddings often suffice, tables are structured combinations of…

Machine Learning · Computer Science 2026-04-22 Ehsan Hoseinzade , Ke Wang , Anandharaju Durai Raju

Table structure recognition is a crucial part of document image analysis domain. Its difficulty lies in the need to parse the physical coordinates and logical indices of each cell at the same time. However, the existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Zengyuan Guo , Yuechen Yu , Pengyuan Lv , Chengquan Zhang , Haojie Li , Zhihui Wang , Kun Yao , Jingtuo Liu , Jingdong Wang

We propose a Transformer-based approach for information extraction from digitized handwritten documents. Our approach combines, in a single model, the different steps that were so far performed by separate models: feature extraction,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Solène Tarride , Mélodie Boillet , Christopher Kermorvant

Topic modeling is a powerful technique to discover hidden topics and patterns within a collection of documents without prior knowledge. Traditional topic modeling and clustering-based techniques encounter challenges in capturing contextual…

Computation and Language · Computer Science 2024-10-04 Melkamu Abay Mersha , Mesay Gemeda yigezu , Jugal Kalita