English
Related papers

Related papers: TableFormer: Robust Transformer Modeling for Table…

200 papers

Structured data, prevalent in tables, databases, and knowledge graphs, poses a significant challenge in its representation. With the advent of large language models (LLMs), there has been a shift towards linearization-based methods, which…

Computation and Language · Computer Science 2024-04-04 Yutong Shao , Ndapa Nakashole

Chart comprehension presents significant challenges for machine learning models due to the diverse and intricate shapes of charts. Existing multimodal methods often overlook these visual features or fail to integrate them effectively for…

Computation and Language · Computer Science 2024-08-01 Hanwen Zheng , Sijia Wang , Chris Thomas , Lifu Huang

Tabular foundational models are pre-trained models designed for a wide range of tabular data tasks. They have shown strong performance across domains, yet their internal representations and learned concepts remain poorly understood. This…

Machine Learning · Computer Science 2026-01-14 Aviral Gupta , Armaan Sethi , Dhruv Kumar

Tabular data in digital documents is widely used to express compact and important information for readers. However, it is challenging to parse tables from unstructured digital documents, such as PDFs and images, into machine-readable format…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Bin Xiao , Murat Simsek , Burak Kantarci , Ala Abu Alkheir

Specialized transformer-based models for encoding tabular data have gained interest in academia. Although tabular data is omnipresent in industry, applications of table transformers are still missing. In this paper, we study how these…

Artificial Intelligence · Computer Science 2022-09-30 Aneta Koleva , Martin Ringsquandl , Mark Buckley , Rakebul Hasan , Volker Tresp

Tables are pervasive in diverse documents, making table recognition (TR) a fundamental task in document analysis. Existing modular TR pipelines separately model table structure and content, leading to suboptimal integration and complex…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Chunxia Qin , Chenyu Liu , Pengcheng Xia , Jun Du , Baocai Yin , Bing Yin , Cong Liu

We propose a novel high-performance and interpretable canonical deep tabular data learning architecture, TabNet. TabNet uses sequential attention to choose which features to reason from at each decision step, enabling interpretability and…

Machine Learning · Computer Science 2020-12-10 Sercan O. Arik , Tomas Pfister

The table reasoning task aims to answer the question according to the given table. Currently, using Large Language Models (LLMs) is the predominant method for table reasoning. Most existing methods employ a fixed tabular format to represent…

Computation and Language · Computer Science 2024-08-28 Xuanliang Zhang , Dingzirui Wang , Longxu Dou , Baoxin Wang , Dayong Wu , Qingfu Zhu , Wanxiang Che

Medical tabular data, abundant in Electronic Health Records (EHRs), is a valuable resource for diverse medical tasks such as risk prediction. While deep learning approaches, particularly transformer-based models, have shown remarkable…

Computation and Language · Computer Science 2025-04-11 Yucheng Ruan , Xiang Lan , Daniel J. Tan , Hairil Rizal Abdullah , Mengling Feng

Recent work in deep learning has opened new possibilities for solving classical algorithmic tasks using end-to-end learned models. In this work, we investigate the fundamental task of solving linear systems, particularly those that are…

Machine Learning · Computer Science 2025-11-19 Pietro Sittoni , Francesco Tudisco

In the digital era, table structure recognition technology is a critical tool for processing and analyzing large volumes of tabular data. Previous methods primarily focus on visual aspects of table structure recovery but often fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Zhenrong Zhang , Shuhang Liu , Pengfei Hu , Jiefeng Ma , Jun Du , Jianshu Zhang , Yu Hu

We propose a new positional encoding method for a neural network architecture called the Transformer. Unlike the standard sinusoidal positional encoding, our approach is based on solid mathematical grounds and has a guarantee of not losing…

Machine Learning · Computer Science 2024-05-17 Tsuyoshi Idé , Jokin Labaien , Pin-Yu Chen

All tables can be represented as grids. Based on this observation, we propose GridFormer, a novel approach for interpreting unconstrained table structures by predicting the vertex and edge of a grid. First, we propose a flexible table…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Pengyuan Lyu , Weihong Ma , Hongyi Wang , Yuechen Yu , Chengquan Zhang , Kun Yao , Yang Xue , Jingdong Wang

Tables are ubiquitous across various domains for concisely representing structured information. Empowering large language models (LLMs) to reason over tabular data represents an actively explored direction. However, since typical LLMs only…

Computation and Language · Computer Science 2024-10-21 Jia-Nan Li , Jian Guan , Wei Wu , Zhengtao Yu , Rui Yan

Large Language Models (LLMs), already shown to ace various unstructured text comprehension tasks, have also remarkably been shown to tackle table (structured) comprehension tasks without specific training. Building on earlier studies of…

Computation and Language · Computer Science 2025-08-27 Kushal Raj Bhandari , Sixue Xing , Soham Dan , Jianxi Gao

Table structure recognition (TSR) requires both table-level coherence (row/column counts, headers, spanning cells) and precise separator localization. We introduce FastTab, a grid-centric TSR model that avoids autoregressive HTML decoding…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Laziz Hamdi , Amine Tamasna , Pascal Boisson , Thierry Paquet

Information extraction from semi-structured webpages provides valuable long-tailed facts for augmenting knowledge graph. Relational Web tables are a critical component containing additional entities and attributes of rich and diverse…

Information Retrieval · Computer Science 2021-02-19 Daheng Wang , Prashant Shiralkar , Colin Lockard , Binxuan Huang , Xin Luna Dong , Meng Jiang

Transformer based architectures are recently used for the task of answering questions over tables. In order to improve the accuracy on this task, specialized pre-training techniques have been developed and applied on millions of open-domain…

Table extraction is an important but still unsolved problem. In this paper, we introduce a flexible and modular table extraction system. We develop two rule-based algorithms that perform the complete table recognition process, including…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Marcin Namysl , Alexander M. Esser , Sven Behnke , Joachim Köhler

Transformer models have continuously expanded into all machine learning domains convertible to the underlying sequence-to-sequence representation, including tabular data. However, while ubiquitous, this representation restricts their…

Machine Learning · Computer Science 2025-07-24 Jakub Peleška , Gustav Šír