English
Related papers

Related papers: Multimodal Tabular Reasoning with Privileged Struc…

200 papers

Reasoning over table images remains challenging for Large Vision-Language Models (LVLMs) due to complex layouts and tightly coupled structure-content information. Existing solutions often depend on expensive supervised training,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yingjie Zhu , Xuefeng Bai , Kehai Chen , Yang Xiang , Youcheng Pan , Xiaoqiang Zhou , Min Zhang

Table-based reasoning has shown remarkable progress in combining deep models with discrete reasoning, which requires reasoning over both free-form natural language (NL) questions and structured tabular data. However, previous table-based…

Computation and Language · Computer Science 2023-04-28 Yunhu Ye , Binyuan Hui , Min Yang , Binhua Li , Fei Huang , Yongbin Li

Multimodal Large Language Models (mLLMs) are often used to answer questions in structured data such as tables in Markdown, JSON, and images. While these models can often give correct answers, users also need to know where those answers come…

Computation and Language · Computer Science 2026-02-18 Yahia Alqurnawi , Preetom Biswas , Anmol Rao , Tejas Anvekar , Chitta Baral , Vivek Gupta

Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs). Despite advances in text and image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Prasham Titiya , Jainil Trivedi , Chitta Baral , Vivek Gupta

Tables are among the most widely used tools for representing structured data in research, business, medicine, and education. Although LLMs demonstrate strong performance in downstream tasks, their efficiency in processing tabular data…

Computation and Language · Computer Science 2025-08-27 Ekaterina Borisova , Fabio Barth , Nils Feldhus , Raia Abu Ahmad , Malte Ostendorff , Pedro Ortiz Suarez , Georg Rehm , Sebastian Möller

The table reasoning task aims to answer the question according to the given table. Currently, using Large Language Models (LLMs) is the predominant method for table reasoning. Most existing methods employ a fixed tabular format to represent…

Computation and Language · Computer Science 2024-08-28 Xuanliang Zhang , Dingzirui Wang , Longxu Dou , Baoxin Wang , Dayong Wu , Qingfu Zhu , Wanxiang Che

Recent Large Language Models (LLMs) have significantly advanced natural language processing and automated decision-making. However, these models still encounter difficulties when performing complex reasoning tasks involving logical…

Computation and Language · Computer Science 2025-06-26 Yubo Dong , Hehe Fan

Optimizing accuracy and performance while eliminating hallucinations of open-domain conversational large language models (LLMs) is an open research challenge. A particularly promising direction is to augment and ground LLMs with information…

Computation and Language · Computer Science 2023-06-01 Anirudh S Sundar , Larry Heck

Large Language Models (LLMs) often struggle with requests related to information retrieval and data manipulation that frequently arise in real-world scenarios under multiple conditions. In this paper, we demonstrate that leveraging tabular…

Artificial Intelligence · Computer Science 2026-01-09 Jio Oh , Geon Heo , Seungjun Oh , Hyunjin Kim , JinYeong Bak , Jindong Wang , Xing Xie , Steven Euijong Whang

The ability to process information from multiple modalities and to reason through it step-by-step remains a critical challenge in advancing artificial intelligence. However, existing reasoning benchmarks focus on text-only reasoning, or…

Artificial Intelligence · Computer Science 2025-07-01 Yulun Jiang , Yekun Chai , Maria Brbić , Michael Moor

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in interpreting visual layouts and text. However, a significant challenge remains in their ability to interpret robustly and reason over multi-tabular data presented as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Anshul Singh , Chris Biemann , Jan Strich

Tabular data is arguably one of the most commonly used data structures in various practical domains, including finance, healthcare and e-commerce. The inherent heterogeneity allows tabular data to store rich information. However, based on a…

Machine Learning · Computer Science 2023-06-01 Kuan-Yu Chen , Ping-Han Chiang , Hsin-Rung Chou , Ting-Wei Chen , Tien-Hao Chang

Large language models often struggle with complex long-horizon analytical tasks over unstructured tables, which typically feature hierarchical and bidirectional headers and non-canonical layouts. We formalize this challenge as Deep Tabular…

Artificial Intelligence · Computer Science 2026-03-13 Junnan Dong , Chuang Zhou , Zheng Yuan , Yifei Yu , Qiufeng Wang , Yinghui Li , Siyu An , Di Yin , Xing Sun , Feiyue Huang

Multimodal reasoning has emerged as a powerful framework for enhancing reasoning capabilities of reasoning models. While multi-turn table reasoning methods have improved reasoning accuracy through tool use and reward modeling, they rely on…

Artificial Intelligence · Computer Science 2026-04-07 Tung Sum Thomas Kwok , Xinyu Wang , Xiaofeng Lin , Peng Lu , Chunhe Wang , Changlun Li , Hanwei Wu , Nan Tang , Elisa Kreiss , Guang Cheng

Table reasoning, including tabular QA and fact verification, often depends on annotated data or complex data augmentation, limiting flexibility and generalization. LLMs, despite their versatility, often underperform compared to simple…

Artificial Intelligence · Computer Science 2025-11-19 Yiran Rex Ma

Table reasoning tasks have shown remarkable progress with the development of large language models (LLMs), which involve interpreting and drawing conclusions from tabular data based on natural language (NL) questions. Existing solutions…

Computation and Language · Computer Science 2024-10-11 Yuan Sui , Jiaru Zou , Mengyu Zhou , Xinyi He , Lun Du , Shi Han , Dongmei Zhang

Large Language Models (LLMs) excel in natural language tasks, but less is known about their reasoning capabilities over tabular data. Prior analyses devise evaluation strategies that poorly reflect an LLM's realistic performance on tabular…

Artificial Intelligence · Computer Science 2025-11-05 Cornelius Wolff , Madelon Hulsebos

Large Language Models (LLMs) struggle with multi-step reasoning over structured tables. The primary reason is the lack of explicit supervision for intermediate reasoning states. Existing learned reward models or executor-based verifiers are…

Artificial Intelligence · Computer Science 2026-05-19 Tung Sum Thomas Kwok , Xinyu Wang , Hengzhi He , Xiaofeng Lin , Peng Lu , Liheng Ma , Chunhe Wang , Chun Ho Mak , Yuyu Luo , Ying Nian Wu , Lei Ding , Guang Cheng

Tabular foundation models are becoming increasingly popular for low-resource tabular problems. These models make up for small training datasets by pretraining on large volumes of synthetic data. The prior knowledge obtained via pretraining…

Machine Learning · Computer Science 2026-05-18 George Yakushev , Alina Shutova , Ivan Rubachev , Natalia Bereberdina , Renat Sergazinov , Artem Babenko

The integration of tabular data from diverse sources is often hindered by inconsistencies in formatting and representation, posing significant challenges for data analysts and personal digital assistants. Existing methods for automating…

Databases · Computer Science 2025-08-20 Arash Dargahi Nobari , Davood Rafiei