English
Related papers

Related papers: Thinking with Tables: Enhancing Multi-Modal Tabula…

200 papers

Temporal reasoning over tabular data presents substantial challenges for large language models (LLMs), as evidenced by recent research. In this study, we conduct a comprehensive analysis of temporal datasets to pinpoint the specific…

Computation and Language · Computer Science 2024-07-24 Irwin Deng , Kushagra Dixit , Vivek Gupta , Dan Roth

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

Images usually convey richer detail than text, but often include redundant information, which potentially downgrades multimodal reasoning performance. When faced with lengthy or complex messages, humans tend to employ abstract thinking to…

Computation and Language · Computer Science 2025-12-16 Dairu Liu , Ziyue Wang , Minyuan Ruan , Fuwen Luo , Chi Chen , Peng Li , Yang Liu

Large language models (LLMs) are primarily designed to understand unstructured text. When directly applied to structured formats such as tabular data, they may struggle to discern inherent relationships and overlook critical patterns. While…

Machine Learning · Computer Science 2024-10-11 Natraj Raman , Sumitra Ganesh , Manuela Veloso

Human reasoning relies on constructing and manipulating mental models -- simplified internal representations of situations used to understand and solve problems. Conceptual diagrams (e.g., a sketch drawn to aid reasoning) externalize these…

Artificial Intelligence · Computer Science 2025-09-30 Nasim Borazjanizadeh , Roei Herzig , Eduard Oks , Trevor Darrell , Rogerio Feris , Leonid Karlinsky

The majority of data in businesses and industries is stored in tables, databases, and data warehouses. Reasoning with table-structured data poses significant challenges for large language models (LLMs) due to its hidden semantics, inherent…

Computation and Language · Computer Science 2025-07-15 Ce Li , Xiaofan Liu , Zhiyan Song , Ce Chi , Chen Zhao , Jingjing Yang , Zhendong Wang , Kexin Yang , Boshen Shi , Xing Wang , Chao Deng , Junlan Feng

Multi-modal language model has made advanced progress in vision and audio, but still faces significant challenges in dealing with complex reasoning tasks in the time series domain. The reasons are twofold. First, labels for multi-modal time…

Machine Learning · Computer Science 2025-03-10 Haochuan Zhang , Chunhua Yang , Jie Han , Liyang Qin , Xiaoli Wang

Table reasoning requires models to jointly perform comprehensive semantic understanding and precise numerical operations. Although recent large language model (LLM)-based methods have achieved promising results, most of them still rely on a…

Artificial Intelligence · Computer Science 2025-12-23 Chuang Jiang , Mingyue Cheng , Xiaoyu Tao , Qingyang Mao , Jie Ouyang , Qi Liu

To migrate the remarkable successes of Large Language Models (LLMs), the community has made numerous efforts to generalize them to the table reasoning tasks for the widely deployed tabular data. Despite that, in this work, by showing a…

Computation and Language · Computer Science 2026-01-08 Liyao Li , Chao Ye , Wentao Ye , Yifei Sun , Zhe Jiang , Haobo Wang , Jiaming Tian , Yiming Zhang , Ningtao Wang , Xing Fu , Gang Chen , Junbo Zhao

Neural-symbolic methods have demonstrated efficiency in enhancing the reasoning abilities of large language models (LLMs). However, existing methods mainly rely on syntactically mapping natural languages to complete formal languages like…

Computation and Language · Computer Science 2024-06-04 Yiming Wang , Zhuosheng Zhang , Pei Zhang , Baosong Yang , Rui Wang

The video reasoning ability of multimodal large language models (MLLMs) is crucial for downstream tasks like video question answering and temporal grounding. While recent approaches have explored text-based chain-of-thought (CoT) reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Haoji Zhang , Xin Gu , Jiawen Li , Chixiang Ma , Sule Bai , Chubin Zhang , Bowen Zhang , Zhichao Zhou , Dongliang He , Yansong Tang

Table reasoning tasks have shown remarkable progress with the development of large language models (LLMs), which involve interpreting and drawing conclusions from tabular data based on natural language (NL) questions. Existing solutions…

Computation and Language · Computer Science 2024-10-11 Yuan Sui , Jiaru Zou , Mengyu Zhou , Xinyi He , Lun Du , Shi Han , Dongmei Zhang

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

While large language models (LLMs) have shown promise in the table question answering (TQA) task through prompt engineering, they face challenges in industrial applications, including structural heterogeneity, difficulties in target data…

Computation and Language · Computer Science 2025-09-03 Sishi Xiong , Ziyang He , Zhongjiang He , Yu Zhao , Changzai Pan , Jie Zhang , Zhenhe Wu , Shuangyong Song , Yongxiang Li

Multimodal Large Language Models (MLLMs) excel in solving text-based mathematical problems, but they struggle with mathematical diagrams since they are primarily trained on natural scene images. For humans, visual aids generally enhance…

Computation and Language · Computer Science 2024-09-26 Wenwen Zhuang , Xin Huang , Xiantao Zhang , Jin Zeng

Table reasoning, which aims to generate the corresponding answer to the question following the user requirement according to the provided table, and optionally a text description of the table, effectively improving the efficiency of…

Computation and Language · Computer Science 2024-02-14 Xuanliang Zhang , Dingzirui Wang , Longxu Dou , Qingfu Zhu , Wanxiang Che

Existing datasets for tabular question answering typically focus exclusively on text within cells. However, real-world data is inherently multimodal, often blending images such as symbols, faces, icons, patterns, and charts with textual…

Table reasoning requires models to jointly perform semantic understanding and precise numerical operations. Most existing methods rely on a single-turn reasoning paradigm over tables which suffers from context overflow and weak numerical…

Computation and Language · Computer Science 2026-03-11 Mingyue Cheng , Shuo Yu , Chuang Jiang , Xiaoyu Tao , Qingyang Mao , Jie Ouyang , Qi Liu , Enhong Chen

Large language models (LLMs) have demonstrated remarkable reasoning capabilities when prompted with strategies such as Chain-of-Thought (CoT). However, these approaches focus on token-level output without considering internal weight…

Computation and Language · Computer Science 2025-04-16 Saif Punjwani , Larry Heck

Table Structure Recognition (TSR) requires the logical reasoning ability of large language models (LLMs) to handle complex table layouts, but current datasets are limited in scale and quality, hindering effective use of this reasoning…

Databases · Computer Science 2026-04-16 Ruilin Zhang , Kai Yang