English
Related papers

Related papers: FLEXTAF: Enhancing Table Reasoning with Flexible T…

200 papers

Mathematical reasoning has long been a key benchmark for evaluating large language models. Although substantial progress has been made on math word problems, the need for reasoning over tabular data in real-world applications has been…

Artificial Intelligence · Computer Science 2026-04-20 Shi-Yu Tian , Zhi Zhou , Wei Dong , Kun-Yang Yu , Ming Yang , Zi-Jian Cheng , Lan-Zhe Guo , Yu-Feng Li

This paper proposes a detailed prompting flow, termed Table-Logic, to investigate the performance contrasts between bigger and smaller language models (LMs) utilizing step-by-step reasoning methods in the TableQA task. The method processes…

Computation and Language · Computer Science 2024-11-26 Haoyan Yang , Yixuan Wang , Keyue Tong , Hongjin Zhu , Yuanxin Zhang

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

Tabular reasoning involves multi-step information extraction and logical inference over tabular data. While recent advances have leveraged large language models (LLMs) for reasoning over structured tables, such high-quality textual…

Machine Learning · Computer Science 2025-06-05 Jun-Peng Jiang , Yu Xia , Hai-Long Sun , Shiyin Lu , Qing-Guo Chen , Weihua Luo , Kaifu Zhang , De-Chuan Zhan , Han-Jia Ye

As real-world tasks grow increasingly complex, long-context reasoning has become a core capability for Large Language Models (LLMs). However, few studies explore which data types are effective for long-context reasoning and why. We find…

Computation and Language · Computer Science 2026-03-24 Huaibing Xie , Guoliang Zhao , Yang Liu , Shihan Dou , Siming Huang , Yanling Xiao , Shaolei Wang , Yiting Liu , Cheng Zhang , Shaofan Liu , Pluto Zhou

Table reasoning (TR) requires structured reasoning over semi-structured tabular data and remains challenging, particularly for small language models (SLMs, e.g., LLaMA-8B) due to their limited capacity compared to large LMs (LLMs, e.g.,…

Machine Learning · Computer Science 2025-06-09 Rihui Jin , Zheyu Xin , Xing Xie , Zuoyi Li , Guilin Qi , Yongrui Chen , Xinbang Dai , Tongtong Wu , Gholamreza Haffari

Understanding and reasoning over tables is a critical capability for many real-world applications. Large language models (LLMs) have shown promise on this task, but current approaches remain limited. Fine-tuning based methods strengthen…

Large Language Models (LLMs) trained on large volumes of data excel at various natural language tasks, but they cannot handle tasks requiring knowledge that has not been trained on previously. One solution is to use a retriever that fetches…

Table-based reasoning with large language models (LLMs) is a promising direction to tackle many table understanding tasks, such as table-based question answering and fact verification. Compared with generic reasoning, table-based reasoning…

Our work addresses the challenges of understanding tables. Existing methods often struggle with the unpredictable nature of table content, leading to a reliance on preprocessing and keyword matching. They also face limitations due to the…

Computation and Language · Computer Science 2025-08-26 Thi-Nhung Nguyen , Hoang Ngo , Dinh Phung , Thuy-Trang Vu , Dat Quoc Nguyen

Tables have gained significant attention in large language models (LLMs) and multimodal large language models (MLLMs) due to their complex and flexible structure. Unlike linear text inputs, tables are two-dimensional, encompassing formats…

Computation and Language · Computer Science 2025-08-04 Xiaofeng Wu , Alan Ritter , Wei Xu

Advanced table question answering (TableQA) methods prompt large language models (LLMs) to generate answer text, SQL query, Python code, or custom operation, which impressively improve the complex reasoning problems in the TableQA task.…

Computation and Language · Computer Science 2025-09-03 Zhongyuan Wang , Richong Zhang , Zhijie Nie , Hangyu Mao

Large Language Models (LLMs) excel in natural language tasks, but less is known about their reasoning capabilities over tabular data. Prior analyses devise evaluation strategies that poorly reflect an LLM's realistic performance on tabular…

Artificial Intelligence · Computer Science 2025-11-05 Cornelius Wolff , Madelon Hulsebos

Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks. However, the understanding of their capability to process structured data like tables remains an under-explored area.…

Computation and Language · Computer Science 2024-07-18 Yuan Sui , Mengyu Zhou , Mingjie Zhou , Shi Han , Dongmei Zhang

Large Language Models (LLMs), with their remarkable ability to tackle challenging and unseen reasoning problems, hold immense potential for tabular learning, that is vital for many real-world applications. In this paper, we propose a novel…

Machine Learning · Computer Science 2024-05-07 Sungwon Han , Jinsung Yoon , Sercan O Arik , Tomas Pfister

Automated tabular understanding and reasoning are essential tasks for data scientists. Recently, Large language models (LLMs) have become increasingly prevalent in tabular reasoning tasks. Previous work focuses on (1) finetuning LLMs using…

Machine Learning · Computer Science 2025-08-27 Chufan Gao , Jintai Chen , Jimeng Sun

Test-time compute has emerged as a powerful paradigm for improving the performance of large language models (LLMs), where generating multiple outputs or refining individual chains can significantly boost answer accuracy. However, existing…

Machine Learning · Computer Science 2025-09-26 Sheng Liu , Tianlang Chen , Pan Lu , Haotian Ye , Yizheng Chen , Lei Xing , James Zou

Multimodal Large Language Models (MLLMs) have demonstrated remarkable reasoning capabilities across modalities such as images and text. However, tabular data, despite being a critical real-world modality, remains relatively underexplored in…

Computation and Language · Computer Science 2026-03-26 Kun-Yang Yu , Zhi Zhou , Shi-Yu Tian , Xiao-Wen Yang , Zi-Yi Jia , Ming Yang , Zi-Jian Cheng , Lan-Zhe Guo , Yu-Feng Li

Multimodal reasoning has emerged as a powerful framework for enhancing reasoning capabilities of reasoning models. While multi-turn table reasoning methods have improved reasoning accuracy through tool use and reward modeling, they rely on…

Artificial Intelligence · Computer Science 2026-04-07 Tung Sum Thomas Kwok , Xinyu Wang , Xiaofeng Lin , Peng Lu , Chunhe Wang , Changlun Li , Hanwei Wu , Nan Tang , Elisa Kreiss , Guang Cheng

Tabular data are crucial in many fields and their understanding by large language models (LLMs) under high parameter efficiency paradigm is important. However, directly applying parameter-efficient fine-tuning (PEFT) techniques to tabular…

Computation and Language · Computer Science 2025-06-30 Xinyi He , Yihao Liu , Mengyu Zhou , Yeye He , Haoyu Dong , Shi Han , Zejian Yuan , Dongmei Zhang