English
Related papers

Related papers: The Mighty ToRR: A Benchmark for Table Reasoning a…

200 papers

Tables and table-based use cases play a crucial role in many important real-world applications, such as spreadsheets, databases, and computational notebooks, which traditionally require expert-level users like data engineers, data analysts,…

Artificial Intelligence · Computer Science 2026-03-10 Junjie Xing , Yeye He , Mengyu Zhou , Haoyu Dong , Shi Han , Lingjiao Chen , Dongmei Zhang , Surajit Chaudhuri , H. V. Jagadish

Large language models (LLMs) have recently shown strong performance on Theory of Mind (ToM) tests, prompting debate about the nature and true performance of the underlying capabilities. At the same time, reasoning-oriented LLMs trained via…

Artificial Intelligence · Computer Science 2026-01-26 Ian B. de Haan , Peter van der Putten , Max van Duijn

Large Language Models (LLMs) have advanced Table Question Answering, where most queries can be answered by extracting information or simple aggregation. However, a common class of real-world queries is implicitly predictive, requiring the…

Computation and Language · Computer Science 2026-05-01 An-Yang Ji , Jun-Peng Jiang , De-Chuan Zhan , Han-Jia Ye

Test-time scaling has significantly improved large language model performance, enabling deeper reasoning to solve complex problems. However, this increased reasoning capability also leads to excessive token generation and unnecessary…

Tables are among the most widely used tools for representing structured data in research, business, medicine, and education. Although LLMs demonstrate strong performance in downstream tasks, their efficiency in processing tabular data…

Computation and Language · Computer Science 2025-08-27 Ekaterina Borisova , Fabio Barth , Nils Feldhus , Raia Abu Ahmad , Malte Ostendorff , Pedro Ortiz Suarez , Georg Rehm , Sebastian Möller

Table reasoning (TR) requires structured reasoning over semi-structured tabular data and remains challenging, particularly for small language models (SLMs, e.g., LLaMA-8B) due to their limited capacity compared to large LMs (LLMs, e.g.,…

Machine Learning · Computer Science 2025-06-09 Rihui Jin , Zheyu Xin , Xing Xie , Zuoyi Li , Guilin Qi , Yongrui Chen , Xinbang Dai , Tongtong Wu , Gholamreza Haffari

Large Language Models (LLMs), already shown to ace various unstructured text comprehension tasks, have also remarkably been shown to tackle table (structured) comprehension tasks without specific training. Building on earlier studies of…

Computation and Language · Computer Science 2025-08-27 Kushal Raj Bhandari , Sixue Xing , Soham Dan , Jianxi Gao

Enhancing reasoning capabilities remains a central focus in the LLM reasearch community. A promising direction involves requiring models to simulate code execution step-by-step to derive outputs for given inputs. However, as code is often…

Computation and Language · Computer Science 2025-07-15 Keqin Bao , Nuo Chen , Xiaoyuan Li , Binyuan Hui , Bowen Yu , Fuli Feng , Xiangnan He , Dayiheng Liu

Numbers are crucial for various real-world domains such as finance, economics, and science. Thus, understanding and reasoning with numbers are essential skills for language models to solve different tasks. While different numerical…

Computation and Language · Computer Science 2023-11-07 Mubashara Akhtar , Abhilash Shankarampeta , Vivek Gupta , Arpit Patil , Oana Cocarascu , Elena Simperl

Relational tables on the Web store a vast amount of knowledge. Owing to the wealth of such tables, there has been tremendous progress on a variety of tasks in the area of table understanding. However, existing work generally relies on…

Information Retrieval · Computer Science 2020-12-04 Xiang Deng , Huan Sun , Alyssa Lees , You Wu , Cong Yu

Evaluating the quality of tables generated by large language models (LLMs) remains an open challenge: existing metrics either flatten tables into text, ignoring structure, or rely on fixed references that limit generalization. We present…

Computation and Language · Computer Science 2026-04-22 Tejas Anvekar , Junha Park , Aparna Garimella , Vivek Gupta

Recent advancements in language models (LMs) have notably enhanced their ability to reason with tabular data, primarily through program-aided mechanisms that manipulate and analyze tables. However, these methods often require the entire…

Multimodal large language models (MLLMs) are increasingly deployed as the core reasoning engine for web-facing systems, powering GUI agents and front-end automation that must interpret page structure, select actionable widgets, and execute…

Artificial Intelligence · Computer Science 2026-03-05 Junliang Liu , Jingyu Xiao , Wenxin Tang , Zhixian Wang , Zipeng Xie , Wenxuan Wang , Minrui Zhang , Shuanghe Yu

Benchmark datasets for table structure recognition (TSR) must be carefully processed to ensure they are annotated consistently. However, even if a dataset's annotations are self-consistent, there may be significant inconsistency across…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Brandon Smock , Rohith Pesala , Robin Abraham

Current Large Language Models (LLMs) exhibit limited ability to understand table structures and to apply precise numerical reasoning, which is crucial for tasks such as table question answering (TQA) and table-based fact verification (TFV).…

Computation and Language · Computer Science 2025-07-11 Xinyuan Lu , Liangming Pan , Yubo Ma , Preslav Nakov , Min-Yen Kan

Recent Tabular Foundation Models (TFMs) have demonstrated state-of-the-art predictive performance, often surpassing Gradient-Boosted Decision Trees (GBDTs). However, the trustworthiness of these models, particularly their uncertainty…

Machine Learning · Computer Science 2026-05-28 José Lucas De Melo Costa , Fabrice Popineau , Arpad Rimmel , Bich-Liên Doan

Robustness is often regarded as a critical future challenge for real-world applications, where stability is essential. However, as models often learn tasks in a similar order, we hypothesize that easier tasks will be easier regardless of…

Machine Learning · Computer Science 2026-02-04 Shir Ashury-Tahan , Ariel Gera , Elron Bandel , Michal Shmueli-Scheuer , Leshem Choshen

For task-oriented dialog systems to be maximally useful, it must be able to process conversations in a way that is (1) generalizable with a small number of training examples for new task domains, and (2) robust to user input in various…

Computation and Language · Computer Science 2021-01-01 Baolin Peng , Chunyuan Li , Zhu Zhang , Chenguang Zhu , Jinchao Li , Jianfeng Gao

Principled evaluation is critical for progress in deep reinforcement learning (RL), yet it lags behind the theory-driven benchmarks of tabular RL. While tabular settings benefit from well-understood hardness measures like MDP diameter and…

Machine Learning · Computer Science 2025-09-23 Michelangelo Conserva , Remo Sasso , Paulo Rauber

Complex reasoning over tabular data is crucial in real-world data analysis, yet large language models (LLMs) often underperform due to complex queries, noisy data, and limited numerical capabilities. To address these issues, we propose…

Artificial Intelligence · Computer Science 2025-11-06 Changjiang Jiang , Fengchang Yu , Haihua Chen , Wei Lu , Jin Zeng