English
Related papers

Related papers: The Mighty ToRR: A Benchmark for Table Reasoning a…

200 papers

The increasing reliance on Large Language Models (LLMs) across academia and industry necessitates a comprehensive understanding of their robustness to prompts. In response to this vital need, we introduce PromptRobust, a robustness…

Computation and Language · Computer Science 2024-07-17 Kaijie Zhu , Jindong Wang , Jiaheng Zhou , Zichen Wang , Hao Chen , Yidong Wang , Linyi Yang , Wei Ye , Yue Zhang , Neil Zhenqiang Gong , Xing Xie

RL training of multi-turn LLM agents is inherently unstable, and reasoning quality directly determines task performance. Entropy is widely used to track reasoning stability. However, entropy only measures diversity within the same input,…

In cooperative Multi-Agent Reinforcement Learning (MARL), it is a common practice to tune hyperparameters in ideal simulated environments to maximize cooperative performance. However, policies tuned for cooperation often fail to maintain…

Neural text-to-SQL models have achieved remarkable performance in translating natural language questions into SQL queries. However, recent studies reveal that text-to-SQL models are vulnerable to task-specific perturbations. Previous…

Large Language Models (LLMs) and their multimodal variants (LVLMs) hold immense promise for scientific and engineering applications, particularly in processing visual information like scientific diagrams. However, their practical deployment…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Minghao Zhou , Rafael Souza , Yaqian Hu , Luming Che

Table reasoning, which aims to generate the corresponding answer to the question following the user requirement according to the provided table, and optionally a text description of the table, effectively improving the efficiency of…

Computation and Language · Computer Science 2024-02-14 Xuanliang Zhang , Dingzirui Wang , Longxu Dou , Qingfu Zhu , Wanxiang Che

Large Reasoning Models (LRMs) increasingly rely on reasoning traces with complex internal structures. However, existing work lacks a unified answer to three fundamental questions: (1) what defines high-quality reasoning, (2) how to reliably…

Computation and Language · Computer Science 2026-02-10 Haoran Zhang , Yafu Li , Zhi Wang , Zhilin Wang , Shunkai Zhang , Xiaoye Qu , Yu Cheng

Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads…

Computation and Language · Computer Science 2025-08-14 Yue Liu , Jiaying Wu , Yufei He , Ruihan Gong , Jun Xia , Liang Li , Hongcheng Gao , Hongyu Chen , Baolong Bi , Jiaheng Zhang , Zhiqi Huang , Bryan Hooi , Stan Z. Li , Keqin Li

Recent breakthroughs in large language modeling have facilitated rigorous exploration of their application in diverse tasks related to tabular data modeling, such as prediction, tabular data synthesis, question answering, and table…

Robust explanations of machine learning models are critical to establish human trust in the models. Due to limited cognition capability, most humans can only interpret the top few salient features. It is critical to make top salient…

Machine Learning · Computer Science 2023-07-11 Chao Chen , Chenghua Guo , Guixiang Ma , Ming Zeng , Xi Zhang , Sihong Xie

Table structure recognition (TSR) holds widespread practical importance by parsing tabular images into structured representations, yet encounters significant challenges when processing complex layouts involving merged or empty cells.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Boming Chen , Zining Wang , Zhentao Guo , Jianqiang Liu , Chen Duan , Yu Gu , Kai zhou , Pengfei Yan

Existing datasets for multimodal table understanding, such as MMTab, primarily provide short factual answers without explicit multi-step reasoning supervision. Models trained on these datasets often generate brief responses that offers…

Artificial Intelligence · Computer Science 2026-01-28 Van-Quang Nguyen , Takayuki Okatani

Large Reasoning Models (LRMs) exhibit strong performance, yet often produce rationales that sound plausible but fail to reflect their true decision process, undermining reliability and trust. We introduce a formal framework for reasoning…

Artificial Intelligence · Computer Science 2026-02-24 Yunseok Han , Yejoon Lee , Jaeyoung Do

Meticulously analysing the empirical strengths and weaknesses of reinforcement learning methods in hard (challenging) environments is essential to inspire innovations and assess progress in the field. In tabular reinforcement learning,…

Machine Learning · Computer Science 2022-10-25 Michelangelo Conserva , Paulo Rauber

Recent advances in large language models (LLMs) have enabled near-human performance on software coding benchmarks, but their effectiveness in RTL code generation remains limited due to the scarcity of high-quality training data. While prior…

Hardware Architecture · Computer Science 2025-07-17 Chenhui Deng , Yun-Da Tsai , Guan-Ting Liu , Zhongzhi Yu , Haoxing Ren

To migrate the remarkable successes of Large Language Models (LLMs), the community has made numerous efforts to generalize them to the table reasoning tasks for the widely deployed tabular data. Despite that, in this work, by showing a…

Computation and Language · Computer Science 2026-01-08 Liyao Li , Chao Ye , Wentao Ye , Yifei Sun , Zhe Jiang , Haobo Wang , Jiaming Tian , Yiming Zhang , Ningtao Wang , Xing Fu , Gang Chen , Junbo Zhao

Enterprise LLM applications require consistently high quality and reliable performance across diverse scenarios, demanding robustness to minor variations. Existing research shows that even small prompt changes can lead to substantial…

Machine Learning · Computer Science 2026-01-13 Tara Bogavelli , Oluwanifemi Bamgbose , Gabrielle Gauthier Melançon , Fanny Riols , Roshnee Sharma

In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities in parsing textual data and generating code. However, their performance in tasks involving tabular data, especially those requiring symbolic reasoning,…

Computation and Language · Computer Science 2025-04-04 Md Mahadi Hasan Nahid , Davood Rafiei

Recent tabular Foundational Models (FM) such as TabPFN and TabICL, leverage in-context learning to achieve strong performance without gradient updates or fine-tuning. However, their robustness to adversarial manipulation remains largely…

Machine Learning · Computer Science 2026-04-10 Mohamed Djilani , Thibault Simonetto , Karim Tit , Florian Tambon , Salah Ghamizi , Maxime Cordy , Mike Papadakis

Large Language Models (LLMs) often struggle with requests related to information retrieval and data manipulation that frequently arise in real-world scenarios under multiple conditions. In this paper, we demonstrate that leveraging tabular…

Artificial Intelligence · Computer Science 2026-01-09 Jio Oh , Geon Heo , Seungjun Oh , Hyunjin Kim , JinYeong Bak , Jindong Wang , Xing Xie , Steven Euijong Whang