English
Related papers

Related papers: TabDSR: Decompose, Sanitize, and Reason for Comple…

200 papers

Large Language Models (LLMs) excel in natural language tasks, but less is known about their reasoning capabilities over tabular data. Prior analyses devise evaluation strategies that poorly reflect an LLM's realistic performance on tabular…

Artificial Intelligence · Computer Science 2025-11-05 Cornelius Wolff , Madelon Hulsebos

Discrete diffusion models offer global context awareness and flexible parallel generation. However, uniform random noise schedulers in standard DLLM training overlook the highly non-uniform information density inherent in real-world…

Machine Learning · Computer Science 2026-03-18 Linrui Ma , Yufei Cui , Kai Han , Yunhe Wang

We present Team asdfo123's submission to the LLMSR@XLLM25 shared task, which evaluates large language models on producing fine-grained, controllable, and interpretable reasoning processes. Systems must extract all problem conditions,…

Computation and Language · Computer Science 2025-05-20 Xinye Li , Mingqi Wan , Dianbo Sui

Modeling semantic and structural information from tabular data remains a core challenge for effective table understanding. Existing Table-as-Text approaches flatten tables for large language models (LLMs), but lose crucial structural cues,…

Computation and Language · Computer Science 2026-02-12 Xiaobo Xing , Wei Yuan , Tong Chen , Quoc Viet Hung Nguyen , Xiangliang Zhang , Hongzhi Yin

The widespread application of pre-trained language models (PLMs) in natural language processing (NLP) has led to increasing concerns about their explainability. Selective rationalization is a self-explanatory framework that selects…

Computation and Language · Computer Science 2025-01-07 Libing Yuan , Shuaibo Hu , Kui Yu , Le Wu

Large language models (LLMs) have made impressive progress in handling simple math problems, yet they still struggle with more challenging and complex mathematical tasks. In this paper, we introduce a series of LLMs that employs the…

Computation and Language · Computer Science 2024-07-18 Chengpeng Li , Guanting Dong , Mingfeng Xue , Ru Peng , Xiang Wang , Dayiheng Liu

Recent advancements in tabular deep learning (DL) have led to substantial performance improvements, surpassing the capabilities of traditional models. With the adoption of techniques from natural language processing (NLP), such as language…

Machine Learning · Computer Science 2024-11-27 Anton Frederik Thielmann , Soheila Samiee

Recent breakthroughs in large language modeling have facilitated rigorous exploration of their application in diverse tasks related to tabular data modeling, such as prediction, tabular data synthesis, question answering, and table…

Large language models (LLMs) have shown significant progress in reasoning tasks. However, recent studies show that transformers and LLMs fail catastrophically once reasoning problems exceed modest complexity. We revisit these findings…

Artificial Intelligence · Computer Science 2025-10-28 Revanth Rameshkumar , Jimson Huang , Yunxin Sun , Fei Xia , Abulhair Saparov

Despite the remarkable success of large language models (LLMs) on traditional natural language processing tasks, their planning ability remains a critical bottleneck in tackling complex multi-step reasoning tasks. Existing approaches mainly…

Computation and Language · Computer Science 2024-10-07 Jiaxin Wen , Jian Guan , Hongning Wang , Wei Wu , Minlie Huang

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

Computation and Language · Computer Science 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

Structured tables are essential for conveying high-density information in professional domains such as finance, healthcare, and scientific research. Despite the progress in Multimodal Large Language Models (MLLMs), reasoning performance…

Artificial Intelligence · Computer Science 2026-04-07 Xiaoyu Chen , Lu Dai , Hanqing Wang , Zhuoyu Li , Wenbin Dai , Yanzong Zheng , Zhenggang Xia , Junyong Lin , Hui Xiong

Tabular data synthesis is crucial in machine learning, yet existing general methods-primarily based on statistical or deep learning models-are highly data-dependent and often fall short in recommender systems. This limitation arises from…

Information Retrieval · Computer Science 2025-02-12 Jingtong Gao , Zhaocheng Du , Xiaopeng Li , Yichao Wang , Xiangyang Li , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Large language models (LLMs) face significant challenges in specialized biomedical tasks due to the inherent complexity of medical reasoning and the sensitive nature of clinical data. Existing LLMs often struggle with intricate medical…

Computation and Language · Computer Science 2026-05-12 Zongxian Yang , Jiayu Qian , Kay Chen Tan , Hau-San Wong , Yulong Chen , Haoyu Zhang , Zhi-An Huang

Synthetic tabular data are increasingly being used to replace real data, serving as an effective solution that simultaneously protects privacy and addresses data scarcity. However, in addition to preserving global statistical properties,…

Machine Learning · Computer Science 2026-05-19 Yunbo Long , Liming Xu , Alexandra Brintrup

General-purpose Large Language Models (LLMs) have achieved remarkable success in intelligence, performing comparably to human experts on complex reasoning tasks such as coding and mathematical reasoning. However, generating formal proofs in…

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal…

Machine Learning · Computer Science 2025-05-12 Ruxue Shi , Hengrui Gu , Xu Shen , Xin Wang

While large language models (LLMs) equipped with techniques like chain-of-thought prompting have demonstrated impressive capabilities, they still fall short in their ability to reason robustly in complex settings. However, evaluating LLM…

Computation and Language · Computer Science 2024-03-26 Zayne Sprague , Xi Ye , Kaj Bostrom , Swarat Chaudhuri , Greg Durrett

Large Language Models (LLMs) have shown remarkable performance on complex reasoning tasks, especially when equipped with long chain-of-thought (CoT) reasoning. However, eliciting long CoT typically requires large-scale reinforcement…

Computation and Language · Computer Science 2026-01-30 Huiyuan Lai , Malvina Nissim

Large language models often struggle with complex long-horizon analytical tasks over unstructured tables, which typically feature hierarchical and bidirectional headers and non-canonical layouts. We formalize this challenge as Deep Tabular…

Artificial Intelligence · Computer Science 2026-03-13 Junnan Dong , Chuang Zhou , Zheng Yuan , Yifei Yu , Qiufeng Wang , Yinghui Li , Siyu An , Di Yin , Xing Sun , Feiyue Huang