English
Related papers

Related papers: TransientTables: Evaluating LLMs' Reasoning on Tem…

200 papers

Periodic or quasi-periodic phenomena reveal intrinsic characteristics in various natural processes, such as weather patterns, movement behaviors, traffic flows, and biological signals. Given that these phenomena span multiple modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Yuting Zhang , Hao Lu , Qingyong Hu , Yin Wang , Kaishen Yuan , Xin Liu , Kaishun Wu

Large Language Models (LLMs) have achieved remarkable success in various NLP tasks, yet they still face significant challenges in reasoning and arithmetic. Temporal reasoning, a critical component of natural language understanding, has…

Machine Learning · Computer Science 2025-07-22 Duygu Sezen Islakoglu , Jan-Christoph Kalo

Current Large Language Models (LLMs) are unparalleled in their ability to generate grammatically correct, fluent text. LLMs are appearing rapidly, and debates on LLM capacities have taken off, but reflection is lagging behind. Thus, in this…

Computation and Language · Computer Science 2023-11-01 Bram M. A. van Dijk , Tom Kouwenhoven , Marco R. Spruit , Max J. van Duijn

Large language models (LLMs) have achieved remarkable performance in language understanding and generation tasks by leveraging vast amounts of online texts. Unlike conventional models, LLMs can adapt to new domains through prompt…

Artificial Intelligence · Computer Science 2024-06-18 Ming Cheung

With the increasing capabilities of Large Language Models (LLMs), parallel reasoning has emerged as a new inference paradigm that enhances reasoning robustness by concurrently exploring multiple lines of thought before converging on a final…

Computation and Language · Computer Science 2025-10-15 Ziqi Wang , Boye Niu , Zipeng Gao , Zhi Zheng , Tong Xu , Linghui Meng , Zhongli Li , Jing Liu , Yilong Chen , Chen Zhu , Hua Wu , Haifeng Wang , Enhong Chen

The cognitive and reasoning abilities of large language models (LLMs) have enabled remarkable progress in natural language processing. However, their performance in interpreting structured data, especially in tabular formats, remains…

Computation and Language · Computer Science 2025-07-25 Rana Alshaikh , Israa Alghanmi , Shelan Jeawak

Large language models (LLMs) have demonstrated remarkable progress in understanding long-context inputs. However, benchmarks for evaluating the long-context reasoning abilities of LLMs fall behind the pace. Existing benchmarks often focus…

Computation and Language · Computer Science 2025-11-19 Zhan Ling , Kang Liu , Kai Yan , Yifan Yang , Weijian Lin , Ting-Han Fan , Lingfeng Shen , Zhengyin Du , Jiecao Chen

Large Language Models (LLMs), while being increasingly dominant on a myriad of knowledge-intensive activities, have only had limited success understanding lengthy table-text mixtures, such as academic papers and financial reports. Recent…

Computation and Language · Computer Science 2024-12-16 Yikang Pan , Yi Zhu , Rand Xie , Yizhi Liu

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

Machine Learning · Computer Science 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

Table reasoning is a challenging task that requires understanding both natural language questions and structured tabular data. Large language models (LLMs) have shown impressive capabilities in natural language understanding and generation,…

Computation and Language · Computer Science 2024-04-17 Md Mahadi Hasan Nahid , Davood Rafiei

Tabular data is ubiquitous in real-world applications and abundant on the web, yet its annotation has traditionally required human labor, posing a significant scalability bottleneck for tabular machine learning. Our methodology can…

Machine Learning · Computer Science 2024-06-25 Yaojie Hu , Ilias Fountalis , Jin Tian , Nikolaos Vasiloglou

The rapid advancements in large Language models (LLMs) have significantly enhanced their reasoning capabilities, driven by various strategies such as multi-agent collaboration. However, unlike the well-established performance improvements…

Artificial Intelligence · Computer Science 2026-04-23 Zihan Chen , Song Wang , Zhen Tan , Xingbo Fu , Zhenyu Lei , Peng Wang , Huan Liu , Cong Shen , Jundong Li

Understanding how data moves, transforms, and persists, known as data flow, is fundamental to reasoning in procedural tasks. Despite their fluency in natural and programming languages, large language models (LLMs), although increasingly…

Artificial Intelligence · Computer Science 2025-06-02 Vishal Pallagani , Nitin Gupta , John Aydin , Biplav Srivastava

Language models (LMs) are trained on web text originating from many points in time and, in general, without any explicit temporal grounding. This work investigates the temporal chaos of pretrained LMs and explores various methods to align…

Computation and Language · Computer Science 2024-06-11 Bowen Zhao , Zander Brumbaugh , Yizhong Wang , Hannaneh Hajishirzi , Noah A. Smith

Tables are among the most widely used tools for representing structured data in research, business, medicine, and education. Although LLMs demonstrate strong performance in downstream tasks, their efficiency in processing tabular data…

Computation and Language · Computer Science 2025-08-27 Ekaterina Borisova , Fabio Barth , Nils Feldhus , Raia Abu Ahmad , Malte Ostendorff , Pedro Ortiz Suarez , Georg Rehm , Sebastian Möller

Large language models (LLMs) enable researchers to analyze text at unprecedented scale and minimal cost. Researchers can now revisit old questions and tackle novel ones with rich data. We provide an econometric framework for realizing this…

Econometrics · Economics 2025-12-08 Jens Ludwig , Sendhil Mullainathan , Ashesh Rambachan

Table reasoning, including tabular QA and fact verification, often depends on annotated data or complex data augmentation, limiting flexibility and generalization. LLMs, despite their versatility, often underperform compared to simple…

Artificial Intelligence · Computer Science 2025-11-19 Yiran Rex Ma

Large language models (LLMs) have demonstrated impressive capabilities in natural language processing. However, their internal mechanisms are still unclear and this lack of transparency poses unwanted risks for downstream applications.…

Computation and Language · Computer Science 2023-11-30 Haiyan Zhao , Hanjie Chen , Fan Yang , Ninghao Liu , Huiqi Deng , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Mengnan Du

Large Language Models (LLMs) excel at text summarization, a task that requires models to select content based on its importance. However, the exact notion of salience that LLMs have internalized remains unclear. To bridge this gap, we…

Computation and Language · Computer Science 2025-05-28 Jan Trienes , Jörg Schlötterer , Junyi Jessy Li , Christin Seifert

The scientific reasoning ability of large language models (LLMs) has recently attracted significant attention. Time series, as a fundamental modality in scientific data, presents unique challenges that are often overlooked in current…