中文
相关论文

相关论文: TabReX : Tabular Referenceless eXplainable Evaluat…

200 篇论文

Table-to-text generation (insight generation from tables) is a challenging task that requires precision in analyzing the data. In addition, the evaluation of existing benchmarks is affected by contamination of Large Language Model (LLM)…

计算与语言 · 计算机科学 2025-10-16 Kristýna Onderková , Ondřej Plátek , Zdeněk Kasner , Ondřej Dušek

To migrate the remarkable successes of Large Language Models (LLMs), the community has made numerous efforts to generalize them to the table reasoning tasks for the widely deployed tabular data. Despite that, in this work, by showing a…

计算与语言 · 计算机科学 2026-01-08 Liyao Li , Chao Ye , Wentao Ye , Yifei Sun , Zhe Jiang , Haobo Wang , Jiaming Tian , Yiming Zhang , Ningtao Wang , Xing Fu , Gang Chen , Junbo Zhao

Planning is a fundamental capability for large language models (LLMs) because such complex tasks require models to coordinate goals, constraints, resources, and long-term consequences into executable and verifiable solutions. Existing…

人工智能 · 计算机科学 2026-05-21 Ziliang Zhao , Zenan Xu , Shuting Wang , Hongjin Qian , Yan Lei , Minda Hu , Zhao Wang , Shihan Dou , Zhicheng Dou , Pluto Zhou

Learning to Reject (LtR) frameworks allow ML models to abstain from uncertain predictions and promote user trust. However, since current LtR strategies focus solely on predictive performance, they completely neglect explanation quality.…

机器学习 · 计算机科学 2026-03-19 Luca Stradiotti , Dario Pesenti , Stefano Teso , Jesse Davis

Data quality remains an important challenge in data-driven systems, as errors in tabular data can severely compromise downstream analytics and machine learning performance. Although numerous error detection algorithms have been proposed,…

数据库 · 计算机科学 2026-03-10 Xinyuan Liu , Jiahui Chen , Bocheng Hu , Yu Sun , Xinyang Chen , Shaoxu Song , Yongxin Tong

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

计算与语言 · 计算机科学 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

Recent advancements in large language models (LLMs) have shown promise in feature engineering for tabular data, but concerns about their reliability persist, especially due to variability in generated outputs. We introduce a multi-level…

机器学习 · 计算机科学 2025-10-01 Yebin Lim , Susik Yoon

Tables serve as a fundamental format for representing structured relational data. While current language models (LMs) excel at many text-based tasks, they still face challenges in table understanding due to the complex characteristics of…

计算与语言 · 计算机科学 2026-04-16 Lang Cao , Hanbing Liu

Generating high-fidelity synthetic tabular data remains a critical challenge for enhancing data availability in privacy-sensitive and low-resource domains. Recent approaches leverage LLMs by representing table rows as sequences, yet suffer…

机器学习 · 计算机科学 2026-04-28 Shuo Yang , Zheyu Zhang , Bardh Prenkaj , Gjergji Kasneci

Supervised classification for tabular data remains a core machine learning task, yet its reliance on large labeled datasets limits applicability in data-scarce domains. For such few-shot scenarios, specialized methods like TabPFN - a…

Understanding whether a generated table is of good quality is important to be able to use it in creating or editing documents using automatic methods. In this work, we underline that existing measures for table quality evaluation fail to…

计算与语言 · 计算机科学 2024-11-26 Pritika Ramu , Aparna Garimella , Sambaran Bandyopadhyay

Evaluating factual correctness of LLM generated natural language explanations grounded in time series data remains an open challenge. Although modern models generate textual interpretations of numerical signals, existing evaluation methods…

人工智能 · 计算机科学 2026-04-03 Preetham Sivalingam , Murari Mandal , Saurabh Deshpande , Dhruv Kumar

The cognitive and reasoning abilities of large language models (LLMs) have enabled remarkable progress in natural language processing. However, their performance in interpreting structured data, especially in tabular formats, remains…

计算与语言 · 计算机科学 2025-07-25 Rana Alshaikh , Israa Alghanmi , Shelan Jeawak

Large language models (LLMs) are increasingly evaluated and sometimes trained using automated graders such as LLM-as-judges that output scalar scores or preferences. While convenient, these approaches are often opaque: a single score rarely…

信息检索 · 计算机科学 2026-03-24 Kaustubh D. Dhole , Eugene Agichtein

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across…

信息检索 · 计算机科学 2023-11-07 Zhenrui Yue , Sara Rabhi , Gabriel de Souza Pereira Moreira , Dong Wang , Even Oldridge

We investigate how large language models (LLMs) fail when tabular data in an otherwise canonical representation is subjected to semantic and structural distortions. Our findings reveal that LLMs lack an inherent ability to detect and…

人工智能 · 计算机科学 2026-01-09 Avik Dutta , Harshit Nigam , Hosein Hasanbeig , Arjun Radhakrishna , Sumit Gulwani

Retrieval-Augmented Generation (RAG) has demonstrated considerable effectiveness in open-domain question answering. However, when applied to heterogeneous documents, comprising both textual and tabular components, existing RAG approaches…

计算与语言 · 计算机科学 2025-10-01 Xiaohan Yu , Pu Jian , Chong Chen

While large language models (LLMs) show great potential in temporal reasoning, most existing work focuses heavily on enhancing performance, often neglecting the explainable reasoning processes underlying the results. To address this gap, we…

计算与语言 · 计算机科学 2025-05-22 Zihao Jiang , Ben Liu , Miao Peng , Wenjie Xu , Yao Xiao , Zhenyan Shan , Min Peng

The evaluation of natural language generation (NLG) tasks is a significant and longstanding research area. With the recent emergence of powerful large language models (LLMs), some studies have turned to LLM-based automatic evaluation…

计算与语言 · 计算机科学 2024-10-10 Xinyu Hu , Li Lin , Mingqi Gao , Xunjian Yin , Xiaojun Wan

Tabular synthesis models remain ineffective at capturing complex dependencies, and the quality of synthetic data is still insufficient for comprehensive downstream tasks, such as prediction under distribution shifts, automated…

机器学习 · 计算机科学 2024-07-08 Ruibo Tu , Zineb Senane , Lele Cao , Cheng Zhang , Hedvig Kjellström , Gustav Eje Henter