English
Related papers

Related papers: Towards Benchmarking Foundation Models for Tabular…

200 papers

With the growing popularity of deep learning and foundation models for tabular data, the need for standardized and reliable benchmarks is higher than ever. However, current benchmarks are static. Their design is not updated even if flaws…

Deep generative models have made rapid progress in image, text, audio, and video generation, and are increasingly being applied to structured records. For tabular data, however, generative modeling remains difficult: a dataset may contain…

Machine Learning · Computer Science 2026-05-25 Zhong Li , Qi Huang , Lincen Yang , Jiayang Shi , Zhao Yang , Niki van Stein , Thomas Bäck , Matthijs van Leeuwen

Tabular foundation models represent a growing paradigm in structured data learning, extending the benefits of large-scale pretraining to tabular domains. However, their adoption remains limited due to heterogeneous preprocessing pipelines,…

Machine Learning · Computer Science 2025-12-03 Aditya Tanna , Pratinav Seth , Mohamed Bouadi , Utsav Avaiya , Vinay Kumar Sankarapu

In 2010, the concept of data lake emerged as an alternative to data warehouses for big data management. Data lakes follow a schema-on-read approach to provide rich and flexible analyses. However, although trendy in both the industry and…

Databases · Computer Science 2021-09-06 Pegdwendé Sawadogo , Jérôme Darmont , Camille Noûs

The ability to train generative models that produce realistic, safe and useful tabular data is essential for data privacy, imputation, oversampling, explainability or simulation. However, generating tabular data is not straightforward due…

Machine Learning · Computer Science 2025-09-18 G. Charbel N. Kindji , Lina Maria Rojas-Barahona , Elisa Fromont , Tanguy Urvoy

We present ModelTables, a benchmark of tables in Model Lakes that captures the structured semantics of performance and configuration tables often overlooked by text only retrieval. The corpus is built from Hugging Face model cards, GitHub…

Databases · Computer Science 2025-12-19 Zhengyuan Dong , Victor Zhong , Renée J. Miller

Synthetic tabular data generation has attracted growing attention due to its importance for data augmentation, foundation models, and privacy. However, real-world tabular datasets increasingly contain free-form text fields (e.g., reviews or…

Machine Learning · Computer Science 2026-05-13 Donghong Cai , Jiarui Feng , Yanbo Wang , Da Zheng , Yixin Chen , Muhan Zhang

Table foundation models bring high hopes to data science: pre-trained on tabular data to embark knowledge or priors, they should facilitate downstream tasks on tables. One specific challenge is that of data semantics: numerical entries take…

Machine Learning · Computer Science 2025-07-01 Myung Jun Kim , Félix Lefebvre , Gaëtan Brison , Alexandre Perez-Lebel , Gaël Varoquaux

Tabular data, a fundamental data format in machine learning, is predominantly utilized in competitions and real-world applications. The performance of tabular models--such as gradient boosted decision trees and neural networks--can vary…

Machine Learning · Computer Science 2025-05-20 Si-Yang Liu , Qile Zhou , Han-Jia Ye

We apply foundation models to data discovery and exploration tasks. Foundation models include large language models (LLMs) that show promising performance on a range of diverse tasks unrelated to their training. We show that these models…

Databases · Computer Science 2024-04-09 Moe Kayali , Anton Lykov , Ilias Fountalis , Nikolaos Vasiloglou , Dan Olteanu , Dan Suciu

Spatio-temporal deep learning models aims to utilize useful patterns in such data to support tasks like prediction. However, previous deep learning models designed for specific tasks typically require separate training for each use case,…

Text analytical tasks like word embedding, phrase mining, and topic modeling, are placing increasing demands as well as challenges to existing database management systems. In this paper, we provide a novel algebraic approach based on…

Databases · Computer Science 2020-05-05 Xiuwen Zheng , Amarnath Gupta

Data lakes have emerged as a flexible and scalable solution for storing and analyzing large volumes of heterogeneous data, including structured, semi-structured, and unstructured formats. Despite their growing adoption in both industry and…

Databases · Computer Science 2026-01-28 Yi Lyu , Pei-Chieh Lo , Natan Lidukhover

Large Language Models (LLMs) often struggle with requests related to information retrieval and data manipulation that frequently arise in real-world scenarios under multiple conditions. In this paper, we demonstrate that leveraging tabular…

Artificial Intelligence · Computer Science 2026-01-09 Jio Oh , Geon Heo , Seungjun Oh , Hyunjin Kim , JinYeong Bak , Jindong Wang , Xing Xie , Steven Euijong Whang

Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation…

Computation and Language · Computer Science 2023-05-16 Hanieh Khorashadizadeh , Nandana Mihindukulasooriya , Sanju Tiwari , Jinghua Groppe , Sven Groppe

Tabular data in relational databases represents a significant portion of industrial data. Hence, analyzing and interpreting tabular data is of utmost importance. Application tasks on tabular data are manifold and are often not specified…

Machine Learning · Computer Science 2025-07-09 Astrid Franz , Frederik Hoppe , Marianne Michaelis , Udo Göbel

Despite recent success, large neural models often generate factually incorrect text. Compounding this is the lack of a standard automatic evaluation for factuality--it cannot be meaningfully improved if it cannot be measured. Grounded…

Computation and Language · Computer Science 2022-03-30 Peter West , Chris Quirk , Michel Galley , Yejin Choi

The ubiquity of payment networks generates vast transactional data encoding rich consumer and merchant behavioral patterns. Recent foundation models for transaction analysis process tabular data sequentially but rely on index-based…

Computation and Language · Computer Science 2026-01-12 Xiran Fan , Zhimeng Jiang , Chin-Chia Michael Yeh , Yuzhong Chen , Yingtong Dou , Menghai Pan , Yan Zheng

State-of-the-art data stream mining has long drawn from ensembles of the Very Fast Decision Tree, a seminal algorithm honored with the 2015 KDD Test-of-Time Award. However, the emergence of large tabular models, i.e., transformers designed…

Machine Learning · Computer Science 2025-12-16 Afonso Lourenço , João Gama , Eric P. Xing , Goreti Marreiros

Advances in machine learning research drive progress in real-world applications. To ensure this progress, it is important to understand the potential pitfalls on the way from a novel method's success on academic benchmarks to its practical…

Machine Learning · Computer Science 2024-10-25 Ivan Rubachev , Nikolay Kartashev , Yury Gorishniy , Artem Babenko