English
Related papers

Related papers: Tabular Foundation Model for Generative Modelling

200 papers

Tabular-image multimodal learning, which integrates structured tabular data with imaging data, holds great promise for a variety of tasks, especially in medical applications. Yet, two key challenges remain: (1) the lack of a standardized,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jiaqi Luo , Yuan Yuan , Shixin Xu

Synthetic tabular data generation has gained significant attention for its potential in data augmentation and privacy-preserving data sharing. While recent methods like diffusion and auto-regressive models (i.e., transformer) have advanced…

Machine Learning · Computer Science 2025-12-15 Jiayu Li , Zilong Zhao , Kevin Yee , Uzair Javaid , Biplab Sikdar

Training data has been proven to be one of the most critical components in training generative AI. However, obtaining high-quality data remains challenging, with data privacy issues presenting a significant hurdle. To address the need for…

Computation and Language · Computer Science 2025-06-18 Jia-Chen Zhang , Zheng Zhou , Yu-Jie Xiong , Chun-Ming Xia , Fei Dai

Combinatorial optimization problems are ubiquitous in science and engineering. Still, learning-based approaches to accelerate combinatorial optimization often require solving a large number of difficult instances to collect training data,…

Machine Learning · Computer Science 2025-09-25 Zohair Shafi , Serdar Kadioglu

Foundation models have established unified representations for natural language processing, yet this paradigm remains largely unexplored for tabular data. Existing methods face fundamental limitations: LLM-based approaches lack…

Computation and Language · Computer Science 2026-05-07 Minjie Qiang , Mingming Zhang , Xiaoyi Bao , Xing Fu , Yu Cheng , Weiqiang Wang , Zhongqing Wang , Ningtao Wang

This work presents a novel approach to tabular data prediction leveraging graph structure learning and graph neural networks. Despite the prevalence of tabular data in real-world applications, traditional deep learning methods often…

Machine Learning · Computer Science 2023-05-26 Jay Chiehen Liao , Cheng-Te Li

Synthetic tabular data are often evaluated by distributional similarity, privacy distance, or train-on-synthetic-test-on-real predictive performance, but these criteria do not ensure validity for causal inference. We show that fully…

Methodology · Statistics 2026-05-12 Yichen Xu

Ensuring fairness in machine learning remains a significant challenge, as models often inherit biases from their training data. Generative models have recently emerged as a promising approach to mitigate bias at the data level while…

Machine Learning · Computer Science 2025-09-25 Emmanouil Panagiotou , Benoît Ronval , Arjun Roy , Ludwig Bothmann , Bernd Bischl , Siegfried Nijssen , Eirini Ntoutsi

Tabular foundation models represent a growing paradigm in structured data learning, extending the benefits of large-scale pretraining to tabular domains. However, their adoption remains limited due to heterogeneous preprocessing pipelines,…

Machine Learning · Computer Science 2025-12-03 Aditya Tanna , Pratinav Seth , Mohamed Bouadi , Utsav Avaiya , Vinay Kumar Sankarapu

Temporal causal discovery is a crucial task aimed at uncovering the causal relations within time series data. The latest temporal causal discovery methods usually train deep learning models on prediction tasks to uncover the causality…

Machine Learning · Computer Science 2024-06-25 Lingbai Kong , Wengen Li , Hanchen Yang , Yichao Zhang , Jihong Guan , Shuigeng Zhou

Recent foundation models for tabular data achieve strong task-specific performance via in-context learning. Nevertheless, they focus on direct prediction by encapsulating both representation learning and task-specific inference inside a…

Machine Learning · Computer Science 2026-02-05 Frederik Hoppe , Lars Kleinemeier , Astrid Franz , Udo Göbel

Synthetic tabular data generation has received increasing attention in recent years, particularly with the emergence of foundation models for tabular data. The breakthrough success of TabPFN (Hollmann et al.,2025), which leverages vast…

Machine Learning · Computer Science 2025-07-08 Frederik Hoppe , Astrid Franz , Lars Kleinemeier , Udo Göbel

Diffusion models have been the predominant generative model for tabular data generation. However, they face the conundrum of modeling under a separate versus a unified data representation. The former encounters the challenge of jointly…

Machine Learning · Computer Science 2025-12-23 Jacob Si , Zijing Ou , Mike Qu , Zhengrui Xiang , Yingzhen Li

Trajectory data generation is an important domain that characterizes the generative process of mobility data. Traditional methods heavily rely on predefined heuristics and distributions and are weak in learning unknown mechanisms. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Liming Zhang , Liang Zhao , Dieter Pfoser

Recent advancements in NLP have witnessed the groundbreaking impact of pretrained models, yielding impressive outcomes across various tasks. This study seeks to extend the power of pretraining methodologies to facilitating the prediction…

Machine Learning · Computer Science 2024-03-14 Yazheng Yang , Yuqi Wang , Guang Liu , Ledell Wu , Qi Liu

Transformer-based tabular foundation models have recently demonstrated promising in-context learning (ICL) performance on structured data, emerging as competitive alternatives to gradient-boosted trees. However, the fairness implications of…

Machine Learning · Computer Science 2026-01-06 Patrik Kenfack , Samira Ebrahimi Kahou , Ulrich Aïvodji

In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represent the inferred \textbf{latent data distribution}, i.e. its topology and structural properties. We…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Shuyu Lin , Ronald Clark

Tabular data is prevalent across diverse domains in machine learning. With the rapid progress of deep tabular prediction methods, especially pretrained (foundation) models, there is a growing need to evaluate these methods systematically…

Machine Learning · Computer Science 2025-11-10 Han-Jia Ye , Si-Yang Liu , Hao-Run Cai , Qi-Le Zhou , De-Chuan Zhan

Tabular data builds the basis for a wide range of applications, yet real-world datasets are frequently incomplete due to collection errors, privacy restrictions, or sensor failures. As missing values degrade the performance or hinder the…

Tabular data is one of the most ubiquitous sources of information worldwide, spanning a wide variety of domains. This inherent heterogeneity has slowed the development of Tabular Foundation Models (TFMs) capable of fast generalization to…