English
Related papers

Related papers: StructSynth: Leveraging LLMs for Structure-Aware T…

200 papers

Diffusion-based tabular data synthesis models have yielded promising results. However, when the data dimensionality increases, existing models tend to degenerate and may perform even worse than simpler, non-diffusion-based models. This is…

Machine Learning · Computer Science 2025-11-12 Zuqing Li , Junhao Gan , Jianzhong Qi

Synthetic tabular data generation with differential privacy is a crucial problem to enable data sharing with formal privacy. Despite a rich history of methodological research and development, developing differentially private tabular data…

Machine Learning · Computer Science 2024-06-05 Toan V. Tran , Li Xiong

Large Language Models (LLMs) have been widely adopted in conversational applications. However, their reliance on parametric knowledge limits reliability in real-world scenarios that require dynamic or domain-specific information.…

Computation and Language · Computer Science 2026-05-26 Kaiqiao Han , LuAn Tang , Renliang Sun , Peng Yuan , Wei Cheng , Haoyu Wang , Wei Wang , Yizhou Sun , Haifeng Chen

Large language models (LLMs) have shown promise in synthetic tabular data generation, yet existing methods struggle to preserve complex feature dependencies, particularly among categorical variables. This work introduces a…

Machine Learning · Computer Science 2025-05-07 Andrey Sidorenko

Recent advancements in large language models (LLMs) have significantly enhanced their knowledge and generative capabilities, leading to a surge of interest in leveraging LLMs for high-quality data synthesis. However, synthetic data…

Machine Learning · Computer Science 2025-06-11 Ying Zhou , Xinyao Wang , Yulei Niu , Yaojie Shen , Lexin Tang , Fan Chen , Ben He , Le Sun , Longyin Wen

Recent advancements in generative AI facilitate large-scale synthetic data generation for model evaluation. However, without targeted approaches, these datasets often lack the sociotechnical nuance required for sensitive domains. We…

Machine learning for tabular data remains constrained by poor schema generalization, a challenge rooted in the lack of semantic understanding of structured variables. This challenge is particularly acute in domains like clinical medicine,…

Machine Learning · Computer Science 2026-05-05 Hongxi Mao , Wei Zhou , Mengting Jia , Tao Fang , Huan Gao , Bin Zhang , Shangyang Li

Synthetic data generation is integral to ML pipelines, e.g., to augment training data, replace sensitive information, and even to power advanced platforms like DeepSeek. While LLMs fine-tuned for synthetic data generation are gaining…

Machine Learning · Computer Science 2025-03-17 Shengzhe Xu , Cho-Ting Lee , Mandar Sharma , Raquib Bin Yousuf , Nikhil Muralidhar , Naren Ramakrishnan

Despite the commendable progress of recent LLM-based data synthesis methods, they face two limitations in generating table instruction tuning data. First, they can not thoroughly explore the vast input space of table understanding tasks,…

Computation and Language · Computer Science 2025-06-11 Mingyu Zheng , Zhifan Feng , Jia Wang , Lanrui Wang , Zheng Lin , Yang Hao , Weiping Wang

Synthetic data generation for tabular datasets must balance fidelity, efficiency, and versatility to meet the demands of real-world applications. We introduce the Tabular Auto-Regressive Generative Network (TabularARGN), a flexible…

Machine Learning · Computer Science 2025-02-07 Paul Tiwald , Ivona Krchova , Andrey Sidorenko , Mariana Vargas Vieyra , Mario Scriminaci , Michael Platzer

Deep Generative Models (DGMs) have been shown to be powerful tools for generating tabular data, as they have been increasingly able to capture the complex distributions that characterize them. However, to generate realistic synthetic data,…

Machine Learning · Computer Science 2024-02-08 Mihaela Cătălina Stoian , Salijona Dyrmishi , Maxime Cordy , Thomas Lukasiewicz , Eleonora Giunchiglia

In this paper, we study how to improve the zero-shot reasoning ability of large language models~(LLMs) over structured data in a unified way. Inspired by the study on tool augmentation for LLMs, we develop an \emph{Iterative…

Computation and Language · Computer Science 2023-10-24 Jinhao Jiang , Kun Zhou , Zican Dong , Keming Ye , Wayne Xin Zhao , Ji-Rong Wen

Structured data offers a sophisticated mechanism for the organization of information. Existing methodologies for the text-serialization of structured data in the context of large language models fail to adequately address the heterogeneity…

Computation and Language · Computer Science 2024-02-20 YiQiu Guo , Yuchen Yang , Ya Zhang , Yu Wang , Yanfeng Wang

Deep generative models for tabular data (GANs, diffusion models, and LLM-based generators) exhibit highly non-uniform behavior across datasets; the best-performing synthesizer family depends strongly on distributional stressors such as…

Machine Learning · Computer Science 2026-04-02 Hochan Son , Xiaofeng Lin , Jason Ni , Guang Cheng

Data serves as the fundamental foundation for advancing deep learning, particularly tabular data presented in a structured format, which is highly conducive to modeling. However, even in the era of LLM, obtaining tabular data from sensitive…

Machine Learning · Computer Science 2024-08-07 Yuxin Wang , Duanyu Feng , Yongfu Dai , Zhengyu Chen , Jimin Huang , Sophia Ananiadou , Qianqian Xie , Hao Wang

Large Language Models (LLMs) offer a flexible means to generate synthetic tabular data, yet existing approaches often fail to preserve key causal parameters such as the average treatment effect (ATE). In this technical exploration, we first…

Machine Learning · Computer Science 2025-11-04 Dana Kim , Yichen Xu , Tiffany Lin

Structured data sources, such as tables, graphs, and databases, are ubiquitous knowledge sources. Despite the demonstrated capabilities of large language models (LLMs) on plain text, their proficiency in interpreting and utilizing…

Computation and Language · Computer Science 2024-10-08 Alex Zhuang , Ge Zhang , Tianyu Zheng , Xinrun Du , Junjie Wang , Weiming Ren , Stephen W. Huang , Jie Fu , Xiang Yue , Wenhu Chen

Model customization necessitates high-quality and diverse datasets, but acquiring such data remains time-consuming and labor-intensive. Despite the great potential of large language models (LLMs) for data synthesis, current approaches are…

Machine Learning · Computer Science 2025-06-24 Sheng Wang , Pengan Chen , Jingqi Zhou , Qintong Li , Jingwei Dong , Jiahui Gao , Boyang Xue , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Synthetic tabular data is increasingly used in privacy-sensitive domains such as health care, but existing generative models often fail to preserve inter-attribute relationships. In particular, functional dependencies (FDs) and logical…

Machine Learning · Computer Science 2025-07-28 Chaithra Umesh , Kristian Schultz , Manjunath Mahendra , Saptarshi Bej , Olaf Wolkenhauer

Machine Learning (ML) in low-data settings remains an underappreciated yet crucial problem. Hence, data augmentation methods to increase the sample size of datasets needed for ML are key to unlocking the transformative potential of ML in…

Machine Learning · Computer Science 2024-07-02 Nabeel Seedat , Nicolas Huynh , Boris van Breugel , Mihaela van der Schaar