English
Related papers

Related papers: Team, Then Trim: An Assembly-Line LLM Framework fo…

200 papers

With the growing demands of AI-generated content (AIGC), the need for high-quality, diverse, and scalable data has become increasingly crucial. However, collecting large-scale real-world data remains costly and time-consuming, hindering the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Kunyu Feng , Yue Ma , Xinhua Zhang , Boshi Liu , Yikuang Yuluo , Yinhan Zhang , Runtao Liu , Hongyu Liu , Zhiyuan Qin , Shanhui Mo , Qifeng Chen , Zeyu Wang

The reasoning capabilities of Large Language Models (LLMs) play a critical role in many downstream tasks, yet depend strongly on the quality of training data. Despite various proposed data construction methods, their practical utility in…

Computation and Language · Computer Science 2025-10-09 Yike Zhao , Simin Guo , Ziqing Yang , Shifan Han , Dahua Lin , Fei Tan

Feature transformation enhances data representation by deriving new features from the original data. Generative AI offers potential for this task, but faces challenges in stable generation (consistent outputs) and valid generation…

Machine Learning · Computer Science 2025-06-12 Xinyuan Wang , Haoyue Bai , Nanxu Gong , Wangyang Ying , Sixun Dong , Xiquan Cui , Yanjie Fu

Tabular data generation has become increasingly essential for enabling robust machine learning applications, which require large-scale, high-quality data. Existing solutions leverage generative models to learn original data distributions.…

Machine Learning · Computer Science 2025-12-29 Yafeng Tang , Xiaoou Ding , Jianzhuo Du , Zishuo Yan , Zhuang Ma , Zheng Liang , Zekai Qian , Hongzhi Wang

Synthetic data generation is integral to ML pipelines, e.g., to augment training data, replace sensitive information, and even to power advanced platforms like DeepSeek. While LLMs fine-tuned for synthetic data generation are gaining…

Machine Learning · Computer Science 2025-03-17 Shengzhe Xu , Cho-Ting Lee , Mandar Sharma , Raquib Bin Yousuf , Nikhil Muralidhar , Naren Ramakrishnan

Tabular data have been playing a vital role in diverse real-world fields, including healthcare, finance, etc. With the recent success of Large Language Models (LLMs), early explorations of extending LLMs to the domain of tabular data have…

Machine Learning · Computer Science 2025-12-11 Hangting Ye , Jinmeng Li , He Zhao , Dandan Guo , Yi Chang

Large Language Models (LLMs) such as GPT-4 and Llama3 have significantly impacted various fields by enabling high-quality synthetic data generation and reducing dependence on expensive human-generated datasets. Despite this, challenges…

Computation and Language · Computer Science 2025-11-18 Yue Huang , Siyuan Wu , Chujie Gao , Dongping Chen , Qihui Zhang , Yao Wan , Tianyi Zhou , Jianfeng Gao , Chaowei Xiao , Lichao Sun , Xiangliang Zhang

Synthetic tabular data is used for privacy-preserving data sharing and data-driven model development. Its effectiveness, however, depends heavily on the used Tabular Data Synthesis (TDS) tool. Recent studies have shown that…

Machine Learning · Computer Science 2025-09-26 Maria F. Davila R , Azizjon Turaev , Wolfram Wingerath

Large Language Models (LLMs) often do not perform well on queries that require the aggregation of information across texts. To better evaluate this setting and facilitate modeling efforts, we introduce TACT - Text And Calculations through…

Computation and Language · Computer Science 2024-10-15 Avi Caciularu , Alon Jacovi , Eyal Ben-David , Sasha Goldshtein , Tal Schuster , Jonathan Herzig , Gal Elidan , Amir Globerson

It is well known that LLM-based systems are data-hungry. Recent LLM-based TTS works typically employ complex data processing pipelines to obtain high-quality training data. These sophisticated pipelines require excellent models at each…

The application of machine learning on tabular data in specialized domains is severely limited by data scarcity. While generative models offer a solution, traditional methods falter in low-data regimes, and recent Large Language Models…

Machine Learning · Computer Science 2025-08-05 Siyi Liu , Yujia Zheng , Yongqi Zhang

Tabular data is among the oldest and most ubiquitous forms of data. However, the generation of synthetic samples with the original data's characteristics remains a significant challenge for tabular data. While many generative models from…

Machine Learning · Computer Science 2023-04-25 Vadim Borisov , Kathrin Seßler , Tobias Leemann , Martin Pawelczyk , Gjergji Kasneci

Efficient processing of tabular data is important in various industries, especially when working with datasets containing a large number of columns. Large language models (LLMs) have demonstrated their ability on several tasks through…

Machine Learning · Computer Science 2024-08-22 Ashlesha Akella , Abhijit Manatkar , Brij Chavda , Hima Patel

Large language models (LLMs) have shown promise in synthetic tabular data generation, yet existing methods struggle to preserve complex feature dependencies, particularly among categorical variables. This work introduces a…

Machine Learning · Computer Science 2025-05-07 Andrey Sidorenko

Machine learning (ML) on tabular data is ubiquitous, yet obtaining abundant high-quality tabular data for model training remains a significant obstacle. Numerous works have focused on tabular data augmentation (TDA) to enhance the original…

Machine Learning · Computer Science 2024-08-01 Lingxi Cui , Huan Li , Ke Chen , Lidan Shou , Gang Chen

Tabular data is common yet typically incomplete, small in volume, and access-restricted due to privacy concerns. Synthetic data generation offers potential solutions. Many metrics exist for evaluating the quality of synthetic tabular data;…

Machine Learning · Computer Science 2024-04-01 Scott Cheng-Hsin Yang , Baxter Eaves , Michael Schmidt , Ken Swanson , Patrick Shafto

Combining large language models during training or at inference time has shown substantial performance gain over component LLMs. This paper presents LLM-TOPLA, a diversity-optimized LLM ensemble method with three unique properties: (i) We…

Computation and Language · Computer Science 2024-10-08 Selim Furkan Tekin , Fatih Ilhan , Tiansheng Huang , Sihao Hu , Ling Liu

Synthetic tabular data are increasingly being used to replace real data, serving as an effective solution that simultaneously protects privacy and addresses data scarcity. However, in addition to preserving global statistical properties,…

Machine Learning · Computer Science 2026-05-19 Yunbo Long , Liming Xu , Alexandra Brintrup

The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through human annotation is prohibitively time-consuming particularly…

Computation and Language · Computer Science 2026-02-02 Chenhua Shi , Gregor Macdonald , Bhavika Jalli , Wanlu Lei , John Zou , Mridul Jain , Joji Philip

High-quality, error-free datasets are a key ingredient in building reliable, accurate, and unbiased machine learning (ML) models. However, real world datasets often suffer from errors due to sensor malfunctions, data entry mistakes, or…

Machine Learning · Computer Science 2025-03-11 Tommaso Bendinelli , Artur Dox , Christian Holz