English
Related papers

Related papers: PluRel: Synthetic Data unlocks Scaling Laws for Re…

200 papers

Federated learning (FL) enables training large language models (LLMs) without sharing raw data, but adapting LLMs under strict data isolation and non-IID client distributions remains challenging in practice. Synthetic data offers a natural…

Tabular data is a common form of organizing data. Multiple models are available to generate synthetic tabular datasets where observations are independent, but few have the ability to produce relational datasets. Modeling relational data is…

Machine Learning · Computer Science 2023-02-07 Aivin V. Solatorio , Olivier Dupriez

In the era of big data, access to abundant data is crucial for driving research forward. However, such data is often inaccessible due to privacy concerns or high costs, particularly in healthcare domain. Generating synthetic (tabular) data…

Machine Learning · Computer Science 2026-04-10 Yaobin Ling , Xiaoqian Jiang , Yejin Kim

Synthetic data generation is integral to ML pipelines, e.g., to augment training data, replace sensitive information, and even to power advanced platforms like DeepSeek. While LLMs fine-tuned for synthetic data generation are gaining…

Machine Learning · Computer Science 2025-03-17 Shengzhe Xu , Cho-Ting Lee , Mandar Sharma , Raquib Bin Yousuf , Nikhil Muralidhar , Naren Ramakrishnan

Table Structure Recognition (TSR) requires the logical reasoning ability of large language models (LLMs) to handle complex table layouts, but current datasets are limited in scale and quality, hindering effective use of this reasoning…

Databases · Computer Science 2026-04-16 Ruilin Zhang , Kai Yang

Synthetic tabular data generation is increasingly essential in data management, supporting downstream applications when real-world and high-quality tabular data is insufficient. Existing tabular generation approaches, such as generative…

Machine Learning · Computer Science 2025-09-15 Mingxuan Jiang , Yongxin Wang , Ziyue Dai , Yicun Liu , Hongyi Nie , Sen Liu , Hongfeng Chai

How to manage various data in a unified way is a significant research topic in the field of databases. To address this problem, researchers have proposed multi-model databases to support multiple data models in a uniform platform with a…

Databases · Computer Science 2021-09-02 Gongsheng Yuan , Jiaheng Lu , Shuxun Zhang , Zhengtong Yan

Foundation Models (FMs) have demonstrated remarkable insights into the relational dynamics of the world, leading to the crucial question: how do these models acquire an understanding of world hybrid relations? Traditional statistical…

Artificial Intelligence · Computer Science 2024-06-18 Yang Chen , Cong Fang , Zhouchen Lin , Bing Liu

Probabilistic relational models provide a well-established formalism to combine first-order logic and probabilistic models, thereby allowing to represent relationships between objects in a relational domain. At the same time, the field of…

Artificial Intelligence · Computer Science 2024-10-03 Malte Luttermann , Ralf Möller , Mattis Hartwig

Relational databases (RDBs) have become the industry standard for storing massive and heterogeneous data. However, despite the widespread use of RDBs across various fields, the inherent structure of relational databases hinders their…

Databases · Computer Science 2025-08-13 Ning Li , Kounianhua Du , Han Zhang , Quan Gan , Minjie Wang , David Wipf , Weinan Zhang

Tabular data synthesis involves not only multi-table synthesis but also generating multi-modal data (e.g., strings and categories), which enables diverse knowledge synthesis. However, separating numerical and categorical data has limited…

Machine Learning · Computer Science 2025-03-21 Tung Sum Thomas Kwok , Chi-Hua Wang , Guang Cheng

Graph machine learning has led to a significant increase in the capabilities of models that learn on arbitrary graph-structured data and has been applied to molecules, social networks, recommendation systems, and transportation, among other…

Machine Learning · Computer Science 2025-06-23 Vijay Prakash Dwivedi , Charilaos Kanatsoulis , Shenyang Huang , Jure Leskovec

With the growing demand for synthetic data to address contemporary issues in machine learning, such as data scarcity, data fairness, and data privacy, having robust tools for assessing the utility and potential privacy risks of such data…

Machine Learning · Computer Science 2024-12-05 Anton Danholt Lautrup , Tobias Hyrup , Arthur Zimek , Peter Schneider-Kamp

Vision-language models (VLMs) trained via reinforcement learning with verifiable reward (RLVR) have shown notable progress in scaling test-time compute effectively. In this work, we investigate how synthesized RL data can further improve…

Machine Learning · Computer Science 2025-06-04 Zijian Wu , Jinjie Ni , Xiangyan Liu , Zichen Liu , Hang Yan , Michael Qizhe Shieh

Association Rule Mining (ARM) is a fundamental task for knowledge discovery in tabular data and is widely used in high-stakes decision-making. Classical ARM methods rely on frequent itemset mining, leading to rule explosion and poor…

Artificial Intelligence · Computer Science 2026-02-18 Erkan Karabulut , Daniel Daza , Paul Groth , Martijn C. Schut , Victoria Degeler

Reinforcement learning (RL) has emerged as a powerful paradigm for improving large language models beyond supervised fine-tuning, yet sustaining performance gains at scale remains an open challenge, as data diversity and structure, rather…

Machine Learning · Computer Science 2026-03-26 Cansu Sancaktar , David Zhang , Gabriel Synnaeve , Taco Cohen

Training data plays a crucial role in Large Language Models (LLM) scaling, yet high quality data is of limited supply. Synthetic data techniques offer a potential path toward sidestepping these limitations. We conduct a large-scale…

Recent advances in text-to-SQL systems have been driven by larger models and improved datasets, yet progress is still limited by the scarcity of high-quality training data. Manual data creation is expensive, and existing synthetic methods…

Machine Learning · Computer Science 2026-01-12 Marko Sterbentz , Kevin Cushing , Cameron Barrie , Kristian J. Hammond

Recent research in tabular data synthesis has focused on single tables, whereas real-world applications often involve complex data with tens or hundreds of interconnected tables. Previous approaches to synthesizing multi-relational…

Artificial Intelligence · Computer Science 2024-11-15 Wei Pang , Masoumeh Shafieinejad , Lucy Liu , Stephanie Hazlewood , Xi He

Relational tables, where each row corresponds to an entity and each column corresponds to an attribute, have been the standard for tables in relational databases. However, such a standard cannot be taken for granted when dealing with tables…

Databases · Computer Science 2023-08-10 Peng Li , Yeye He , Cong Yan , Yue Wang , Surajit Chaudhuri