English
Related papers

Related papers: TabMT: Generating tabular data with masked transfo…

200 papers

Tabular data synthesis is crucial for addressing privacy and security concerns in industries reliant on tabular data. While recent advancements adopt large language models (LLMs) for realistic tabular data generation, their long training…

Machine Learning · Computer Science 2025-02-18 Zilong Zhao , Robert Birke , Lydia Chen

Data augmentation is an effective technique for improving the performance of machine learning models. However, it has not been explored as extensively in natural language processing (NLP) as it has in computer vision. In this paper, we…

Computation and Language · Computer Science 2024-01-04 Himmet Toprak Kesgin , Mehmet Fatih Amasyali

Many works proposed methods to improve the performance of Neural Machine Translation (NMT) models in a domain/multi-domain adaptation scenario. However, an understanding of how NMT baselines represent text domain information internally is…

Computation and Language · Computer Science 2021-09-17 Maksym Del , Elizaveta Korotkova , Mark Fishel

Recent advancements in tabular deep learning (DL) have led to substantial performance improvements, surpassing the capabilities of traditional models. With the adoption of techniques from natural language processing (NLP), such as language…

Machine Learning · Computer Science 2024-11-27 Anton Frederik Thielmann , Soheila Samiee

While Generative Adversarial Networks (GANs) achieve spectacular results on unstructured data like images, there is still a gap on tabular data, data for which state of the art supervised learning still favours to a large extent decision…

Machine Learning · Computer Science 2022-02-14 Richard Nock , Mathieu Guillame-Bert

Transformers trained on huge text corpora exhibit a remarkable set of capabilities, e.g., performing basic arithmetic. Given the inherent compositional nature of language, one can expect the model to learn to compose these capabilities,…

Machine Learning · Computer Science 2024-02-07 Rahul Ramesh , Ekdeep Singh Lubana , Mikail Khona , Robert P. Dick , Hidenori Tanaka

We present a novel approach for differentially private data synthesis of protected tabular datasets, a relevant task in highly sensitive domains such as healthcare and government. Current state-of-the-art methods predominantly use…

Machine Learning · Computer Science 2024-07-30 Konstantin Donhauser , Javier Abad , Neha Hulkund , Fanny Yang

While tabular data is fundamental to many real-world machine learning (ML) applications, acquiring high-quality tabular data is usually labor-intensive and expensive. Limited by the scarcity of observations, tabular datasets often exhibit…

Machine Learning · Computer Science 2026-02-05 Congjing Zhang , Ryan Feng Lin , Ruoxuan Bao , Shuai Huang

We show how bidirectional transformers trained for masked token prediction can be applied to neural image compression to achieve state-of-the-art results. Such models were previously used for image generation by progressivly sampling groups…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Fabian Mentzer , Eirikur Agustsson , Michael Tschannen

Recent work on deep learning for tabular data demonstrates the strong performance of deep tabular models, often bridging the gap between gradient boosted decision trees and neural networks. Accuracy aside, a major advantage of neural models…

Tabular data pervades the landscape of the World Wide Web, playing a foundational role in the digital architecture that underpins online information. Given the recent influence of large-scale pretrained models like ChatGPT and SAM across…

Machine Learning · Computer Science 2024-02-02 Chao Ye , Guoshan Lu , Haobo Wang , Liyao Li , Sai Wu , Gang Chen , Junbo Zhao

Constructing dataset for fashion style recognition is challenging due to the inherent subjectivity and ambiguity of style concepts. Recent advances in text-to-image models have facilitated generative data augmentation by synthesizing images…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yuki Hirakawa , Ryotaro Shimizu

Synthetic data generation is integral to ML pipelines, e.g., to augment training data, replace sensitive information, and even to power advanced platforms like DeepSeek. While LLMs fine-tuned for synthetic data generation are gaining…

Machine Learning · Computer Science 2025-03-17 Shengzhe Xu , Cho-Ting Lee , Mandar Sharma , Raquib Bin Yousuf , Nikhil Muralidhar , Naren Ramakrishnan

Data sharing is a prerequisite for collaborative innovation, enabling organizations to leverage diverse datasets for deeper insights. In real-world applications like FinTech and Smart Manufacturing, transactional data, often in tabular…

Cryptography and Security · Computer Science 2024-11-07 Mengmeng Yang , Chi-Hung Chi , Kwok-Yan Lam , Jie Feng , Taolin Guo , Wei Ni

Tabular data is one of the most ubiquitous modalities, yet the literature on tabular generative foundation models is lagging far behind its text and vision counterparts. Creating such a model is hard, due to the heterogeneous feature spaces…

Machine Learning · Computer Science 2024-06-26 Boris van Breugel , Jonathan Crabbé , Rob Davis , Mihaela van der Schaar

In this paper, our goal is to generate synthetic data for heterogeneous (mixed-type) tabular datasets with high machine learning utility (MLu). Since the MLu performance depends on accurately approximating the conditional distributions, we…

Machine Learning · Computer Science 2024-08-20 Seunghwan An , Gyeongdong Woo , Jaesung Lim , ChangHyun Kim , Sungchul Hong , Jong-June Jeon

Table annotation is crucial for making web and enterprise tables usable in downstream NLP applications. Unlike textual data where learning semantically rich token or sentence embeddings often suffice, tables are structured combinations of…

Machine Learning · Computer Science 2026-04-22 Ehsan Hoseinzade , Ke Wang , Anandharaju Durai Raju

Tabular data synthesis involves not only multi-table synthesis but also generating multi-modal data (e.g., strings and categories), which enables diverse knowledge synthesis. However, separating numerical and categorical data has limited…

Machine Learning · Computer Science 2025-03-21 Tung Sum Thomas Kwok , Chi-Hua Wang , Guang Cheng

Despite the prevalence and significance of tabular data across numerous industries and fields, it has been relatively underexplored in the realm of deep learning. Even today, neural networks are often overshadowed by techniques such as…

Machine Learning · Computer Science 2024-07-19 Andreas Voskou , Charalambos Christoforou , Sotirios Chatzis

Masked transformer models for class-conditional image generation have become a compelling alternative to diffusion models. Typically comprising two stages - an initial VQGAN model for transitioning between latent space and image space, and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Mark Weber , Lijun Yu , Qihang Yu , Xueqing Deng , Xiaohui Shen , Daniel Cremers , Liang-Chieh Chen