English
Related papers

Related papers: Private Synthetic Data for Multitask Learning and …

200 papers

Imbalanced data, where the positive samples represent only a small proportion compared to the negative samples, makes it challenging for classification problems to balance the false positive and false negative rates. A common approach to…

Machine Learning · Statistics 2026-02-17 Pengfei Lyu , Zhengchi Ma , Linjun Zhang , Anru R. Zhang

Multi-task learning (MTL) aims to improve the performance of multiple related prediction tasks by leveraging useful information from them. Due to their flexibility and ability to reduce unknown coefficients substantially, the…

Machine Learning · Computer Science 2022-12-01 Yuzhao Zhang , Yifan Sun

Reinforcement Learning (RL) has been shown to significantly boost reasoning capabilities of large language models (LLMs) in math, coding, and multi-hop reasoning tasks. However, RL fine-tuning requires abundant high-quality verifiable data,…

We present an approach for generating differentially private synthetic text using large language models (LLMs), via private prediction. In the private prediction framework, we only require the output synthetic data to satisfy differential…

Machine Learning · Computer Science 2024-10-10 Kareem Amin , Alex Bie , Weiwei Kong , Alexey Kurakin , Natalia Ponomareva , Umar Syed , Andreas Terzis , Sergei Vassilvitskii

We propose $\mathtt{PrivHP}$, a lightweight synthetic data generator with \textit{differential privacy} guarantees. $\mathtt{PrivHP}$ uses a novel hierarchical decomposition that approximates the input's cumulative distribution function…

Cryptography and Security · Computer Science 2025-12-10 Rayne Holland , Seyit Camtepe , Chandra Thapa , Minhui Xue

We propose a new semi-supervised learning method on face-related tasks based on Multi-Task Learning (MTL) and data distillation. The proposed method exploits multiple datasets with different labels for different-but-related tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2019-07-10 Sepidehsadat Hosseini , Mohammad Amin Shabani , Nam Ik Cho

Synthetic data has emerged as a crucial solution to the data scarcity bottleneck in large language models (LLMs), particularly for specialized domains and low-resource languages. However, the broader adoption of existing synthetic data…

Machine Learning · Computer Science 2026-05-12 Zhichao Shi , Cehao Yang , Hao Zhou , Xiaojun Wu , Huajie Li , Xuhui Jiang , Chengjin Xu , Yuanzhuo Wang , Jian Guo

Multimodal self-supervised representation learning has consistently proven to be a highly effective method in medical image analysis, offering strong task performance and producing biologically informed insights. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Lucas Farndale , Chris Walsh , Robert Insall , Ke Yuan

Synthetic tabular data enables sharing and analysis of sensitive records, but its practical deployment requires balancing distributional fidelity, downstream utility, and privacy protection. We study a simple, model agnostic post processing…

Machine Learning · Computer Science 2026-02-09 David Yavo , Richard Khoury , Christophe Pere , Sadoune Ait Kaci Azzou

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

Synthetic data generation has emerged as a crucial topic for financial institutions, driven by multiple factors, such as privacy protection and data augmentation. Many algorithms have been proposed for synthetic data generation but reaching…

Machine Learning · Computer Science 2024-05-13 Shinpei Nakamura-Sakai , Fadi Hamad , Saheed Obitayo , Vamsi K. Potluru

We study LTLf synthesis with multiple properties, where satisfying all properties may be impossible. Instead of enumerating subsets of properties, we compute in one fixed-point computation the relation between product-game states and the…

Artificial Intelligence · Computer Science 2026-01-16 Christoph Weinhuber , Yannik Schnitzer , Alessandro Abate , David Parker , Giuseppe De Giacomo , Moshe Y. Vardi

Deep neural networks have become prevalent in human analysis, boosting the performance of applications, such as biometric recognition, action recognition, as well as person re-identification. However, the performance of such networks scales…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Indu Joshi , Marcel Grimmer , Christian Rathgeb , Christoph Busch , Francois Bremond , Antitza Dantcheva

We study synthetic data release for answering multiple linear queries over a set of database tables in a differentially private way. Two special cases have been considered in the literature: how to release a synthetic dataset for answering…

Databases · Computer Science 2023-06-28 Badih Ghazi , Xiao Hu , Ravi Kumar , Pasin Manurangsi

The performance of supervised deep learning algorithms depends significantly on the scale, quality and diversity of the data used for their training. Collecting and manually annotating large amount of data can be both time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 C. Symeonidis , P. Nousi , P. Tosidis , K. Tsampazis , N. Passalis , A. Tefas , N. Nikolaidis

We propose a method for using synthetic data to help learning classifiers. Synthetic data, even is generated based on real data, normally results in a shift from the distribution of real data in feature space. To bridge the gap between the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-12 Xi Zhang , Yanwei Fu , Andi Zang , Leonid Sigal , Gady Agam

Optimization problems characterized by both discrete and continuous variables are common across various disciplines, presenting unique challenges due to their complex solution landscapes and the difficulty of navigating mixed-variable…

Optimization and Control · Mathematics 2024-06-03 Haoyan Zhai , Qianli Hu , Jiangning Chen

Probabilistic relational models provide a well-established formalism to combine first-order logic and probabilistic models, thereby allowing to represent relationships between objects in a relational domain. At the same time, the field of…

Artificial Intelligence · Computer Science 2024-10-03 Malte Luttermann , Ralf Möller , Mattis Hartwig

This article provides a comprehensive synthesis of the recent developments in synthetic data generation via deep generative models, focusing on tabular datasets. We specifically outline the importance of synthetic data generation in the…

Machine Learning · Computer Science 2023-08-29 Conor Hassan , Robert Salomone , Kerrie Mengersen

Deep neural networks often use large, high-quality datasets to achieve high performance on many machine learning tasks. When training involves potentially sensitive data, this process can raise privacy concerns, as large models have been…

Machine Learning · Computer Science 2025-06-23 Felix Zhou , Samson Zhou , Vahab Mirrokni , Alessandro Epasto , Vincent Cohen-Addad