English
Related papers

Related papers: Few-shot LLM Synthetic Data with Distribution Matc…

200 papers

Sensitive datasets are often underutilized in research and industry due to privacy concerns, limiting the potential of valuable data-driven insights. Synthetic data generation presents a promising solution to address this challenge by…

Computation · Statistics 2026-01-27 Ali Furkan Kalay

Fine-tuning Vision-Language Models (VLMs) is a common strategy to improve performance following an ad-hoc data collection and annotation of real-world scenes. However, this process is often prone to biases, errors, and distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Massimo Rizzoli , Simone Alghisi , Seyed Mahed Mousavi , Giuseppe Riccardi

Data heterogeneity hinders clinical deployment of medical image analysis models, and generative data augmentation helps mitigate this issue. However, recent diffusion-based methods that synthesize image-mask pairs often ignore distribution…

Image and Video Processing · Electrical Eng. & Systems 2026-04-06 Jie Yang , Ziqi Ye , Aihua Ke , Jian Luo , Bo Cai , Xiaosong Wang

Generative models have gained significant attention for their ability to produce realistic synthetic data that supplements the quantity of real-world datasets. While recent studies show performance improvements in wireless sensing tasks by…

Machine Learning · Computer Science 2025-07-01 Chen Gong , Bo Liang , Wei Gao , Chenren Xu

While modern Requirements Engineering (RE) heavily relies on natural language processing and Machine Learning (ML) techniques, their effectiveness is limited by the scarcity of high-quality datasets. This paper introduces Synthline, a…

Software Engineering · Computer Science 2025-05-07 Abdelkarim El-Hajjami , Camille Salinesi

For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing problem. The efficiency…

Computation and Language · Computer Science 2022-12-19 Harsh Lara , Manoj Tiwari

Database research and the development of learned query optimisers rely heavily on realistic SQL workloads. Acquiring real-world queries is increasingly difficult, however, due to strict privacy regulations, and publicly released anonymised…

Databases · Computer Science 2026-04-10 Kahan Mehta , Amit Mankodi

Large vision-language models (LVLMs) have shown premise in a broad range of vision-language tasks with their strong reasoning and generalization capabilities. However, they require considerable computational resources for training and…

Computation and Language · Computer Science 2024-06-18 Guiming Hardy Chen , Shunian Chen , Ruifei Zhang , Junying Chen , Xiangbo Wu , Zhiyi Zhang , Zhihong Chen , Jianquan Li , Xiang Wan , Benyou Wang

There is a rising interest in further exploring the zero-shot learning potential of large pre-trained language models (PLMs). A new paradigm called data-generation-based zero-shot learning has achieved impressive success. In this paradigm,…

Computation and Language · Computer Science 2023-02-28 Jiahui Gao , Renjie Pi , Yong Lin , Hang Xu , Jiacheng Ye , Zhiyong Wu , Weizhong Zhang , Xiaodan Liang , Zhenguo Li , Lingpeng Kong

As artificial neural networks, and specifically large language models, have improved rapidly in capabilities and quality, they have increasingly been deployed in real-world applications, from customer service to Google search, despite the…

Machine Learning · Computer Science 2026-02-02 Eugenia Iofinova , Dan Alistarh

Pretrained large language models (LLMs) are currently state-of-the-art for solving the vast majority of natural language processing tasks. While many real-world applications still require fine-tuning to reach satisfactory levels of…

Smartphone usage data can provide valuable insights for understanding interaction with technology and human behavior. However, collecting large-scale, in-the-wild smartphone usage logs is challenging due to high costs, privacy concerns,…

Human-Computer Interaction · Computer Science 2025-09-18 Gustavo Kruger , Nikhil Sachdeva , Michael Sobolev

Joint logical-numerical reasoning remains a major challenge for language models, yet existing datasets rely on fixed rule sets and offer limited control over task complexity, constraining their generalizability for evaluation and training.…

Computation and Language · Computer Science 2025-10-14 Yiwei Liu , Yucheng Li , Xiao Li , Gong Cheng

Data imbalance in training data often leads to biased predictions from trained models, which in turn causes ethical and social issues. A straightforward solution is to carefully curate training data, but given the enormous scale of modern…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Moon Ye-Bin , Nam Hyeon-Woo , Wonseok Choi , Nayeong Kim , Suha Kwak , Tae-Hyun Oh

Large language models (LLMs) can be used to generate smaller, more refined datasets via few-shot prompting for benchmarking, fine-tuning or other use cases. However, understanding and evaluating these datasets is difficult, and the failure…

Computation and Language · Computer Science 2023-09-29 Emily Reif , Minsuk Kahng , Savvas Petridis

An important issue impacting healthcare is a lack of available experts. Machine learning (ML) models could resolve this by aiding in diagnosing patients. However, creating datasets large enough to train these models is expensive. We…

Computation and Language · Computer Science 2024-05-14 Chancellor R. Woolsey , Prakash Bisht , Joshua Rothman , Gondy Leroy

Progress in the field of machine learning has been fueled by the introduction of benchmark datasets pushing the limits of existing algorithms. Enabling the design of datasets to test specific properties and failure modes of learning…

Weakly Supervised Semantic Segmentation (WSSS) with image level labels aims to produce pixel level predictions without requiring dense annotations. While recent approaches have leveraged generative models to augment existing data, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Wangyu Wu , Zhenhong Chen , Xiaowei Huang , Fei Ma , Jimin Xiao

Synthetic data is useful only when the added samples fill missing parts of the training distribution that matter for the downstream task. We introduce LiBaGS, a lightweight, generator-agnostic method for targeted synthetic training data…

Machine Learning · Computer Science 2026-05-14 Abhishek Moturu , Anna Goldenberg , Babak Taati

The rise of AI-generated images (AIGIs) poses growing challenges for digital authenticity, prompting the need for efficient, generalizable image forgery detection systems. Existing methods, whether non-LLM-based or LLM-based, exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Qing Huang , Zhipei Xu , Xuanyu Zhang , Xiangyu Yu , Jian Zhang