English
Related papers

Related papers: Using GPT-2 to Create Synthetic Data to Improve th…

200 papers

Despite recent advances in training and prompting strategies for Large Language Models (LLMs), these models continue to face challenges with complex logical reasoning tasks that involve long reasoning chains. In this work, we explore the…

Computation and Language · Computer Science 2024-12-18 Jiaming Zhou , Abbas Ghaddar , Ge Zhang , Liheng Ma , Yaochen Hu , Soumyasundar Pal , Mark Coates , Bin Wang , Yingxue Zhang , Jianye Hao

Text analysis of social media for sentiment, topic analysis, and other analysis depends initially on the selection of keywords and phrases that will be used to create the research corpora. However, keywords that researchers choose may occur…

Computation and Language · Computer Science 2022-04-21 Philip Feldman , Aaron Dant , James R. Foulds , Shemei Pan

This study explores the utilization of Dermatoscopic synthetic data generated through stable diffusion models as a strategy for enhancing the robustness of machine learning model training. Synthetic data generation plays a pivotal role in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Muhammad Ali Farooq , Wang Yao , Michael Schukat , Mark A Little , Peter Corcoran

An important issue impacting healthcare is a lack of available experts. Machine learning (ML) models could resolve this by aiding in diagnosing patients. However, creating datasets large enough to train these models is expensive. We…

Computation and Language · Computer Science 2024-05-14 Chancellor R. Woolsey , Prakash Bisht , Joshua Rothman , Gondy Leroy

Synthetic training data generation with Large Language Models (LLMs) like Google's Gemma and OpenAI's GPT offer a promising solution to the challenge of obtaining large, labeled datasets for training classifiers. When rapid model deployment…

This paper demonstrates the potential of statistical disclosure control for protecting the data used to train recommender systems. Specifically, we use a synthetic data generation approach to hide specific information in the user-item…

Information Retrieval · Computer Science 2020-08-11 Manel Slokom , Martha Larson , Alan Hanjalic

Large-scale clinical data is invaluable to driving many computational scientific advances today. However, understandable concerns regarding patient privacy hinder the open dissemination of such data and give rise to suboptimal siloed…

Computation and Language · Computer Science 2019-05-23 Oren Melamud , Chaitanya Shivade

Reinforcement Learning (RL) has been shown to significantly boost reasoning capabilities of large language models (LLMs) in math, coding, and multi-hop reasoning tasks. However, RL fine-tuning requires abundant high-quality verifiable data,…

Online reviews are a vital source of information when purchasing a service or a product. Opinion spammers manipulate these reviews, deliberately altering the overall perception of the service. Though there exists a corpus of online reviews,…

Artificial Intelligence · Computer Science 2020-12-25 Athirai A. Irissappane , Hanfei Yu , Yankun Shen , Anubha Agrawal , Gray Stanton

Large language models (LLMs) achieve strong performance across diverse tasks, largely driven by high-quality web data used in pre-training. However, recent studies indicate this data source is rapidly depleting. Synthetic data emerges as a…

Deep learning is now the gold standard in computer vision-based quality inspection systems. In order to detect defects, supervised learning is often utilized, but necessitates a large amount of annotated images, which can be costly:…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Pierre Gutierrez , Maria Luschkova , Antoine Cordier , Mustafa Shukor , Mona Schappert , Tim Dahmen

Data annotation is the process of labeling data that could be used to train machine learning models. Having high-quality annotation is crucial, as it allows the model to learn the relationship between the input data and the desired output.…

Computation and Language · Computer Science 2023-06-16 Bosheng Ding , Chengwei Qin , Linlin Liu , Yew Ken Chia , Shafiq Joty , Boyang Li , Lidong Bing

Validating evaluation metrics for NLG typically relies on expensive and time-consuming human annotations, which predominantly exist only for English datasets. We propose \textit{LLM as a Meta-Judge}, a scalable framework that utilizes LLMs…

Computation and Language · Computer Science 2026-03-11 Lukáš Eigler , Jindřich Libovický , David Hurych

Mixup is the latest data augmentation technique that linearly interpolates input examples and the corresponding labels. It has shown strong effectiveness in image classification by interpolating images at the pixel level. Inspired by this…

Computation and Language · Computer Science 2020-11-12 Lichao Sun , Congying Xia , Wenpeng Yin , Tingting Liang , Philip S. Yu , Lifang He

Synthetic data augmentation via large language models (LLMs) allows researchers to leverage additional training data, thus enhancing the performance of downstream tasks, especially when real-world data is scarce. However, the generated data…

Machine Learning · Computer Science 2025-03-25 Hsun-Yu Kuo , Yin-Hsiang Liao , Yu-Chieh Chao , Wei-Yun Ma , Pu-Jen Cheng

Training on model-generated synthetic data is a promising approach for finetuning LLMs, but it remains unclear when it helps or hurts. In this paper, we investigate this question for math reasoning via an empirical study, followed by…

Machine Learning · Computer Science 2024-06-21 Amrith Setlur , Saurabh Garg , Xinyang Geng , Naman Garg , Virginia Smith , Aviral Kumar

Synthetic data generation is integral to ML pipelines, e.g., to augment training data, replace sensitive information, and even to power advanced platforms like DeepSeek. While LLMs fine-tuned for synthetic data generation are gaining…

Machine Learning · Computer Science 2025-03-17 Shengzhe Xu , Cho-Ting Lee , Mandar Sharma , Raquib Bin Yousuf , Nikhil Muralidhar , Naren Ramakrishnan

Personal thermal comfort models aim to predict an individual's thermal comfort response, instead of the average response of a large group. Recently, machine learning algorithms have proven to be having enormous potential as a candidate for…

Machine Learning · Computer Science 2022-11-22 Hari Prasanna Das , Costas J. Spanos

Synthetic data has been proposed as a solution to address the issue of high-quality data scarcity in the training of large language models (LLMs). Studies have shown that synthetic data can effectively improve the performance of LLMs on…

Computation and Language · Computer Science 2024-06-19 Jie Chen , Yupeng Zhang , Bingning Wang , Wayne Xin Zhao , Ji-Rong Wen , Weipeng Chen

Data annotation and synthesis generally refers to the labeling or generating of raw data with relevant information, which could be used for improving the efficacy of machine learning models. The process, however, is labor-intensive and…

Computation and Language · Computer Science 2024-12-04 Zhen Tan , Dawei Li , Song Wang , Alimohammad Beigi , Bohan Jiang , Amrita Bhattacharjee , Mansooreh Karami , Jundong Li , Lu Cheng , Huan Liu