English
Related papers

Related papers: Linguistic and Argument Diversity in Synthetic Dat…

200 papers

There have been growing concerns regarding the out-of-domain generalization ability of natural language processing (NLP) models, particularly in question-answering (QA) tasks. Current synthesized data augmentation methods for QA are…

Computation and Language · Computer Science 2023-05-19 Yingjie Niu , Linyi Yang , Ruihai Dong , Yue Zhang

Diversity is an important property of datasets and sampling data for diversity is useful in dataset creation. Finding the optimally diverse sample is expensive, we therefore present a heuristic significantly increasing diversity relative to…

Computation and Language · Computer Science 2025-01-15 Louis Estève , Manon Scholivet , Agata Savary

Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem…

Artificial Intelligence · Computer Science 2024-05-24 Huajian Xin , Daya Guo , Zhihong Shao , Zhizhou Ren , Qihao Zhu , Bo Liu , Chong Ruan , Wenda Li , Xiaodan Liang

While most generative models show achievements in image data generation, few are developed for tabular data generation. Recently, due to success of large language models (LLM) in diverse tasks, they have also been used for tabular data…

Machine Learning · Computer Science 2024-10-30 Dang Nguyen , Sunil Gupta , Kien Do , Thin Nguyen , Svetha Venkatesh

Recent studies have shown that Large Language Models (LLMs) struggle to accurately retrieve information and maintain reasoning capabilities when processing long-context inputs. To address these limitations, we propose a finetuning approach…

Machine Learning · Computer Science 2024-10-15 Zheyang Xiong , Vasilis Papageorgiou , Kangwook Lee , Dimitris Papailiopoulos

Code-mixing (CM), where speakers blend languages within a single expression, is prevalent in multilingual societies but poses challenges for natural language processing due to its complexity and limited data. We propose using a large…

Computation and Language · Computer Science 2025-10-28 Linda Zeng

$\textbf{Background:}$ At the onset of a pandemic, such as COVID-19, data with proper labeling/attributes corresponding to the new disease might be unavailable or sparse. Machine Learning (ML) models trained with the available data, which…

Accurate classification of clinical text often requires fine-tuning pre-trained language models, a process that is costly and time-consuming due to the need for high-quality data and expert annotators. Synthetic data generation offers an…

Computation and Language · Computer Science 2025-01-28 Ivan Lopez , Fateme Nateghi Haredasht , Kaitlin Caoili , Jonathan H Chen , Akshay Chaudhari

Recent advancements in conversational systems have significantly enhanced human-machine interactions across various domains. However, training these systems is challenging due to the scarcity of specialized dialogue data. Traditionally,…

Computation and Language · Computer Science 2026-05-29 Heydar Soudani , Roxana Petcu , Evangelos Kanoulas , Faegheh Hasibi

Presenting users with diverse responses from foundation models is crucial for enhancing user experience and accommodating varying preferences. However, generating multiple high-quality and diverse responses without sacrificing accuracy…

Machine Learning · Computer Science 2024-11-12 Yeming Wen , Swarat Chaudhuri

Data scarcity remains a persistent challenge in low-resource domains. While existing data augmentation methods leverage the generative capabilities of large language models (LLMs) to produce large volumes of synthetic data, these approaches…

Computation and Language · Computer Science 2026-03-25 Janghyeok Choi , Jaewon Lee , Sungzoon Cho

Generative models achieve remarkable results in multiple data domains, including images and texts, among other examples. Unfortunately, malicious users exploit synthetic media for spreading misinformation and disseminating deepfakes.…

Artificial Intelligence · Computer Science 2025-08-04 Tom Or , Omri Azencot

This paper addresses the challenge of overfitting in the learning of dynamical systems by introducing a novel approach for the generation of synthetic data, aimed at enhancing model generalization and robustness in scenarios characterized…

Machine Learning · Computer Science 2024-03-11 Dario Piga , Matteo Rufolo , Gabriele Maroni , Manas Mejari , Marco Forgione

Large Language Models (LLMs) have demonstrated remarkable multilingual capabilities, making them promising tools in both high- and low-resource languages. One particularly valuable use case is generating synthetic samples that can be used…

Computation and Language · Computer Science 2026-01-26 Branislav Pecher , Jan Cegin , Robert Belanec , Ivan Srba , Jakub Simko , Maria Bielikova

Large language models (LLMs) have great potential for synthetic data generation. This work shows that useful data can be synthetically generated even for tasks that cannot be solved directly by LLMs: for problems with structured outputs, it…

Computation and Language · Computer Science 2023-10-31 Martin Josifoski , Marija Sakota , Maxime Peyrard , Robert West

Accurate barcode detection and decoding in Identity documents is crucial for applications like security, healthcare, and education, where reliable data extraction and verification are essential. However, building robust detection models is…

Computation and Language · Computer Science 2024-12-25 Hitesh Laxmichand Patel , Amit Agarwal , Bhargava Kumar , Karan Gupta , Priyaranjan Pattnayak

Recent breakthroughs in synthetic data generation approaches made it possible to produce highly photorealistic images which are hardly distinguishable from real ones. Furthermore, synthetic generation pipelines have the potential to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Alon Shoshan , Nadav Bhonker , Igor Kviatkovsky , Matan Fintz , Gerard Medioni

An important issue impacting healthcare is a lack of available experts. Machine learning (ML) models could resolve this by aiding in diagnosing patients. However, creating datasets large enough to train these models is expensive. We…

Computation and Language · Computer Science 2024-05-14 Chancellor R. Woolsey , Prakash Bisht , Joshua Rothman , Gondy Leroy

Synthetic data generation is widely recognized as a way to enhance the quality of neural grammatical error correction (GEC) systems. However, current approaches often lack diversity or are too simplistic to generate the wide range of…

Computation and Language · Computer Science 2025-02-11 Ahlam Alrehili , Areej Alhothali

Data scarcity is one of the main obstacles of domain adaptation in spoken language understanding (SLU) due to the high cost of creating manually tagged SLU datasets. Recent works in neural text generative models, particularly latent…

Computation and Language · Computer Science 2018-11-07 Kang Min Yoo , Youhyun Shin , Sang-goo Lee