English
Related papers

Related papers: Few-shot LLM Synthetic Data with Distribution Matc…

200 papers

Macro-aligned micro-records are crucial for credible simulations in social science and urban studies. For example, epidemic models are only reliable when individual-level mobility and contacts mirror real behavior, while aggregates match…

Machine Learning · Computer Science 2025-10-14 Yihong Tang , Menglin Kong , Junlin He , Tong Nie , Lijun Sun

Aspect-Based Sentiment Analysis (ABSA) offers granular insights into opinions but often suffers from the scarcity of diverse, labeled datasets that reflect real-world conversational nuances. This paper presents an approach for generating…

Computation and Language · Computer Science 2025-06-02 Tejul Pandit , Meet Raval , Dhvani Upadhyay

Training fall detection systems is challenging due to the scarcity of real-world fall data, particularly from elderly individuals. To address this, we explore the potential of Large Language Models (LLMs) for generating synthetic fall data.…

Computation and Language · Computer Science 2025-05-09 Sana Alamgeer , Yasine Souissi , Anne H. H. Ngu

LLM alignment ensures that large language models behave safely and effectively by aligning their outputs with human values, goals, and intentions. Aligning LLMs employ huge amounts of data, computation, and time. Moreover, curating data…

Machine Learning · Computer Science 2025-02-19 Amrit Khera , Rajat Ghosh , Debojyoti Dutta

Synthetic data generation creates data based on real-world data using generative models. In health applications, generating high-quality data while maintaining fairness for sensitive attributes is essential for equitable outcomes. Existing…

Machine Learning · Computer Science 2025-06-25 Nitish Nagesh , Ziyu Wang , Amir M. Rahmani

Large Language Models (LLMs) are powerful but often require extensive fine-tuning and large datasets for specialized domains like law. General-purpose pre-training may not capture legal nuances, and acquiring sufficient legal data is…

Computation and Language · Computer Science 2025-05-01 Ojasw Upadhyay , Abishek Saravanakumar , Ayman Ismail

When developing text classification models for real world applications, one major challenge is the difficulty to collect sufficient data for all text classes. In this work, we address this challenge by utilizing large language models (LLMs)…

Computation and Language · Computer Science 2025-08-15 Chenhao Xue , Yuanzhe Jin , Adrian Carrasco-Revilla , Joyraj Chakraborty , Min Chen

Synthetic training data has gained prominence in numerous learning tasks and scenarios, offering advantages such as dataset augmentation, generalization evaluation, and privacy preservation. Despite these benefits, the efficiency of…

Machine Learning · Computer Science 2024-03-21 Jianhao Yuan , Jie Zhang , Shuyang Sun , Philip Torr , Bo Zhao

Bias in AI systems, especially those relying on natural language data, raises ethical and practical concerns. Underrepresentation of certain groups often leads to uneven performance across demographics. Traditional fairness methods, such as…

Computation and Language · Computer Science 2025-10-16 Sai Suhruth Reddy Karri , Yashwanth Sai Nallapuneni , Laxmi Narasimha Reddy Mallireddy , Gopichand G

Imbalanced classification and spurious correlation are common challenges in data science and machine learning. Both issues are linked to data imbalance, with certain groups of data samples significantly underrepresented, which in turn would…

Machine Learning · Statistics 2026-02-10 Ryumei Nakada , Yichen Xu , Lexin Li , Linjun Zhang

Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic…

Computation and Language · Computer Science 2024-10-01 Fengzhu Zeng , Wenqian Li , Wei Gao , Yan Pang

Training and fine-tuning deep learning models, especially large language models (LLMs), on limited and imbalanced datasets poses substantial challenges. These issues often result in poor generalization, where models overfit to dominant…

Computation and Language · Computer Science 2025-01-14 Ashok Choudhary , Cornelius Thiels , Hojjat Salehinejad

Validating evaluation metrics for NLG typically relies on expensive and time-consuming human annotations, which predominantly exist only for English datasets. We propose \textit{LLM as a Meta-Judge}, a scalable framework that utilizes LLMs…

Computation and Language · Computer Science 2026-03-11 Lukáš Eigler , Jindřich Libovický , David Hurych

Recent studies have shown that Large Language Models (LLMs) struggle to accurately retrieve information and maintain reasoning capabilities when processing long-context inputs. To address these limitations, we propose a finetuning approach…

Machine Learning · Computer Science 2024-10-15 Zheyang Xiong , Vasilis Papageorgiou , Kangwook Lee , Dimitris Papailiopoulos

Although many AI applications of interest require specialized multi-modal models, relevant data to train such models is inherently scarce or inaccessible. Filling these gaps with human annotators is prohibitively expensive, error-prone, and…

Artificial Intelligence · Computer Science 2026-04-01 Tim R. Davidson , Benoit Seguin , Enrico Bacis , Cesar Ilharco , Hamza Harkous

This paper explores the use of large language models (LLMs) to assist in the development of new disease modules for Synthea, an open-source synthetic health data generator. Incorporating LLMs into the module development process has the…

Artificial Intelligence · Computer Science 2025-07-30 Mark A. Kramer , Aanchal Mathur , Caroline E. Adams , Jason A. Walonoski

The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through human annotation is prohibitively time-consuming particularly…

Computation and Language · Computer Science 2026-02-02 Chenhua Shi , Gregor Macdonald , Bhavika Jalli , Wanlu Lei , John Zou , Mridul Jain , Joji Philip

Data catalogs serve as repositories for organizing and accessing diverse collection of data assets, but their effectiveness hinges on the ease with which business users can look-up relevant content. Unfortunately, many data catalogs within…

Information Retrieval · Computer Science 2025-03-13 Mayank Singh , Abhijeet Kumar , Sasidhar Donaparthi , Gayatri Karambelkar

We introduce and formalize the Synthetic Dataset Quality Estimation (SynQuE) problem: ranking synthetic datasets by their expected real-world task performance using only limited unannotated real data. This addresses a critical and open…

Machine Learning · Computer Science 2026-05-04 Arthur Chen , Victor Zhong

Large Language Models (LLMs) with extended context windows promise direct reasoning over long documents, reducing the need for chunking or retrieval. Constructing annotated resources for training and evaluation, however, remains costly.…

Computation and Language · Computer Science 2025-11-13 Mohamed Elaraby , Jyoti Prakash Maheswari