English
Related papers

Related papers: A Large Language Model for Feasible and Diverse Po…

200 papers

As large language models (LLMs) are applied to more use cases, creating high quality, task-specific datasets for fine-tuning becomes a bottleneck for model improvement. Using high quality human data has been the most common approach to…

Computation and Language · Computer Science 2024-10-31 Yung-Chieh Chan , George Pu , Apaar Shanker , Parth Suresh , Penn Jenks , John Heyer , Sam Denton

In the era of big data, access to abundant data is crucial for driving research forward. However, such data is often inaccessible due to privacy concerns or high costs, particularly in healthcare domain. Generating synthetic (tabular) data…

Machine Learning · Computer Science 2026-04-10 Yaobin Ling , Xiaoqian Jiang , Yejin Kim

Recent advances in large language models (LLMs) have enabled human-like social simulations at unprecedented scale and fidelity, offering new opportunities for computational social science. A key challenge, however, is the construction of…

Computation and Language · Computer Science 2025-10-07 Zhengyu Hu , Jianxun Lian , Zheyuan Xiao , Max Xiong , Yuxuan Lei , Tianfu Wang , Kaize Ding , Ziang Xiao , Nicholas Jing Yuan , Xing Xie

In this study, we explore the application of Large Language Models (LLMs) for generating synthetic users and simulating user conversations with a task-oriented dialogue system and present detailed results and their analysis. We propose a…

Computation and Language · Computer Science 2025-02-19 Adnan Ahmad , Stefan Hillmann , Sebastian Möller

A common and effective means for improving language model capabilities involves finetuning a ``student'' language model's parameters on generations from a more proficient ``teacher'' model. Termed ``synthetic data'', these generations are…

Large Language Models (LLMs) have democratized synthetic data generation, which in turn has the potential to simplify and broaden a wide gamut of NLP tasks. Here, we tackle a pervasive problem in synthetic data generation: its generative…

Computation and Language · Computer Science 2023-05-25 Veniamin Veselovsky , Manoel Horta Ribeiro , Akhil Arora , Martin Josifoski , Ashton Anderson , Robert West

Synthetic Data Generation (SDG), leveraging Large Language Models (LLMs), has recently been recognized and broadly adopted as an effective approach to improve the performance of smaller but more resource and compute efficient LLMs through…

Machine Learning · Computer Science 2026-03-25 Srideepika Jayaraman , Achille Fokoue , Dhaval Patel , Jayant Kalagnanam

The representation of feature space is a crucial environment where data points get vectorized and embedded for subsequent modeling. Thus the efficacy of machine learning (ML) algorithms is closely related to the quality of feature…

Machine Learning · Computer Science 2026-01-12 Xinhao Zhang , Jinghan Zhang , Banafsheh Rekabdar , Yuanchun Zhou , Pengfei Wang , Kunpeng Liu

Evaluating AI systems that interact with humans requires understanding their behavior across diverse user populations, but collecting representative human data is often expensive or infeasible, particularly for novel technologies or…

Artificial Intelligence · Computer Science 2026-05-27 Davide Paglieri , Logan Cross , William A. Cunningham , Joel Z. Leibo , Alexander Sasha Vezhnevets

The success of Large Language Models (LLMs) is inherently linked to the availability of vast, diverse, and high-quality data for training and evaluation. However, the growth rate of high-quality data is significantly outpaced by the…

Computation and Language · Computer Science 2024-10-18 Ke Wang , Jiahui Zhu , Minjie Ren , Zeming Liu , Shiwei Li , Zongye Zhang , Chenkai Zhang , Xiaoyu Wu , Qiqi Zhan , Qingjie Liu , Yunhong Wang

Random Number Generation Tasks (RNGTs) are used in psychology for examining how humans generate sequences devoid of predictable patterns. By adapting an existing human RNGT for an LLM-compatible environment, this preliminary study tests…

Artificial Intelligence · Computer Science 2024-08-21 Rachel M. Harrison

The collection and curation of high-quality training data is crucial for developing text classification models with superior performance, but it is often associated with significant costs and time investment. Researchers have recently…

Computation and Language · Computer Science 2023-10-16 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ming Yin

Recent advancements in AI have reinvigorated Agent-Based Models (ABMs), as the integration of Large Language Models (LLMs) has led to the emergence of ``generative ABMs'' as a novel approach to simulating social systems. While ABMs offer…

Multiagent Systems · Computer Science 2025-04-07 Maik Larooij , Petter Törnberg

Collecting large amounts of real-world interaction data to train general robotic policies is often prohibitively expensive, thus motivating the use of simulation data. However, existing methods for data generation have generally focused on…

Machine Learning · Computer Science 2024-01-23 Lirui Wang , Yiyang Ling , Zhecheng Yuan , Mohit Shridhar , Chen Bao , Yuzhe Qin , Bailin Wang , Huazhe Xu , Xiaolong Wang

As large language models (LLMs) transition from chat interfaces to integral components of stochastic pipelines and systems approaching general intelligence, the ability to faithfully sample from specified probability distributions has…

Computation and Language · Computer Science 2026-04-27 Minda Zhao , Yilun Du , Mengyu Wang

Simulating human profiles by instilling personas into large language models (LLMs) is rapidly transforming research in agentic behavioral simulation, LLM personalization, and human-AI alignment. However, most existing synthetic personas…

Artificial Intelligence · Computer Science 2025-12-02 Zhen Wang , Yufan Zhou , Zhongyan Luo , Lyumanshan Ye , Adam Wood , Man Yao , Saab Mansour , Luoshang Pan

Large Language Models (LLMs) have demonstrated remarkable in-context learning capabilities, enabling flexible utilization of limited historical information to play pivotal roles in reasoning, problem-solving, and complex pattern recognition…

Machine Learning · Computer Science 2025-03-31 Zhonglin Jiang , Qian Tang , Zequn Wang

Grammar plays a critical role in natural language processing and text/code generation by enabling the definition of syntax, the creation of parsers, and guiding structured outputs. Although large language models (LLMs) demonstrate…

Artificial Intelligence · Computer Science 2025-06-03 Weizhi Tang , Yixuan Li , Chris Sypherd , Elizabeth Polgreen , Vaishak Belle

Recently, program synthesis driven by large language models (LLMs) has become increasingly popular. However, program synthesis for machine learning (ML) tasks still poses significant challenges. This paper explores a novel form of program…

Software Engineering · Computer Science 2024-09-10 Jinglue Xu , Jialong Li , Zhen Liu , Nagar Anthel Venkatesh Suryanarayanan , Guoyuan Zhou , Jia Guo , Hitoshi Iba , Kenji Tei

The scarcity of domain-specific dialogue datasets limits the development of dialogue systems across applications. Existing research is constrained by general or niche datasets that lack sufficient scale for training dialogue systems. To…

Computation and Language · Computer Science 2025-02-11 Sathya Krishnan Suresh , Wu Mengjun , Tushar Pranav , Eng Siong Chng