English
Related papers

Related papers: Seed-Free Synthetic Data Generation Framework for …

200 papers

In this paper, we propose three methods for generating synthetic samples to train and evaluate multimodal large language models capable of processing both text and speech inputs. Addressing the scarcity of samples containing both…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Vahid Noroozi , Zhehuai Chen , Somshubra Majumdar , Steve Huang , Jagadeesh Balam , Boris Ginsburg

In AI research, the optimization of Large Language Models (LLMs) remains a significant challenge, crucial for advancing the field's practical applications and sustainability. Building upon the foundational work of Professor Song Han's lab…

Computation and Language · Computer Science 2023-12-21 Tim Valicenti , Justice Vidal , Ritik Patnaik

Speech large language models (SLLMs) built on speech encoders, adapters, and LLMs demonstrate remarkable multitask understanding performance in high-resource languages such as English and Chinese. However, their effectiveness substantially…

Sound · Computer Science 2026-04-21 Mingchen Shao , Bingshen Mu , Chengyou Wang , Hai Li , Ying Yan , Zhonghua Fu , Lei Xie

Personalized tutoring, teacher training, and education research need access to \emph{targeted} synthetic misconceptions, but privacy and IRB constraints make labelled corpora of real student errors scarce. LLMs could in principle generate…

Computation and Language · Computer Science 2026-05-29 Xinming Yang , Jun Li

Supervised Fine-Tuning (SFT) is essential for training large language models (LLMs), significantly enhancing critical capabilities such as instruction following and in-context learning. Nevertheless, creating suitable training datasets…

Computation and Language · Computer Science 2025-09-16 Iman Barati , Mostafa Amiri , Heshaam Faili

Dataset diversity plays a pivotal role for the successful training of many machine learning models, particularly in the supervised fine-tuning (SFT) stage of large language model (LLM) development. Despite increasing recognition of its…

Computation and Language · Computer Science 2025-06-02 Haoyu Li , Xuhong Li , Yiming Dong , Kun Liu

Large language models (LLMs) have been applied to a wide range of tasks, including text summarization, web navigation, and chatbots. They have benefitted from supervised fine-tuning (SFT) and reinforcement learning from human feedback…

Computation and Language · Computer Science 2024-08-07 Ryan Aponte , Ryan A. Rossi , Shunan Guo , Franck Dernoncourt , Tong Yu , Xiang Chen , Subrata Mitra , Nedim Lipka

We present a novel framework, SoftSRV, that is used to generate targeted synthetic fine-tuning data for improving task-specific model performance. Given a sample from a target distribution, our proposed framework uses a data-driven loss…

Machine Learning · Computer Science 2025-02-06 Giulia DeSalvo , Jean-Fracois Kagy , Lazaros Karydas , Afshin Rostamizadeh , Sanjiv Kumar

Instruction tuning is instrumental in enabling Large Language Models~(LLMs) to follow user instructions to complete various open-domain tasks. The success of instruction tuning depends on the availability of high-quality instruction data.…

Computation and Language · Computer Science 2023-08-25 Yue Wang , Xinrui Wang , Juntao Li , Jinxiong Chang , Qishen Zhang , Zhongyi Liu , Guannan Zhang , Min Zhang

High-quality, large-scale instructions are crucial for aligning large language models (LLMs), however, there is a severe shortage of instruction in the field of natural language understanding (NLU). Previous works on constructing NLU…

Computation and Language · Computer Science 2025-02-07 Lin Yuan , Jun Xu , Honghao Gui , Mengshu Sun , Zhiqiang Zhang , Lei Liang , Jun Zhou

Factual consistency evaluation is often conducted using Natural Language Inference (NLI) models, yet these models exhibit limited success in evaluating summaries. Previous work improved such models with synthetic training data. However, the…

Computation and Language · Computer Science 2023-10-20 Zorik Gekhman , Jonathan Herzig , Roee Aharoni , Chen Elkind , Idan Szpektor

The LLM-as-a-judge paradigm enables flexible, user-defined evaluation, but its effectiveness is often limited by the scarcity of diverse, representative data for refining criteria. We present a tool that integrates synthetic data generation…

Human-Computer Interaction · Computer Science 2025-11-07 Hyo Jin Do , Zahra Ashktorab , Jasmina Gajcin , Erik Miehling , Martín Santillán Cooper , Qian Pan , Elizabeth M. Daly , Werner Geyer

Instruction tuning has become essential for adapting large language models (LLMs) to follow domain-specific prompts. Yet, in specialized fields such as medicine, the scarcity of high-quality French instruction data limits effective…

Computation and Language · Computer Science 2026-03-10 Ikram Belmadani , Oumaima El Khettari , Pacôme Constant dit Beaufils , Benoit Favre , Richard Dufour

Recent advances in large language models (LLMs) have shown promise for scalable educational applications, but their use in dialog-based tutoring systems remains challenging due to the need for effective pedagogical strategies and the high…

Computation and Language · Computer Science 2024-10-28 Menna Fateen , Tsunenori Mine

We consider small-data, large-scale decision problems in which a firm must make many operational decisions simultaneously (e.g., across a large product portfolio) while observing only a few, potentially noisy, data points per instance.…

Machine Learning · Computer Science 2026-02-04 Zishi Zhang , Jinhui Han , Ming Hu , Yijie Peng

High-quality long-context instruction data is essential for aligning long-context large language models (LLMs). Despite the public release of models like Qwen and Llama, their long-context instruction data remains proprietary. Human…

Computation and Language · Computer Science 2025-06-04 Chaochen Gao , Xing Wu , Zijia Lin , Debing Zhang , Songlin Hu

In recent years, developing compact and efficient large language models (LLMs) has emerged as a thriving area of research. Traditional Supervised Fine-Tuning (SFT), which relies on singular ground truth labels, often fails to capture…

Machine Learning · Computer Science 2025-06-12 Jingyao Li , Senqiao Yang , Sitong Wu , Han Shi , Chuanyang Zheng , Hong Xu , Jiaya Jia

Training language models (LMs) and their application agents is increasingly costly due to large datasets and models, making test failures difficult to bear. Simplified language environments serve as primordial training and testing grounds,…

Computation and Language · Computer Science 2025-01-03 Ke Yang , Volodymyr Kindratenko , ChengXiang Zhai

Large Language Models (LLMs) are commonly pretrained on vast corpora of text without utilizing contextual metadata such as source, quality, or topic, leading to a context-free learning paradigm. While recent studies suggest that adding…

Computation and Language · Computer Science 2025-11-25 Dongyang Fan , Vinko Sabolčec , Martin Jaggi

Despite the impressive performance of large language models (LLMs) in general domains, they often underperform in specialized domains. Existing approaches typically rely on data synthesis methods and yield promising results by using…

Computation and Language · Computer Science 2025-07-25 Xiaopeng Ke , Hexuan Deng , Xuebo Liu , Jun Rao , Zhenxi Song , Jun Yu , Min Zhang