中文
相关论文

相关论文: Synthetic Text Generation for Training Large Langu…

200 篇论文

In today's digital world, casual user-generated content often contains subtle cues that may inadvertently expose sensitive personal attributes. Such risks underscore the growing importance of effective text anonymization to safeguard…

计算与语言 · 计算机科学 2025-07-01 Chenyang Shao , Tianxing Li , Chenhao Pu , Fengli Xu , Yong Li

As large language models (LLMs) continue to be deployed and utilized across domains, the volume of LLM-generated data is growing rapidly. This trend highlights the increasing importance of effective and lossless compression for such data in…

机器学习 · 计算机科学 2025-05-13 Yu Mao , Holger Pirk , Chun Jason Xue

The pursuit of diverse, complex, and large-scale instruction data is crucial for automatically aligning large language models (LLMs). While there are methods capable of generating synthetic instructions at scale, they either suffer from…

计算与语言 · 计算机科学 2025-06-05 Chiwei Zhu , Benfeng Xu , Xiaorui Wang , Zhendong Mao

The burgeoning progress in the field of Large Language Models (LLMs) heralds significant benefits due to their unparalleled capacities. However, it is critical to acknowledge the potential misuse of these models, which could give rise to a…

计算与语言 · 计算机科学 2023-08-07 Haolan Zhan , Xuanli He , Qiongkai Xu , Yuxiang Wu , Pontus Stenetorp

There are concerns that the ability of language models (LMs) to generate high quality synthetic text can be misused to launch spam, disinformation, or propaganda. Therefore, the research community is actively working on developing…

计算与语言 · 计算机科学 2021-06-04 Nirav Diwan , Tanmoy Chakravorty , Zubair Shafiq

Workload traces are essential to understand complex computer systems' behavior and manage processing and memory resources. Since real-world traces are hard to obtain, synthetic trace generation is a promising alternative. This paper…

软件工程 · 计算机科学 2025-09-23 Donghyun Kim , Sriram Ravula , Taemin Ha , Alexandros G. Dimakis , Daehyeok Kim , Aditya Akella

The difficulty of anonymizing text data hinders the development and deployment of NLP in high-stakes domains that involve private data, such as healthcare and social services. Poorly anonymized sensitive data cannot be easily shared with…

计算与语言 · 计算机科学 2024-10-14 Krithika Ramesh , Nupoor Gandhi , Pulkit Madaan , Lisa Bauer , Charith Peris , Anjalie Field

Large language models (LLMs) have demonstrated remarkable capabilities in generating high-quality texts across diverse domains. However, the potential misuse of LLMs has raised significant concerns, underscoring the urgent need for reliable…

计算与语言 · 计算机科学 2024-10-10 Yihuai Xu , Yongwei Wang , Yifei Bi , Huangsen Cao , Zhouhan Lin , Yu Zhao , Fei Wu

Recent advancements in Generative AI and Large Language Models (LLMs) have enabled the creation of highly realistic synthetic content, raising concerns about the potential for malicious use, such as misinformation and manipulation.…

Machine-generated texts (MGTs) produced by large language models (LLMs) are increasingly prevalent across various applications, while their potential misuse in fake news propagation and phishing has raised serious concerns, highlighting the…

计算与语言 · 计算机科学 2026-05-25 Chenwang Wu , Yiu-ming Cheung , Bo Han , Defu Lian

The ability of large language models to generate complex texts allows them to be widely integrated into many aspects of life, and their output can quickly fill all network resources. As the impact of LLMs grows, it becomes increasingly…

计算与语言 · 计算机科学 2024-11-12 Yongye Su , Yuqing Wu

The use of large language models (LLMs) to simulate human behavior has gained significant attention, particularly through personas that approximate individual characteristics. Persona-based simulations hold promise for transforming…

计算与语言 · 计算机科学 2025-03-24 Ang Li , Haozhe Chen , Hongseok Namkoong , Tianyi Peng

Precisely controlling the length of generated text is a common requirement in real-world applications. However, despite significant advancements in following human instructions, Large Language Models (LLMs) still struggle with this task. In…

计算与语言 · 计算机科学 2026-01-08 Meiman Xiao , Ante Wang , Qingguo Hu , Zhongjian Miao , Huangjun Shen , Longyue Wang , Weihua Luo , Jinsong Su

This paper addresses fine-tuning Large Language Models (LLMs) for function calling tasks when real user interaction data is unavailable. In digital content creation tools, where users express their needs through natural language queries…

Text generation aims to produce human-like natural language output for down-stream tasks. It covers a wide range of applications like machine translation, document summarization, dialogue generation and so on. Recently deep neural…

计算与语言 · 计算机科学 2022-03-07 Xiaoyu Shen

Synthetic data generation has emerged as an invaluable solution in scenarios where real-world data collection and usage are limited by cost and scarcity. Large language models (LLMs) have demonstrated remarkable capabilities in producing…

机器学习 · 计算机科学 2025-07-22 Anh Nguyen , Sam Schafft , Nicholas Hale , John Alfaro

Significant progress has been made on text generation by pre-trained language models (PLMs), yet distinguishing between human and machine-generated text poses an escalating challenge. This paper offers an in-depth evaluation of three…

计算与语言 · 计算机科学 2024-05-16 Muhammad Farid Adilazuarda

Large Language Models (LLMs) are powerful but often require extensive fine-tuning and large datasets for specialized domains like law. General-purpose pre-training may not capture legal nuances, and acquiring sufficient legal data is…

计算与语言 · 计算机科学 2025-05-01 Ojasw Upadhyay , Abishek Saravanakumar , Ayman Ismail

Reinforcement Learning (RL) has been shown to significantly boost reasoning capabilities of large language models (LLMs) in math, coding, and multi-hop reasoning tasks. However, RL fine-tuning requires abundant high-quality verifiable data,…

We propose to utilize an instruction-tuned large language model (LLM) for guiding the text generation process in automatic speech recognition (ASR). Modern large language models (LLMs) are adept at performing various text generation tasks…

音频与语音处理 · 电气工程与系统科学 2025-01-08 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi