English
Related papers

Related papers: Combating Data Laundering in LLM Training

200 papers

Fine-tuning Large Language Models (LLMs) on specific datasets is a common practice to improve performance on target tasks. However, this performance gain often leads to overfitting, where the model becomes too specialized in either the task…

Computation and Language · Computer Science 2024-09-10 Sonam Gupta , Yatin Nandwani , Asaf Yehudai , Mayank Mishra , Gaurav Pandey , Dinesh Raghu , Sachindra Joshi

Motivation. Large language models (LLMs) have exhibited remarkable proficiency in diverse software engineering (SE) tasks. Handling such tasks typically involves acquiring foundational coding knowledge on large, general-purpose datasets…

Software Engineering · Computer Science 2024-08-02 José Antonio Hernández López , Boqi Chen , Mootez Saaz , Tushar Sharma , Dániel Varró

The quality of Supervised Fine-Tuning (SFT) data plays a critical role in enhancing the conversational capabilities of Large Language Models (LLMs). However, as LLMs become more advanced, the availability of high-quality human-annotated SFT…

Computation and Language · Computer Science 2025-01-22 Maosong Cao , Taolin Zhang , Mo Li , Chuyu Zhang , Yunxin Liu , Haodong Duan , Songyang Zhang , Kai Chen

The problem of pre-training data detection for large language models (LLMs) has received growing attention due to its implications in critical issues like copyright violation and test data contamination. Despite improved performance,…

Computation and Language · Computer Science 2025-02-13 Jingyang Zhang , Jingwei Sun , Eric Yeats , Yang Ouyang , Martin Kuo , Jianyi Zhang , Hao Frank Yang , Hai Li

Optimizing data mixtures for supervised fine-tuning (SFT) of large language models (LLMs) is critical for developing general-purpose models, yet this area remains underexplored. In this paper, we frame data mixing as an optimization problem…

Artificial Intelligence · Computer Science 2025-08-19 Yuan Li , Zhengzhong Liu , Eric Xing

Fine-tuning on open-source Large Language Models (LLMs) with proprietary data is now a standard practice for downstream developers to obtain task-specific LLMs. Surprisingly, we reveal a new and concerning risk along with the practice: the…

Computation and Language · Computer Science 2026-04-06 Zhexin Zhang , Yuhao Sun , Junxiao Yang , Shiyao Cui , Yuanchao Zhang , Hongning Wang , Minlie Huang

The remarkable language ability of Large Language Models (LLMs) stems from extensive training on vast datasets, often including copyrighted material, which raises serious concerns about unauthorized use. While Membership Inference Attacks…

Artificial Intelligence · Computer Science 2025-11-21 Haodong Li , Jingqi Zhang , Xiao Cheng , Peihua Mai , Haoyu Wang , Yan Pang

Detecting pre-training data in Large Language Models (LLMs) is crucial for auditing data privacy and copyright compliance, yet it remains challenging in black-box, zero-shot settings where computational resources and training data are…

Computation and Language · Computer Science 2026-01-13 Jinhan Liu , Yibo Yang , Ruiying Lu , Piotr Piekos , Yimeng Chen , Peng Wang , Dandan Guo

The increasing demand for domain-specific and human-aligned Large Language Models (LLMs) has led to the widespread adoption of Supervised Fine-Tuning (SFT) techniques. SFT datasets often comprise valuable instruction-response pairs, making…

Cryptography and Security · Computer Science 2025-06-24 Zongjie Li , Daoyuan Wu , Shuai Wang , Zhendong Su

Large language models (LLMs) have demonstrated exceptional performance across a wide range of tasks and domains, with data preparation playing a critical role in achieving these results. Pre-training data typically combines information from…

Computation and Language · Computer Science 2024-09-27 Hao Liang , Keshi Zhao , Yajie Yang , Bin Cui , Guosheng Dong , Zenan Zhou , Wentao Zhang

The increasing use of synthetic data generated by Large Language Models (LLMs) presents both opportunities and challenges in data-driven applications. While synthetic data provides a cost-effective, scalable alternative to real-world data…

Computation and Language · Computer Science 2025-07-25 Tevin Atwal , Chan Nam Tieu , Yefeng Yuan , Zhan Shi , Yuhong Liu , Liang Cheng

Large Language Models (LLMs), now a foundation in advancing natural language processing, power applications such as text generation, machine translation, and conversational systems. Despite their transformative potential, these models…

Cryptography and Security · Computer Science 2025-08-05 Kang Chen , Xiuze Zhou , Yuanguo Lin , Jinhe Su , Yuanhui Yu , Li Shen , Fan Lin

Pre-trained Large Language Models (LLMs) are an integral part of modern AI that have led to breakthrough performances in complex AI tasks. Major AI companies with expensive infrastructures are able to develop and train these large models…

Cryptography and Security · Computer Science 2023-05-02 Rouzbeh Behnia , Mohamamdreza Ebrahimi , Jason Pacheco , Balaji Padmanabhan

Many large language models (LLMs) use reasoning to generate responses but do not reveal their full reasoning traces (a.k.a. chains of thought), instead outputting only final answers and brief reasoning summaries. To demonstrate that hiding…

Cryptography and Security · Computer Science 2026-05-14 Tingwei Zhang , John X. Morris , Vitaly Shmatikov

Data filtering strategies are a crucial component to develop safe Large Language Models (LLM), since they support the removal of harmful contents from pretraining datasets. There is a lack of research on the actual impact of these…

Computation and Language · Computer Science 2026-03-24 Marco Antonio Stranisci , Christian Hardmeier

Large language models (LLMs) are demonstrating significant promise as an alternate strategy to facilitate analyses and optimizations of high-performance computing programs, circumventing the need for resource-intensive manual tool creation.…

Machine Learning · Computer Science 2023-11-28 Le Chen , Xianzhong Ding , Murali Emani , Tristan Vanderbruggen , Pei-hung Lin , Chuanhua Liao

There has been limited success for dense retrieval models in multilingual retrieval, due to uneven and scarce training data available across multiple languages. Synthetic training data generation is promising (e.g., InPars or Promptagator),…

Information Retrieval · Computer Science 2024-04-17 Nandan Thakur , Jianmo Ni , Gustavo Hernández Ábrego , John Wieting , Jimmy Lin , Daniel Cer

High-quality, error-free datasets are a key ingredient in building reliable, accurate, and unbiased machine learning (ML) models. However, real world datasets often suffer from errors due to sensor malfunctions, data entry mistakes, or…

Machine Learning · Computer Science 2025-03-11 Tommaso Bendinelli , Artur Dox , Christian Holz

Large language models excel at performing inference over text to extract information, summarize information, or generate additional text. These inference capabilities are implicated in a variety of ethical harms spanning surveillance, labor…

Computation and Language · Computer Science 2024-10-18 William Agnew , Harry H. Jiang , Cella Sum , Maarten Sap , Sauvik Das

Error correction is an important capability when applying large language models (LLMs) to facilitate user typing on mobile devices. In this paper, we use LLMs to synthesize a high-quality dataset of error correction pairs to evaluate and…

Machine Learning · Computer Science 2025-05-27 Yanxiang Zhang , Zheng Xu , Shanshan Wu , Yuanbo Zhang , Daniel Ramage