中文
相关论文

相关论文: Unlocking Post-hoc Dataset Inference with Syntheti…

200 篇论文

The memorization of training data in large language models (LLMs) poses significant privacy and copyright concerns. Existing data extraction methods, particularly heuristic-based divergence attacks, often exhibit limited success and offer…

计算与语言 · 计算机科学 2025-11-11 Myeongseob Ko , Nikhil Reddy Billa , Adam Nguyen , Charles Fleming , Ming Jin , Ruoxi Jia

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) but pose risks of inadvertently exposing copyrighted or proprietary data, especially when such data is used for training but not intended for distribution.…

计算与语言 · 计算机科学 2025-09-16 Guangwei Zhang , Qisheng Su , Jiateng Liu , Cheng Qian , Yanzhou Pan , Yanjie Fu , Denghui Zhang

AI-based data synthesis has seen rapid progress over the last several years, and is increasingly recognized for its promise to enable privacy-respecting high-fidelity data sharing. However, adequately evaluating the quality of generated…

机器学习 · 统计学 2021-04-02 Michael Platzer , Thomas Reutterer

Collecting high-quality training data is essential for fine-tuning Large Language Models (LLMs). However, acquiring such data is often costly and time-consuming, especially for non-English languages such as Italian. Recently, researchers…

计算与语言 · 计算机科学 2025-04-01 Fatemeh Mohammadi , Tommaso Romano , Samira Maghool , Paolo Ceravolo

The proliferation of large language models (LLMs) in the real world has come with a rise in copyright cases against companies for training their models on unlicensed data from the internet. Recent works have presented methods to identify if…

机器学习 · 计算机科学 2024-06-11 Pratyush Maini , Hengrui Jia , Nicolas Papernot , Adam Dziedzic

Large language models (LLMs) have been shown to memorize and reproduce content from their training data, raising significant privacy concerns, especially with web-scale datasets. Existing methods for detecting memorization are primarily…

密码学与安全 · 计算机科学 2026-01-07 Zhenpeng Wu , Jian Lou , Zibin Zheng , Chuan Chen

The widespread use of Large Language Models (LLMs) raises critical concerns regarding the unauthorized inclusion of copyrighted content in training data. Existing detection frameworks, such as DE-COP, are computationally intensive, and…

人工智能 · 计算机科学 2026-03-20 David Szczecina , Senan Gaffori , Edmond Li

Data rights owners can detect unauthorized data use in large language model (LLM) training by querying with proprietary samples. Often, superior performance (e.g., higher confidence or lower loss) on a sample relative to the untrained data…

密码学与安全 · 计算机科学 2026-05-29 Muxing Li , Zesheng Ye , Sharon Li , Feng Liu

The collection and curation of high-quality training data is crucial for developing text classification models with superior performance, but it is often associated with significant costs and time investment. Researchers have recently…

计算与语言 · 计算机科学 2023-10-16 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ming Yin

Recently, the use of synthetic training data has been on the rise as it offers correctly labelled datasets at a lower cost. The downside of this technique is that the so-called domain gap between the real target images and synthetic…

计算机视觉与模式识别 · 计算机科学 2022-11-30 Bram Vanherle , Steven Moonen , Frank Van Reeth , Nick Michiels

The training data for many Large Language Models (LLMs) is contaminated with test data. This means that public benchmarks used to assess LLMs are compromised, suggesting a performance gap between benchmark scores and actual capabilities.…

机器学习 · 计算机科学 2024-10-15 Jacob Haimes , Cenny Wenner , Kunvar Thaman , Vassil Tashev , Clement Neo , Esben Kran , Jason Schreiber

Synthetic data has been proposed as a solution to address the issue of high-quality data scarcity in the training of large language models (LLMs). Studies have shown that synthetic data can effectively improve the performance of LLMs on…

计算与语言 · 计算机科学 2024-06-19 Jie Chen , Yupeng Zhang , Bingning Wang , Wayne Xin Zhao , Ji-Rong Wen , Weipeng Chen

Training fall detection systems is challenging due to the scarcity of real-world fall data, particularly from elderly individuals. To address this, we explore the potential of Large Language Models (LLMs) for generating synthetic fall data.…

计算与语言 · 计算机科学 2025-05-09 Sana Alamgeer , Yasine Souissi , Anne H. H. Ngu

Machine learning (ML) models frequently rely on training data that may include sensitive or personal information, raising substantial privacy concerns. Legislative frameworks such as the General Data Protection Regulation (GDPR) and the…

机器学习 · 计算机科学 2024-12-31 Md Mahadi Hasan Nahid , Sadid Bin Hasan

Recent advancements in large language models (LLMs) have significantly enhanced their knowledge and generative capabilities, leading to a surge of interest in leveraging LLMs for high-quality data synthesis. However, synthetic data…

机器学习 · 计算机科学 2025-06-11 Ying Zhou , Xinyao Wang , Yulei Niu , Yaojie Shen , Lexin Tang , Fan Chen , Ben He , Le Sun , Longyin Wen

Large Language Models (LLMs) raise concerns about lowering the cost of generating texts that could be used for unethical or illegal purposes, especially on social media. This paper investigates the promise of such models to help enforce…

计算机与社会 · 计算机科学 2024-03-25 Thales Bertaglia , Lily Heisig , Rishabh Kaushal , Adriana Iamnitchi

Large language models (LLMs) with extended context windows enable tasks requiring extensive information integration but are limited by the scarcity of high-quality, diverse datasets for long-context instruction tuning. Existing data…

计算与语言 · 计算机科学 2025-02-25 Jiaxi Li , Xingxing Zhang , Xun Wang , Xiaolong Huang , Li Dong , Liang Wang , Si-Qing Chen , Wei Lu , Furu Wei

In recent years, as smart home systems have become more widespread, security concerns within these environments have become a growing threat. Currently, most smart home security solutions, such as anomaly detection and behavior prediction…

人工智能 · 计算机科学 2025-02-03 Zhiyao Xu , Dan Zhao , Qingsong Zou , Jingyu Xiao , Yong Jiang , Zhenhui Yuan , Qing Li

Safeguarding the Intellectual Property (IP) of data has become critically important as machine learning applications continue to proliferate, and their success heavily relies on the quality of training data. While various mechanisms exist…

机器学习 · 计算机科学 2024-04-18 Biao Wu , Qiang Huang , Anthony K. H. Tung

The success of Large Language Models (LLMs) is inherently linked to the availability of vast, diverse, and high-quality data for training and evaluation. However, the growth rate of high-quality data is significantly outpaced by the…

计算与语言 · 计算机科学 2024-10-18 Ke Wang , Jiahui Zhu , Minjie Ren , Zeming Liu , Shiwei Li , Zongye Zhang , Chenkai Zhang , Xiaoyu Wu , Qiqi Zhan , Qingjie Liu , Yunhong Wang