English
Related papers

Related papers: Blackbox Dataset Inference for LLM

200 papers

Generative audio models, based on diffusion and autoregressive architectures, have advanced rapidly in both quality and expressiveness. This progress, however, raises pressing copyright concerns, as such models are often trained on vast…

Membership Inference Attacks (MIAs) aim to predict whether a data sample belongs to the model's training set or not. Although prior research has extensively explored MIAs in Large Language Models (LLMs), they typically require accessing to…

Cryptography and Security · Computer Science 2025-02-27 Yu He , Boheng Li , Liu Liu , Zhongjie Ba , Wei Dong , Yiming Li , Zhan Qin , Kui Ren , Chun Chen

Most language models (LMs) are trained and applied in an autoregressive left-to-right fashion, assuming that the next token only depends on the preceding ones. However, this assumption ignores the potential benefits of using the full…

Computation and Language · Computer Science 2023-03-14 Anh Nguyen , Nikos Karampatziakis , Weizhu Chen

Instruction tuning is crucial for enabling Large Language Models (LLMs) to solve real-world tasks. Prior work has shown the effectiveness of instruction-tuning data synthesized solely from LLMs, raising a fundamental question: Do we still…

Large language models (LLMs) have become essential tools for digital task assistance. Their training relies heavily on the collection of vast amounts of data, which may include copyright-protected or sensitive information. Recent studies on…

Cryptography and Security · Computer Science 2025-09-22 Sagiv Antebi , Edan Habler , Asaf Shabtai , Yuval Elovici

Realistic, large-scale, and well-labeled cybersecurity datasets are essential for training and evaluating Intrusion Detection Systems (IDS). However, they remain difficult to obtain due to privacy constraints, data sensitivity, and the cost…

Cryptography and Security · Computer Science 2026-01-09 Konstantinos E. Kampourakis , Vyron Kampourakis , Efstratios Chatzoglou , Georgios Kambourakis , Stefanos Gritzalis

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

Large Language Models (LLMs) are trained on large-scale web data, which makes it difficult to grasp the contribution of each text. This poses the risk of leaking inappropriate data such as benchmarks, personal information, and copyrighted…

Computation and Language · Computer Science 2024-04-18 Masahiro Kaneko , Youmi Ma , Yuki Wata , Naoaki Okazaki

Recent observations have underscored a disparity between the inflated benchmark scores and the actual performance of LLMs, raising concerns about potential contamination of evaluation benchmarks. This issue is especially critical for…

Computation and Language · Computer Science 2024-04-05 Chunyuan Deng , Yilun Zhao , Xiangru Tang , Mark Gerstein , Arman Cohan

Recent research on reinforcement learning (RL) has suggested that trained agents are vulnerable to maliciously crafted adversarial samples. In this work, we show how such samples can be generalised from White-box and Grey-box attacks to a…

Machine Learning · Computer Science 2019-11-25 Yiren Zhao , Ilia Shumailov , Han Cui , Xitong Gao , Robert Mullins , Ross Anderson

Inference attacks against Machine Learning (ML) models allow adversaries to learn sensitive information about training data, model parameters, etc. While researchers have studied, in depth, several kinds of attacks, they have done so in…

Cryptography and Security · Computer Science 2021-10-07 Yugeng Liu , Rui Wen , Xinlei He , Ahmed Salem , Zhikun Zhang , Michael Backes , Emiliano De Cristofaro , Mario Fritz , Yang Zhang

Current large language models (LLM) provide a strong foundation for large-scale user-oriented natural language tasks. Many users can easily inject adversarial text or instructions through the user interface, thus causing LLM model security…

Computation and Language · Computer Science 2024-11-14 Chong Zhang , Mingyu Jin , Dong Shu , Taowen Wang , Dongfang Liu , Xiaobo Jin

High-quality training data has proven crucial for developing performant large language models (LLMs). However, commercial LLM providers disclose few, if any, details about the data used for training. This lack of transparency creates…

Large language models (LLMs) are increasingly fine-tuned on domain-specific datasets to support applications in fields such as healthcare, finance, and law. These fine-tuning datasets often have sensitive and confidential dataset-level…

Machine Learning · Computer Science 2026-02-10 Pengrun Huang , Chhavi Yadav , Kamalika Chaudhuri , Ruihan Wu

Data rights owners can detect unauthorized data use in large language model (LLM) training by querying with proprietary samples. Often, superior performance (e.g., higher confidence or lower loss) on a sample relative to the untrained data…

Cryptography and Security · Computer Science 2026-05-29 Muxing Li , Zesheng Ye , Sharon Li , Feng Liu

Large language model (LLM) safety is a critical issue, with numerous studies employing red team testing to enhance model security. Among these, jailbreak methods explore potential vulnerabilities by crafting malicious prompts that induce…

Computation and Language · Computer Science 2025-03-07 Honglin Mu , Han He , Yuxin Zhou , Yunlong Feng , Yang Xu , Libo Qin , Xiaoming Shi , Zeming Liu , Xudong Han , Qi Shi , Qingfu Zhu , Wanxiang Che

Comparing two (large) language models (LMs) side-by-side and pinpointing their prediction similarities and differences on the same set of inputs are crucial in many real-world scenarios, e.g., one can test if a licensed model was…

Computation and Language · Computer Science 2024-12-18 Weitang Liu , Yuelei Li , Ying Wai Li , Zihan Wang , Jingbo Shang

With the rapid advancement of diffusion-based image-generative models, the quality of generated images has become increasingly photorealistic. Moreover, with the release of high-quality pre-trained image-generative models, a growing number…

Cryptography and Security · Computer Science 2024-09-06 Yan Pang , Tianhao Wang

How much does a machine learning algorithm leak about its training data, and why? Membership inference attacks are used as an auditing tool to quantify this leakage. In this paper, we present a comprehensive \textit{hypothesis testing…

Machine Learning · Computer Science 2022-09-14 Jiayuan Ye , Aadyaa Maddi , Sasi Kumar Murakonda , Vincent Bindschaedler , Reza Shokri

Recently, large language models (LLMs) have been gaining a lot of interest due to their adaptability and extensibility in emerging applications, including communication networks. It is anticipated that ZSM networks will be able to support…

Cryptography and Security · Computer Science 2025-01-07 Sunder Ali Khowaja , Parus Khuwaja , Kapal Dev , Hussam Al Hamadi , Engin Zeydan