English

GPT in Sheep's Clothing: The Risk of Customized GPTs

Cryptography and Security 2024-01-18 v1 Artificial Intelligence
Authors: Sagiv Antebi , Noam Azulay , Edan Habler , Ben Ganon , Asaf Shabtai , Yuval Elovici
View on arXiv ↗ PDF ↗

Abstract

In November 2023, OpenAI introduced a new service allowing users to create custom versions of ChatGPT (GPTs) by using specific instructions and knowledge to guide the model's behavior. We aim to raise awareness of the fact that GPTs can be used maliciously, posing privacy and security risks to their users.

Keywords

customized GPTs security risks privacy risks malicious use large language models OpenAI GPTs

Cite

@article{arxiv.2401.09075,
  title  = {GPT in Sheep's Clothing: The Risk of Customized GPTs},
  author = {Sagiv Antebi and Noam Azulay and Edan Habler and Ben Ganon and Asaf Shabtai and Yuval Elovici},
  journal= {arXiv preprint arXiv:2401.09075},
  year   = {2024}
}

Related papers

View all related →
Cryptography and Security · Computer Science
Privacy and Security Threat for OpenAI GPTs
Wei Wenying, Zhao Kaifa, Xue Lei, Fan Ming
2025-06-05
Cryptography and Security · Computer Science
Security Analysis of ChatGPT: Threats and Privacy Risks
Yushan Xiang, Zhongwen Li, Xiaoqi Li
2026-02-03
Cryptography and Security · Computer Science
A Large-Scale Empirical Analysis of Custom GPTs' Vulnerabilities in the OpenAI Ecosystem
Sunday Oyinlola Ogundoyin, Muhammad Ikram, Hassan Jameel Asghar, Benjamin Zi Hao Zhao +1
2025-05-14
Cryptography and Security · Computer Science
Assessing Prompt Injection Risks in 200+ Custom GPTs
Jiahao Yu, Yuhang Wu, Dong Shu, Mingyu Jin +2
2024-05-28
Cryptography and Security · Computer Science
Opening A Pandora's Box: Things You Should Know in the Era of Custom GPTs
Guanhong Tao, Siyuan Cheng, Zhuo Zhang, Junmin Zhu +2
2024-01-03
Software Engineering · Computer Science
ChatGPT: A Study on its Utility for Ubiquitous Software Engineering Tasks
Giriprasad Sridhara, Ranjani H. G., Sourav Mazumdar
2023-05-29
Cryptography and Security · Computer Science
Tracking GPTs Third Party Service: Automation, Analysis, and Insights
Chuan Yan, Liuhuo Wan, Bowei Guan, Fengqi Yu +2
2025-06-24
Computers and Society · Computer Science
ChatGPT: Applications, Opportunities, and Threats
Aram Bahrini, Mohammadsadra Khamoshifar, Hossein Abbasimehr, Robert J. Riggs +3
2023-04-19
Computers and Society · Computer Science
On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready to Obtain a University Degree?
Kamil Malinka, Martin Perešíni, Anton Firc, Ondřej Hujňák +1
2023-07-04
Computers and Society · Computer Science
Legal and ethical considerations regarding the use of ChatGPT in education
Fereniki Panagopoulou, Christina Parpoula, Kostas Karpouzis
2023-06-21
Machine Learning · Computer Science
Does fine-tuning GPT-3 with the OpenAI API leak personally-identifiable information?
Albert Yu Sun, Eliott Zemour, Arushi Saxena, Udith Vaidyanathan +3
2024-04-17
Cryptography and Security · Computer Science
Unveiling Security, Privacy, and Ethical Concerns of ChatGPT
Xiaodong Wu, Ran Duan, Jianbing Ni
2023-07-27
Cryptography and Security · Computer Science
From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacy
Maanak Gupta, CharanKumar Akiri, Kshitiz Aryal, Eli Parker +1
2023-07-04
Computation and Language · Computer Science
Towards Safer Chatbots: Automated Policy Compliance Evaluation of Custom GPTs
David Rodriguez, William Seymour, Jose M. Del Alamo, Jose Such
2025-12-22
Computation and Language · Computer Science
Let's have a chat! A Conversation with ChatGPT: Technology, Applications, and Limitations
Sakib Shahriar, Kadhim Hayawi
2023-08-11
Human-Computer Interaction · Computer Science
ChatGPT in the classroom. Exploring its potential and limitations in a Functional Programming course
Dan-Matei Popovici
2024-02-01
Cryptography and Security · Computer Science
How Secure is Code Generated by ChatGPT?
Raphaël Khoury, Anderson R. Avila, Jacob Brunelle, Baba Mamadou Camara
2026-04-09
Computation and Language · Computer Science
Unlocking the Potential of ChatGPT: A Comprehensive Exploration of its Applications, Advantages, Limitations, and Future Directions in Natural Language Processing
Walid Hariri
2025-05-28
Computation and Language · Computer Science
Real Customization or Just Marketing: Are Customized Versions of Chat GPT Useful?
Eduardo C. Garrido-Merchán, Jose L. Arroyo-Barrigüete, Francisco Borrás-Pala, Leandro Escobar-Torres +3
2023-12-08
Software Engineering · Computer Science
Custom Developer GPT for Ethical AI Solutions
Lauren Olson
2024-01-23
Computation and Language · Computer Science
Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators
Andreas Liesenfeld, Alianda Lopez, Mark Dingemanse
2023-07-13
Computation and Language · Computer Science
Gpt-4: A Review on Advancements and Opportunities in Natural Language Processing
Jawid Ahmad Baktash, Mursal Dawodi
2023-05-08
Computers and Society · Computer Science
Ask ChatGPT: Caveats and Mitigations for Individual Users of AI Chatbots
Chengen Wang, Murat Kantarcioglu
2025-08-15
Computation and Language · Computer Science
Multi-step Jailbreaking Privacy Attacks on ChatGPT
Haoran Li, Dadi Guo, Wei Fan, Mingshi Xu +3
2023-11-02
Computation and Language · Computer Science
ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishing
Brady Lund, Ting Wang, Nishith Reddy Mannuru, Bing Nie +2
2023-04-03