English
Related papers

Related papers: Teach LLMs to Phish: Stealing Private Information …

200 papers

Security exploits can include cyber threats such as computer programs that can disturb the normal behavior of computer systems (viruses), unsolicited e-mail (spam), malicious software (malware), monitoring software (spyware), attempting to…

Cryptography and Security · Computer Science 2017-06-26 Nalin Asanka Gamagedara Arachchilage , Mumtaz Abdul Hameed

Phishing, a prevalent cybercrime tactic for decades, remains a significant threat in today's digital world. By leveraging clever social engineering elements and modern technology, cybercrime targets many individuals, businesses, and…

Computation and Language · Computer Science 2024-06-10 Het Patel , Umair Rehman , Farkhund Iqbal

Phishing attacks are the most common type of cyber-attacks used to obtain sensitive information and have been affecting individuals as well as organisations across the globe. Various techniques have been proposed to identify the phishing…

Cryptography and Security · Computer Science 2021-01-08 Sohail Ahmed Khan , Wasiq Khan , Abir Hussain

Large language models are shown to present privacy risks through memorization of training data, and several recent works have studied such risks for the pre-training phase. Little attention, however, has been given to the fine-tuning phase…

Computation and Language · Computer Science 2022-11-07 Fatemehsadat Mireshghallah , Archit Uniyal , Tianhao Wang , David Evans , Taylor Berg-Kirkpatrick

Adversarial Training (AT) is crucial for obtaining deep neural networks that are robust to adversarial attacks, yet recent works found that it could also make models more vulnerable to privacy attacks. In this work, we further reveal this…

Machine Learning · Computer Science 2022-02-23 Jingyang Zhang , Yiran Chen , Hai Li

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

Cryptography and Security · Computer Science 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

Large language models (LLMs) can leak sensitive training data through memorization and membership inference attacks. Prior work has primarily focused on strong adversarial assumptions, including attacker access to entire samples or long,…

Machine Learning · Computer Science 2025-05-21 Lucas Rosenblatt , Bin Han , Robert Wolfe , Bill Howe

Recent advances in instruction-following large language models (LLMs) have led to dramatic improvements in a range of NLP tasks. Unfortunately, we find that the same improved capabilities amplify the dual-use risks for malicious purposes of…

Cryptography and Security · Computer Science 2023-02-14 Daniel Kang , Xuechen Li , Ion Stoica , Carlos Guestrin , Matei Zaharia , Tatsunori Hashimoto

Phishing is a way of stealing people's sensitive information such as username, password and banking details by disguising as a legitimate entity (i.e. email, website). Anti-phishing education considered to be vital in strengthening "human",…

Cryptography and Security · Computer Science 2020-04-29 Matheesha Fernando , Nalin Asanka Gamagedara Arachchilage

Large language models (LLMs) have achieved remarkable performance on a wide range of tasks. However, recent studies have shown that LLMs can memorize training data and simple repeated tokens can trick the model to leak the data. In this…

Cryptography and Security · Computer Science 2024-05-21 Yang Bai , Ge Pei , Jindong Gu , Yong Yang , Xingjun Ma

Large language models (LLMs) require a significant redesign in solutions to preserve privacy in data-intensive applications due to their text-generation capabilities. Indeed, LLMs tend to memorize and emit private information when…

The Internet has become an indispensable part of our life, However, It also has provided opportunities to anonymously perform malicious activities like Phishing. Phishers try to deceive their victims by social engineering or creating…

Cryptography and Security · Computer Science 2020-09-24 Vahid Shahrivari , Mohammad Mahdi Darabi , Mohammad Izadi

The rapid advancement and widespread use of large language models (LLMs) have raised significant concerns regarding the potential leakage of personally identifiable information (PII). These models are often trained on vast quantities of…

Cryptography and Security · Computer Science 2023-07-06 Siwon Kim , Sangdoo Yun , Hwaran Lee , Martin Gubri , Sungroh Yoon , Seong Joon Oh

Language models are widely deployed to provide automatic text completion services in user products. However, recent research has revealed that language models (especially large ones) bear considerable risk of memorizing private training…

Computation and Language · Computer Science 2022-12-19 C. M. Downey , Wei Dai , Huseyin A. Inan , Kim Laine , Saurabh Naik , Tomasz Religa

Phishing is a type of social engineering attack with an intention to steal user data, including login credentials and credit card numbers, leading to financial losses for both organisations and individuals. It occurs when an attacker,…

Cryptography and Security · Computer Science 2020-07-02 J. Samantha Tharani , Nalin Asanka Gamagedara Arachchilage

Machine learning models' goal is to make correct predictions for specific tasks by learning important properties and patterns from data. By doing so, there is a chance that the model learns properties that are unrelated to its primary task.…

Cryptography and Security · Computer Science 2021-04-28 Mathias P. M. Parisot , Balazs Pejo , Dayana Spagnuelo

In collaborative learning, clients keep their data private and communicate only the computed gradients of the deep neural network being trained on their local data. Several recent attacks show that one can still extract private information…

Machine Learning · Computer Science 2022-07-26 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Soteris Demetriou , Deniz Gündüz , Hamed Haddadi

Large language models (LLMs) have become the backbone of modern natural language processing but pose privacy concerns about leaking sensitive training data. Membership inference attacks (MIAs), which aim to infer whether a sample is…

Machine Learning · Computer Science 2025-06-03 Toan Tran , Ruixuan Liu , Li Xiong

Recent research shows that large language models are susceptible to privacy attacks that infer aspects of the training data. However, it is unclear if simpler generative models, like topic models, share similar vulnerabilities. In this…

Cryptography and Security · Computer Science 2024-09-24 Nico Manzonelli , Wanrong Zhang , Salil Vadhan

Language models are prone to memorizing their training data, making them vulnerable to extraction attacks. While existing research often examines isolated setups, such as a single model or a fixed prompt, real-world adversaries have a…

Cryptography and Security · Computer Science 2025-08-11 Yash More , Prakhar Ganesh , Golnoosh Farnadi