English
Related papers

Related papers: Multi-step Jailbreaking Privacy Attacks on ChatGPT

200 papers

Large Language Models (LLMs) like ChatGPT are now widely used in writing and reviewing scientific papers. While this trend accelerates publication growth and reduces human workload, it also introduces serious risks. Papers written or…

Cryptography and Security · Computer Science 2026-04-16 Kanchon Gharami , Sanjiv Kumar Sarkar , Safayat Bin Hakim , Yongxin Liu , Nahid Farhady Ghalaty , Shafika Showkat Moni

Nowadays, large language models (LLMs) have been integrated with conventional recommendation models to improve recommendation performance. However, while most of the existing works have focused on improving the model performance, the…

Computation and Language · Computer Science 2024-06-04 Sichun Luo , Wei Shao , Yuxuan Yao , Jian Xu , Mingyang Liu , Qintong Li , Bowei He , Maolin Wang , Guanzhi Deng , Hanxu Hou , Xinyi Zhang , Linqi Song

Large language models (LLMs), such as ChatGPT, have rapidly penetrated into people's work and daily lives over the past few years, due to their extraordinary conversational skills and intelligence. ChatGPT has become the fastest-growing…

Computation and Language · Computer Science 2024-09-04 Wenxuan Wang

The increasing demand for customized Large Language Models (LLMs) has led to the development of solutions like GPTs. These solutions facilitate tailored LLM creation via natural language prompts without coding. However, the trustworthiness…

Cryptography and Security · Computer Science 2024-05-29 Rui Zhang , Hongwei Li , Rui Wen , Wenbo Jiang , Yuan Zhang , Michael Backes , Yun Shen , Yang Zhang

With the launch of ChatGPT, Large Language Models (LLMs) are shaking up our whole society, rapidly altering the way we think, create and live. For instance, the GPT integration in Bing has altered our approach to online searching. While…

Computers and Society · Computer Science 2026-02-26 Zihao Li

While open Large Language Models (LLMs) have made significant progress, they still fall short of matching the performance of their closed, proprietary counterparts, making the latter attractive even for the use on highly private data.…

Machine Learning · Computer Science 2024-11-18 Vincent Hanke , Tom Blanchard , Franziska Boenisch , Iyiola Emmanuel Olatunji , Michael Backes , Adam Dziedzic

A high volume of recent ML security literature focuses on attacks against aligned large language models (LLMs). These attacks may extract private information or coerce the model into producing harmful outputs. In real-world deployments,…

Machine Learning · Computer Science 2025-02-13 Ang Li , Yin Zhou , Vethavikashini Chithrra Raghuram , Tom Goldstein , Micah Goldblum

Large language models (LLMs) have demonstrated remarkable capabilities, but their power comes with significant security considerations. While extensive research has been conducted on the safety of LLMs in chat mode, the security…

Cryptography and Security · Computer Science 2024-12-25 Zihui Wu , Haichang Gao , Jianping He , Ping Wang

Large Language Models (LLMs) have gained widespread adoption across various domains, including chatbots and auto-task completion agents. However, these models are susceptible to safety vulnerabilities such as jailbreaking, prompt injection,…

Cryptography and Security · Computer Science 2024-09-10 Divyanshu Kumar , Anurakt Kumar , Sahil Agarwal , Prashanth Harshangi

Large language models (LLMs) such as ChatGPT have evolved into powerful and ubiquitous tools. Fine-tuning on small datasets allows LLMs to acquire specialized skills for specific tasks efficiently. Although LLMs provide great utility in…

Machine Learning · Computer Science 2025-10-08 Ruoxing Yang

This paper presents a comprehensive and practical guide for practitioners and end-users working with Large Language Models (LLMs) in their downstream natural language processing (NLP) tasks. We provide discussions and insights into the…

Computation and Language · Computer Science 2023-04-28 Jingfeng Yang , Hongye Jin , Ruixiang Tang , Xiaotian Han , Qizhang Feng , Haoming Jiang , Bing Yin , Xia Hu

With the rapid evolution of Natural Language Processing (NLP), Large Language Models (LLMs) like ChatGPT have emerged as powerful tools capable of transforming various sectors. Their vast knowledge base and dynamic interaction capabilities…

Computers and Society · Computer Science 2024-01-02 Kevin Wang , Jason Ramos , Ramon Lawrence

This is the first survey of the active area of AI research that focuses on privacy issues in Large Language Models (LLMs). Specifically, we focus on work that red-teams models to highlight privacy risks, attempts to build privacy into the…

Artificial Intelligence · Computer Science 2024-06-03 Seth Neel , Peter Chang

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

As Large Language Models (LLMs) increasingly become key components in various AI applications, understanding their security vulnerabilities and the effectiveness of defense mechanisms is crucial. This survey examines the security challenges…

Machine Learning · Computer Science 2024-06-04 Frank Weizhen Liu , Chenhui Hu

The emergence of Multimodal Large Language Models (MLLMs) and the widespread usage of MLLM cloud services such as GPT-4V raised great concerns about privacy leakage in visual data. As these models are typically deployed in cloud services,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xiaofei Hui , Qian Wu , Haoxuan Qu , Majid Mirmehdi , Hossein Rahmani , Jun Liu

The widespread deployment of LLM-based agents is likely to introduce a critical privacy threat: malicious agents that proactively engage others in multi-turn interactions to extract sensitive information. However, the evolving nature of…

Cryptography and Security · Computer Science 2026-05-11 Yanzhe Zhang , Diyi Yang

Given the data-intensive nature of Machine Learning (ML) systems in general, and Large Language Models (LLM) in particular, using them in cloud based environments can become a challenge due to legislation related to privacy and security of…

Software Engineering · Computer Science 2025-04-11 Teemu Paloniemi , Manu Setälä , Tommi Mikkonen

This paper investigates the impacts of the rapidly evolving landscape of generative Artificial Intelligence (AI) development. Emphasis is given to how organizations grapple with a critical imperative: reevaluating their policies regarding…

Computers and Society · Computer Science 2025-01-22 Lakshika Vaishnav , Sakshi Singh , Kimberly A. Cornell

Large Language Models (LLMs) have a privacy concern because they memorize training data (including personally identifiable information (PII) like emails and phone numbers) and leak it during inference. A company can train an LLM on its…

Cryptography and Security · Computer Science 2023-07-21 Jaydeep Borkar