中文
相关论文

相关论文: Mondrian: Prompt Abstraction Attack Against Large …

200 篇论文

Large Language Models (LLMs) have become foundational components in a wide range of applications, including natural language understanding and generation, embodied intelligence, and scientific discovery. As their computational requirements…

密码学与安全 · 计算机科学 2025-12-09 Yunzhe Li , Jianan Wang , Hongzi Zhu , James Lin , Shan Chang , Minyi Guo

Recent years have seen the wide application of NLP models in crucial areas such as finance, medical treatment, and news media, raising concerns of the model robustness and vulnerabilities. In this paper, we propose a novel prompt-based…

计算与语言 · 计算机科学 2022-03-22 Yuting Yang , Pei Huang , Juan Cao , Jintao Li , Yun Lin , Jin Song Dong , Feifei Ma , Jian Zhang

To guarantee safe and robust deployment of large language models (LLMs) at scale, it is critical to accurately assess their adversarial robustness. Existing adversarial attacks typically target harmful responses in single-point greedy…

机器学习 · 计算机科学 2026-02-24 Tim Beyer , Yan Scholten , Leo Schwinn , Stephan Günnemann

With the rapid progress of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts. Though model developers and researchers work hard on dialog safety to avoid generating harmful content from…

计算与语言 · 计算机科学 2023-11-02 Haoran Li , Dadi Guo , Wei Fan , Mingshi Xu , Jie Huang , Fanpu Meng , Yangqiu Song

Large language models (LLMs) have gained widespread adoption across diverse applications due to their impressive generative capabilities. Their plug-and-play nature enables both developers and end users to interact with these models through…

密码学与安全 · 计算机科学 2025-10-21 Zongze Li , Jiawei Guo , Haipeng Cai

Intent detection, a core component of natural language understanding, has considerably evolved as a crucial mechanism in safeguarding large language models (LLMs). While prior work has applied intent detection to enhance LLMs' moderation…

计算与语言 · 计算机科学 2025-08-26 Jun Zhuang , Haibo Jin , Ye Zhang , Zhengjian Kang , Wenbin Zhang , Gaby G. Dagher , Haohan Wang

Large Language Models (LLMs) have transformed software development, enabling AI-powered applications known as LLM-based agents that promise to automate tasks across diverse apps and workflows. Yet, the security implications of deploying…

密码学与安全 · 计算机科学 2025-11-07 Chenghao Du , Quanfeng Huang , Tingxuan Tang , Zihao Wang , Adwait Nadkarni , Yue Xiao

Large Language Models (LLMs) are increasingly employed as evaluators (LLM-as-a-Judge) for assessing the quality of machine-generated text. This paradigm offers scalability and cost-effectiveness compared to human annotation. However, the…

计算与语言 · 计算机科学 2025-05-20 Narek Maloyan , Bislan Ashinov , Dmitry Namiot

Machine learning (ML) models may be deemed confidential due to their sensitive training data, commercial value, or use in security applications. Increasingly often, confidential ML models are being deployed with publicly accessible query…

密码学与安全 · 计算机科学 2016-10-04 Florian Tramèr , Fan Zhang , Ari Juels , Michael K. Reiter , Thomas Ristenpart

Prompt-based adversarial attacks have become an effective means to assess the robustness of large language models (LLMs). However, existing approaches often treat prompts as monolithic text, overlooking their structural…

Recent surge in Large Language Model (LLM) availability has opened exciting avenues for research. However, efficiently interacting with these models presents a significant hurdle since LLMs often reside on proprietary or self-hosted API…

Artificial intelligence (AI) systems are revolutionizing fields such as medicine, drug discovery, and materials science; however, many technologists and policymakers are also concerned about the technology's risks. To date, most concrete…

计算机与社会 · 计算机科学 2026-01-30 Prateek Puri

Prompts have significantly improved the performance of pretrained Large Language Models (LLMs) on various downstream tasks recently, making them increasingly indispensable for a diverse range of LLM application scenarios. However, the…

计算与语言 · 计算机科学 2023-12-19 Hongwei Yao , Jian Lou , Zhan Qin

Artificial Intelligence (AI) advancements have enabled the development of Large Language Models (LLMs) that can perform a variety of tasks with remarkable semantic understanding and accuracy. ChatGPT is one such LLM that has gained…

软件工程 · 计算机科学 2024-08-02 M. Mehdi Kholoosi , M. Ali Babar , Roland Croft

Despite their superior performance on a wide range of domains, large language models (LLMs) remain vulnerable to misuse for generating harmful content, a risk that has been further amplified by various jailbreak attacks. Existing jailbreak…

密码学与安全 · 计算机科学 2025-10-27 Yukun Jiang , Mingjie Li , Michael Backes , Yang Zhang

In recent years, large language models (LLMs) have made significant advancements in developing human-like and engaging dialogue systems. However, in tasks such as consensus-building and persuasion, LLMs often struggle to resolve conflicts…

人工智能 · 计算机科学 2025-11-14 Zhaoqun Li , Xiaotong Fang , Chen Chen , Mengze Li , Beishui Liao

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

计算机与社会 · 计算机科学 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

Large language models (LLMs) are increasingly deployed in enterprise settings where they interact with multiple users and are trained or fine-tuned on sensitive internal data. While fine-tuning enhances performance by internalizing domain…

Unequal access to costly datasets essential for empirical research has long hindered researchers from disadvantaged institutions, limiting their ability to contribute to their fields and advance their careers. Recent breakthroughs in Large…

综合金融 · 定量金融 2025-09-16 Julian Junyan Wang , Victor Xiaoqi Wang

Large Language Models (LLMs), while powerful, are built and trained to process a single text input. In common applications, multiple inputs can be processed by concatenating them together into a single stream of text. However, the LLM is…

密码学与安全 · 计算机科学 2024-03-25 Keegan Hines , Gary Lopez , Matthew Hall , Federico Zarfati , Yonatan Zunger , Emre Kiciman