中文
相关论文

相关论文: Online Safety Analysis for LLMs: a Benchmark, an A…

200 篇论文

When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails. Indeed, LLMs should never generate content promoting or normalizing harmful, illegal, or unethical behavior that may…

计算与语言 · 计算机科学 2024-06-25 Simone Tedeschi , Felix Friedrich , Patrick Schramowski , Kristian Kersting , Roberto Navigli , Huu Nguyen , Bo Li

The rapid integration of Large Language Models (LLMs) across diverse sectors has marked a transformative era, showcasing remarkable capabilities in text generation and problem-solving tasks. However, this technological advancement is…

密码学与安全 · 计算机科学 2024-03-21 Rahul Pankajakshan , Sumitra Biswal , Yuvaraj Govindarajulu , Gilad Gressel

The last two years have seen a rapid growth in concerns around the safety of large language models (LLMs). Researchers and practitioners have met these concerns by creating an abundance of datasets for evaluating and improving LLM safety.…

计算与语言 · 计算机科学 2025-01-13 Paul Röttger , Fabio Pernisi , Bertie Vidgen , Dirk Hovy

As large language models (LLMs) develop increasingly sophisticated capabilities and find applications in medical settings, it becomes important to assess their medical safety due to their far-reaching implications for personal and public…

人工智能 · 计算机科学 2024-10-11 Tessa Han , Aounon Kumar , Chirag Agarwal , Himabindu Lakkaraju

With the rapid popularity of large language models such as ChatGPT and GPT-4, a growing amount of attention is paid to their safety concerns. These models may generate insulting and discriminatory content, reflect incorrect social values,…

计算与语言 · 计算机科学 2023-04-21 Hao Sun , Zhexin Zhang , Jiawen Deng , Jiale Cheng , Minlie Huang

Input-output safeguards are used to detect anomalies in the traces produced by Large Language Models (LLMs) systems. These detectors are at the core of diverse safety-critical applications such as real-time monitoring, offline evaluation of…

密码学与安全 · 计算机科学 2024-06-04 Diego Dorn , Alexandre Variengien , Charbel-Raphaël Segerie , Vincent Corruble

Spurred by the recent rapid increase in the development and distribution of large language models (LLMs) across industry and academia, much recent work has drawn attention to safety- and security-related threats and vulnerabilities of LLMs,…

计算与语言 · 计算机科学 2023-08-25 Maximilian Mozes , Xuanli He , Bennett Kleinberg , Lewis D. Griffin

While the widespread deployment of Large Language Models (LLMs) holds great potential for society, their vulnerabilities to adversarial manipulation and exploitation can pose serious safety, security, and ethical risks. As new threats…

密码学与安全 · 计算机科学 2025-09-29 Charankumar Akiri , Harrison Simpson , Kshitiz Aryal , Aarav Khanna , Maanak Gupta

With the rapid development of technology and the acceleration of digitalisation, the frequency and complexity of cyber security threats are increasing. Traditional cybersecurity approaches, often based on static rules and predefined…

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

密码学与安全 · 计算机科学 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

Large language models (LLMs) have demonstrated impressive results on natural language tasks, and security researchers are beginning to employ them in both offensive and defensive systems. In cyber-security, there have been multiple research…

密码学与安全 · 计算机科学 2024-03-05 Jiacen Xu , Jack W. Stokes , Geoff McDonald , Xuesong Bai , David Marshall , Siyue Wang , Adith Swaminathan , Zhou Li

Generative large language models (LLMs) have achieved state-of-the-art results on a wide range of tasks, yet they remain susceptible to backdoor attacks: carefully crafted triggers in the input can manipulate the model to produce…

人工智能 · 计算机科学 2025-05-20 Yige Li , Hanxun Huang , Yunhan Zhao , Xingjun Ma , Jun Sun

Large Language Models (LLMs) are increasingly popular, powering a wide range of applications. Their widespread use has sparked concerns, especially through jailbreak attacks that bypass safety measures to produce harmful content. In this…

密码学与安全 · 计算机科学 2025-12-25 Zhengchun Shang , Wenlan Wei , Weiheng Bai

Many studies have demonstrated that large language models (LLMs) can produce harmful responses, exposing users to unexpected risks when LLMs are deployed. Previous studies have proposed comprehensive taxonomies of the risks posed by LLMs,…

计算与语言 · 计算机科学 2024-08-06 Yuxia Wang , Zenan Zhai , Haonan Li , Xudong Han , Lizhi Lin , Zhenxuan Zhang , Jingru Zhao , Preslav Nakov , Timothy Baldwin

This paper analyzes the safety of Large Language Models (LLMs) in interactions with children below age of 18 years. Despite the transformative applications of LLMs in various aspects of children's lives such as education and therapy, there…

计算机与社会 · 计算机科学 2025-02-19 Prasanjit Rath , Hari Shrawgi , Parag Agrawal , Sandipan Dandapat

The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities has spurred public curiosity to evaluate and compare different LLMs, leading many researchers to propose their own LLM benchmarks. Noticing preliminary…

人工智能 · 计算机科学 2025-05-15 Timothy R. McIntosh , Teo Susnjak , Nalin Arachchilage , Tong Liu , Paul Watters , Malka N. Halgamuge

Large Language Models (LLMs) have quickly risen to prominence due to their ability to perform at or close to the state-of-the-art in a variety of fields while handling natural language. An important field of research is the application of…

密码学与安全 · 计算机科学 2024-02-28 Gabriel de Jesus Coelho da Silva , Carlos Becker Westphall

While large language models (LLMs) present significant potential for supporting numerous real-world applications and delivering positive social impacts, they still face significant challenges in terms of the inherent risk of privacy…

人工智能 · 计算机科学 2025-01-17 Huandong Wang , Wenjie Fu , Yingzhou Tang , Zhilong Chen , Yuxi Huang , Jinghua Piao , Chen Gao , Fengli Xu , Tao Jiang , Yong Li

In this paper, we argue that current safety alignment research efforts for large language models are hindered by many intertwined sources of noise, such as small datasets, methodological inconsistencies, and unreliable evaluation setups.…

密码学与安全 · 计算机科学 2026-05-19 Tim Beyer , Sophie Xhonneux , Simon Geisler , Gauthier Gidel , Leo Schwinn , Stephan Günnemann

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

计算与语言 · 计算机科学 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu