English
Related papers

Related papers: Assessing Language Model Deployment with Risk Card…

200 papers

As large language models (LLMs) permeate more and more applications, an assessment of their associated security risks becomes increasingly necessary. The potential for exploitation by malicious actors, ranging from disinformation to data…

Cryptography and Security · Computer Science 2024-09-24 Erik Derner , Kristina Batistič , Jan Zahálka , Robert Babuška

As generative large model capabilities advance, safety concerns become more pronounced in their outputs. To ensure the sustainable growth of the AI ecosystem, it's imperative to undertake a holistic evaluation and refinement of associated…

Artificial Intelligence · Computer Science 2023-12-01 Jiawen Deng , Jiale Cheng , Hao Sun , Zhexin Zhang , Minlie Huang

As large language models (LLMs) expose systemic security challenges in high risk applications, including privacy leaks, bias amplification, and malicious abuse, there is an urgent need for a dynamic risk assessment and collaborative defence…

Cryptography and Security · Computer Science 2026-02-05 Xiaoyan Zhang , Dongyang Lyu , Xiaoqi Li

Threat detection in Natural Language Processing lacks consistent definitions and standardized benchmarks, and is often conflated with broader phenomena such as toxicity, hate speech, or offensive language. In this work, we introduce…

Computation and Language · Computer Science 2026-05-12 Davide Bruni , Carlo Bardazzi , Maurizio Tesconi

Large language models (LLMs) are demonstrating increasing prowess in cybersecurity applications, creating creating inherent risks alongside their potential for strengthening defenses. In this position paper, we argue that current efforts to…

Cryptography and Security · Computer Science 2025-02-04 Kamilė Lukošiūtė , Adam Swanda

When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails. Indeed, LLMs should never generate content promoting or normalizing harmful, illegal, or unethical behavior that may…

Computation and Language · Computer Science 2024-06-25 Simone Tedeschi , Felix Friedrich , Patrick Schramowski , Kristian Kersting , Roberto Navigli , Huu Nguyen , Bo Li

This study addresses categories of harm surrounding Large Language Models (LLMs) in the field of artificial intelligence. It addresses five categories of harms addressed before, during, and after development of AI applications:…

Computers and Society · Computer Science 2026-05-26 Kevin Chen , Saleh Afroogh , Abhejay Murali , David Atkinson , Amit Dhurandhar , Junfeng Jiao

Large language models (LLMs) have emerged as an integral part of modern societies, powering user-facing applications such as personal assistants and enterprise applications like recruitment tools. Despite their utility, research indicates…

Computation and Language · Computer Science 2024-05-10 Preetam Prabhu Srikar Dammu , Hayoung Jung , Anjali Singh , Monojit Choudhury , Tanushree Mitra

For the safe sharing pre-trained language models, no guidelines exist at present owing to the difficulty in estimating the upper bound of the risk of privacy leakage. One problem is that previous studies have assessed the risk for different…

Computation and Language · Computer Science 2022-03-18 Yuta Nakamura , Shouhei Hanaoka , Yukihiro Nomura , Naoto Hayashi , Osamu Abe , Shuntaro Yada , Shoko Wakamiya , Eiji Aramaki

Large Language Models (LLMs) have emerged as powerful tools for automating programming tasks, including security-related ones. However, they can also introduce vulnerabilities during code generation, fail to detect existing vulnerabilities,…

Cryptography and Security · Computer Science 2026-03-18 Enna Basic , Alberto Giaretta

Global rates of mental health concerns are rising, and there is increasing realization that existing models of mental health care will not adequately expand to meet the demand. With the emergence of large language models (LLMs) has come…

Computation and Language · Computer Science 2024-08-02 Hannah R. Lawrence , Renee A. Schneider , Susan B. Rubin , Maja J. Mataric , Daniel J. McDuff , Megan Jones Bell

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

As large language models (LLMs) are increasingly deployed in enterprise settings, controlling model behavior based on user roles becomes an essential requirement. Existing safety methods typically assume uniform access and focus on…

With the rapid advancement of artificial intelligence, Large Language Models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), including content generation, human-computer interaction, machine translation, and…

Computation and Language · Computer Science 2025-10-31 Songyang Liu , Chaozhuo Li , Jiameng Qiu , Xi Zhang , Feiran Huang , Litian Zhang , Yiming Hei , Philip S. Yu

As reasoning capacity and deployment scope grow in tandem, large language models (LLMs) gain the capacity to engage in behaviors that serve their own objectives, a class of risks we term Emergent Strategic Reasoning Risks (ESRRs). These…

Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale:…

The advent of Large Language Models (LLMs) has revolutionized various applications by providing advanced natural language processing capabilities. However, this innovation introduces new cybersecurity challenges. This paper explores the…

Cryptography and Security · Computer Science 2024-06-18 Stephen Burabari Tete

Risk reporting is essential for documenting AI models, yet only 14% of model cards mention risks, out of which 96% copying content from a small set of cards, leading to a lack of actionable insights. Existing proposals for improving model…

Software Engineering · Computer Science 2025-04-15 Pooja S. B. Rao , Sanja Šćepanović , Ke Zhou , Edyta Paulina Bogucka , Daniele Quercia

Given the growing influence of language model-based agents on high-stakes societal decisions, from public policy to healthcare, ensuring their beneficial impact requires understanding the far-reaching implications of their suggestions. We…

Artificial Intelligence · Computer Science 2025-06-27 Chenkai Sun , Denghui Zhang , ChengXiang Zhai , Heng Ji

Software engineers in various industrial domains are already using Large Language Models (LLMs) to accelerate the process of implementing parts of software systems. When considering its potential use for ADAS or AD systems in the automotive…

Software Engineering · Computer Science 2025-05-27 Ali Nouri , Beatriz Cabrero-Daniel , Zhennan Fei , Krishna Ronanki , Håkan Sivencrona , Christian Berger