English
Related papers

Related papers: A Biosecurity Agent for Lifecycle LLM Biosecurity …

200 papers

Embodied agents powered by large language models (LLMs) inherit advanced planning capabilities; however, their direct interaction with the physical world exposes them to safety vulnerabilities. In this work, we identify four key reasoning…

Artificial Intelligence · Computer Science 2025-10-01 Ruolin Chen , Yinqian Sun , Jihang Wang , Mingyang Lv , Qian Zhang , Yi Zeng

Large Language Models (LLMs) are increasingly integrated into high-stakes applications, making robust safety guarantees a central practical and commercial concern. Existing safety evaluations predominantly rely on fixed collections of…

Computation and Language · Computer Science 2026-03-23 Zafir Shamsi , Nikhil Chekuru , Zachary Guzman , Shivank Garg

We argue that LLM agent security is fundamentally an agent-human interaction (AHI) problem, not a purely algorithmic one. To substantiate this position, we conduct a systematic analysis of 59 academic papers, 21 production agent systems,…

Cryptography and Security · Computer Science 2026-05-26 Peiran Wang , Ying Li , Yuan Tian

Large Language Models (LLMs) have achieved impressive performance across diverse natural language processing tasks, but their growing power also amplifies potential risks such as jailbreak attacks that circumvent built-in safety mechanisms.…

Artificial Intelligence · Computer Science 2025-10-01 Qinjian Zhao , Jiaqi Wang , Zhiqiang Gao , Zhihao Dou , Belal Abuhaija , Kaizhu Huang

Large Language Models (LLMs) have been extensively used across diverse domains, including virtual assistants, automated code generation, and scientific research. However, they remain vulnerable to jailbreak attacks, which manipulate the…

Cryptography and Security · Computer Science 2026-01-05 Haoran Gu , Handing Wang , Yi Mei , Mengjie Zhang , Yaochu Jin

Effective pandemic control requires timely and coordinated policymaking across administrative regions that are intrinsically interdependent. However, human-driven responses are often fragmented and reactive, with policies formulated in…

Artificial Intelligence · Computer Science 2026-01-15 Ziyi Shi , Xusen Guo , Hongliang Lu , Mingxing Peng , Haotian Wang , Zheng Zhu , Zhenning Li , Yuxuan Liang , Xinhu Zheng , Hai Yang

As large language models (LLMs) become increasingly integrated into daily applications, it is essential to ensure they operate fairly across diverse user demographics. In this work, we show that LLMs suffer from personalization bias, where…

Computation and Language · Computer Science 2025-02-12 Anvesh Rao Vijjini , Somnath Basu Roy Chowdhury , Snigdha Chaturvedi

Online abuse has grown increasingly complex, spanning toxic language, harassment, manipulation, and fraudulent behavior. Traditional machine-learning approaches dependent on static classifiers and labor-intensive labeling struggle to keep…

Computation and Language · Computer Science 2026-04-02 Suraj Kath , Sanket Badhe , Preet Shah , Ashwin Sampathkumar , Shivani Gupta

A multi-agent system (MAS) powered by large language models (LLMs) can automate tedious user tasks such as meeting scheduling that requires inter-agent collaboration. LLMs enable nuanced protocols that account for unstructured private data,…

Artificial Intelligence · Computer Science 2025-10-17 Mason Nakamura , Abhinav Kumar , Saaduddin Mahmud , Sahar Abdelnabi , Shlomo Zilberstein , Eugene Bagdasarian

Large language models (LLMs) show promise for healthcare question answering, but clinical use is limited by weak verification, insufficient evidence grounding, and unreliable confidence signalling. We propose a multi-agent medical QA…

Computation and Language · Computer Science 2026-02-17 Naeimeh Nourmohammadi , Md Meem Hossain , The Anh Han , Safina Showkat Ara , Zia Ush Shamszaman

Motivated by the challenge to improve the adversarial robustness, security, and trust of medical decision making intelligent agents, this study develops a full-link security enhancement framework, which describes "input risk perception -…

Cryptography and Security · Computer Science 2026-05-12 Saisai Hu

As large language models (LLMs) are increasingly deployed in healthcare, ensuring their safety, particularly within collaborative multi-agent configurations, is paramount. In this paper we introduce MedSentry, a benchmark comprising 5 000…

Multiagent Systems · Computer Science 2025-05-28 Kai Chen , Taihang Zhen , Hewei Wang , Kailai Liu , Xinfeng Li , Jing Huo , Tianpei Yang , Jinfeng Xu , Wei Dong , Yang Gao

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse applications, yet they pose significant security risks that threaten their safe deployment in critical domains. Current security alignment methodologies…

Cryptography and Security · Computer Science 2025-07-22 Pengfei Du

The increasing deployment of Large Language Models (LLMs) across enterprise and mission-critical domains has underscored the urgent need for robust guardrailing systems that ensure safety, reliability, and compliance. Existing solutions…

Computation and Language · Computer Science 2025-10-16 Karthik Avinash , Nikhil Pareek , Rishav Hada

Agentic methods have emerged as a powerful and autonomous paradigm that enhances reasoning, collaboration, and adaptive control, enabling systems to coordinate and independently solve complex tasks. We extend this paradigm to safety…

Artificial Intelligence · Computer Science 2025-10-30 Juan Ren , Mark Dras , Usman Naseem

Language Model Models (LLMs) have improved dramatically in the past few years, increasing their adoption and the scope of their capabilities over time. A significant amount of work is dedicated to ``model alignment'', i.e., preventing LLMs…

Computation and Language · Computer Science 2025-04-07 Abhishek Singhania , Christophe Dupuy , Shivam Mangale , Amani Namboori

Many AI alignment discussions of "runaway optimisation" focus on RL agents: unbounded utility maximisers that over-optimise a proxy objective (e.g., "paperclip maximiser", specification gaming) at the expense of everything else. LLM-based…

Computers and Society · Computer Science 2026-02-27 Roland Pihlakas , Sruthi Susan Kuriakose

Although LLM-based agents, powered by Large Language Models (LLMs), can use external tools and memory mechanisms to solve complex real-world tasks, they may also introduce critical security vulnerabilities. However, the existing literature…

Cryptography and Security · Computer Science 2025-06-02 Hanrong Zhang , Jingyuan Huang , Kai Mei , Yifei Yao , Zhenting Wang , Chenlu Zhan , Hongwei Wang , Yongfeng Zhang

Mechanistic interpretability reveals that safety-critical behaviors (e.g., alignment, jailbreak, backdoor) in Large Language Models (LLMs) are grounded in specialized functional components. However, existing safety attribution methods…

Machine Learning · Computer Science 2026-03-25 Miao Yu , Siyuan Fu , Moayad Aloqaily , Zhenhong Zhou , Safa Otoum , Xing fan , Kun Wang , Yufei Guo , Qingsong Wen

The rapid development of autonomous web agents powered by Large Language Models (LLMs), while greatly elevating efficiency, exposes the frontier risk of taking unintended or harmful actions. This situation underscores an urgent need for…

Artificial Intelligence · Computer Science 2025-07-22 Boyuan Zheng , Zeyi Liao , Scott Salisbury , Zeyuan Liu , Michael Lin , Qinyuan Zheng , Zifan Wang , Xiang Deng , Dawn Song , Huan Sun , Yu Su