English
Related papers

Related papers: ARGOS: Automated Functional Safety Requirement Syn…

200 papers

The integration of vision-language models (VLMs) is driving a new generation of embodied agents capable of operating in human-centered environments. However, as deployment expands, these systems face growing safety risks, particularly when…

Cryptography and Security · Computer Science 2025-10-21 Zonghao Ying , Le Wang , Yisong Xiao , Jiakai Wang , Yuqing Ma , Jinyang Guo , Zhenfei Yin , Mingchuan Zhang , Aishan Liu , Xianglong Liu

Embodied Artificial Intelligence (Embodied AI) integrates perception, cognition, planning, and interaction into agents that operate in open-world, safety-critical environments. As these systems gain autonomy and enter domains such as…

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they face significant challenges in embodied task planning scenarios that require continuous environmental understanding and action generation.…

Computation and Language · Computer Science 2025-07-01 Zhaoye Fei , Li Ji , Siyin Wang , Junhao Shi , Jingjing Gong , Xipeng Qiu

The increasing use of Large Language Models (LLMs) offers significant opportunities across the engineering lifecycle, including requirements engineering, software development, process optimization, and decision support. Despite this…

Software Engineering · Computer Science 2026-02-05 Stefan Otten , Philipp Reis , Philipp Rigoll , Joshua Ransiek , Tobias Schürmann , Jacob Langner , Eric Sax

As Large Language Models (LLMs) and generative AI become increasingly widespread, concerns about content safety have grown in parallel. Currently, there is a clear lack of high-quality, human-annotated datasets that address the full…

The rapid advancement of machine learning (ML) has led to its increasing integration into cyber-physical systems (CPS) across diverse domains. While CPS offer powerful capabilities, incorporating ML components introduces significant safety…

Machine Learning · Computer Science 2025-07-15 Calum Corrie Imrie , Ioannis Stefanakos , Sepeedeh Shahbeigi , Richard Hawkins , Simon Burton

End-to-end autonomous driving models increasingly benefit from large vision--language models for semantic understanding, yet ensuring safe and accurate operation under long-tail conditions remains challenging. These challenges are…

Robotics · Computer Science 2026-02-03 Weizhe Tang , Junwei You , Jiaxi Liu , Zhaoyi Wang , Rui Gan , Zilin Huang , Feng Wei , Bin Ran

Large Language Models (LLMs) have become an essential infrastructure for Artificial General Intelligence (AGI), yet their lack of well-defined memory management systems hinders the development of long-context reasoning, continual…

Embodied Large Language Models (LLMs) enable AI agents to interact with the physical world through natural language instructions and actions. However, beyond the language-level risks inherent to LLMs themselves, embodied LLMs with…

Robotics · Computer Science 2026-03-03 Xinyu Huang , Qiang Yang , Leming Shen , Zijing Ma , Yuanqing Zheng

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Machine Learning · Computer Science 2025-10-08 Zizhao Wang , Dingcheng Li , Vaishakh Keshava , Phillip Wallis , Ananth Balashankar , Peter Stone , Lukas Rutishauser

As generative AI systems, including large language models (LLMs) and diffusion models, advance rapidly, their growing adoption has led to new and complex security risks often overlooked in traditional AI risk assessment frameworks. This…

Cryptography and Security · Computer Science 2024-10-21 Aviral Srivastava , Sourav Panda

Embodied agents powered by large language models (LLMs) inherit advanced planning capabilities; however, their direct interaction with the physical world exposes them to safety vulnerabilities. In this work, we identify four key reasoning…

Artificial Intelligence · Computer Science 2025-10-01 Ruolin Chen , Yinqian Sun , Jihang Wang , Mingyang Lv , Qian Zhang , Yi Zeng

Changes and updates in the requirement artifacts, which can be frequent in the automotive domain, are a challenge for SafetyOps. Large Language Models (LLMs), with their impressive natural language understanding and generating capabilities,…

Artificial Intelligence · Computer Science 2024-03-26 Ali Nouri , Beatriz Cabrero-Daniel , Fredrik Törner , Hȧkan Sivencrona , Christian Berger

This paper introduces ArGen (Auto-Regulation of Generative AI systems), a framework for aligning Large Language Models (LLMs) with complex sets of configurable, machine-readable rules spanning ethical principles, operational safety…

Computers and Society · Computer Science 2025-09-10 Kapil Madan

Vision-Language Models (VLMs) have achieved remarkable progress in multimodal reasoning tasks through enhanced chain-of-thought capabilities. However, this advancement also introduces novel safety risks, as these models become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yinan Xia , Yilei Jiang , Yingshui Tan , Xiaoyong Zhu , Xiangyu Yue , Bo Zheng

Large language models (LLMs) have transformed the development of embodied intelligence. By providing a few contextual demonstrations, developers can utilize the extensive internal knowledge of LLMs to effortlessly translate complex tasks…

Artificial Intelligence · Computer Science 2024-08-07 Aishan Liu , Yuguang Zhou , Xianglong Liu , Tianyuan Zhang , Siyuan Liang , Jiakai Wang , Yanjun Pu , Tianlin Li , Junqi Zhang , Wenbo Zhou , Qing Guo , Dacheng Tao

Large language models (LLMs) are useful tools with the capacity for performing specific types of knowledge work at an effective scale. However, LLM deployments in high-risk and safety-critical domains pose unique challenges, notably the…

Computation and Language · Computer Science 2024-09-05 Joe B Hakim , Jeffery L Painter , Darmendra Ramcharran , Vijay Kara , Greg Powell , Paulina Sobczak , Chiho Sato , Andrew Bate , Andrew Beam

Present day LLMs face the challenge of managing affordance-based safety risks-situations where outputs inadvertently facilitate harmful actions due to overlooked logical implications. Traditional safety solutions, such as scalar…

Computation and Language · Computer Science 2025-08-11 Sayantan Adak , Pratyush Chatterjee , Somnath Banerjee , Rima Hazra , Somak Aditya , Animesh Mukherjee

This thesis explores a multimodal AI framework for enhancing construction safety through the combined analysis of textual and visual data. In safety-critical environments such as construction sites, accident data often exists in multiple…

Artificial Intelligence · Computer Science 2025-11-21 Islem Sahraoui

Replicating human-level intelligence in the execution of embodied tasks remains challenging due to the unconstrained nature of real-world environments. Novel use of large language models (LLMs) for task planning seeks to address the…