English
Related papers

Related papers: Security Challenges in Autonomous Systems Design

200 papers

Autonomous Vehicles (AV) are expected to bring considerable benefits to society, such as traffic optimization and accidents reduction. They rely heavily on advances in many Artificial Intelligence (AI) approaches and techniques. However,…

AI Safety is an emerging area of critical importance to the safe adoption and deployment of AI systems. With the rapid proliferation of AI and especially with the recent advancement of Generative AI (or GAI), the technology ecosystem behind…

Artificial Intelligence · Computer Science 2026-05-14 Chen Chen , Xueluan Gong , Ziyao Liu , Weifeng Jiang , Si Qi Goh , Kwok-Yan Lam

In the rapidly evolving landscape of autonomous driving, the capability to accurately predict future events and assess their implications is paramount for both safety and efficiency, critically aiding the decision-making process. World…

Machine Learning · Computer Science 2024-05-08 Yanchen Guan , Haicheng Liao , Zhenning Li , Jia Hu , Runze Yuan , Yunjian Li , Guohui Zhang , Chengzhong Xu

Software systems are increasingly used in application domains characterised by uncertain environments, evolving requirements and unexpected failures; sudden system malfunctioning raises serious issues of security, safety, loss of comfort or…

Software Engineering · Computer Science 2019-04-04 Simos Gerasimou , Thomas Vogel , Ada Diaconescu

This paper explores the emerging knowledge-driven autonomous driving technologies. Our investigation highlights the limitations of current autonomous driving systems, in particular their sensitivity to data bias, difficulty in handling…

This paper sets the context for the urgency for cyber autonomy, and the current gaps of the cyber security industry. A novel framework proposing four phases of maturity for full cyber autonomy will be discussed. The paper also reviews new…

Cryptography and Security · Computer Science 2020-12-09 Ryan K L Ko

This paper critically examines the evolving ethical and regulatory challenges posed by the integration of artificial intelligence (AI) in cybersecurity. We trace the historical development of AI regulation, highlighting major milestones…

Cryptography and Security · Computer Science 2025-01-22 Vikram Kulothungan

Malicious cyber activity is ubiquitous and its harmful effects have dramatic and often irreversible impacts on society. Given the shortage of cybersecurity professionals, the ever-evolving adversary, the massive amounts of data which could…

Cryptography and Security · Computer Science 2021-06-02 John Emanuello , Kimberly Ferguson-Walter , Erik Hemberg , Una-May O Reilly , Ahmad Ridley , Dennis Ross , Diane Staheli , William Streilein

We investigate the emerging prospect of self-sovereign agents -- AI systems that can economically sustain and extend their own operation without human involvement. Recent advances in large language models and agent frameworks have…

Cryptography and Security · Computer Science 2026-04-13 Wenjie Qu , Xuandong Zhao , Jiaheng Zhang , Dawn Song

Self-driving vehicles are a maturing technology with the potential to reshape mobility by enhancing the safety, accessibility, efficiency, and convenience of automotive transportation. Safety-critical tasks that must be executed by a…

Robotics · Computer Science 2016-04-27 Brian Paden , Michal Cap , Sze Zheng Yong , Dmitry Yershov , Emilio Frazzoli

High levels of robot autonomy are a common goal, but there is a significant risk that the greater the autonomy of the robot the lesser the autonomy of the human working with the robot. For vulnerable populations like older adults who…

Robotics · Computer Science 2022-11-15 Jason R. Wilson

Agentic AI marks an important transition from single-step generative models to systems capable of reasoning, planning, acting, and adapting over long-lasting tasks. By integrating memory, tool use, and iterative decision cycles, these…

Cryptography and Security · Computer Science 2026-01-12 Sahaya Jestus Lazer , Kshitiz Aryal , Maanak Gupta , Elisa Bertino

In recent years, agentic artificial intelligence (AI) systems are becoming increasingly widespread. These systems allow agents to use various tools, such as web browsers, compilers, and more. However, despite their popularity, agentic AI…

Secure robotics is a multi-disciplinary endeavour for improving the cybersecurity posture of robotic and embodied Artificial Intelligence systems. The article surveys emerging concepts and ideas encapsulating the notion of secure robotics…

Robotics · Computer Science 2022-11-15 Adam Haskard , Damith Herath , Zena Assaad

In the past two decades, autonomous driving has been catalyzed into reality by the growing capabilities of machine learning. This paradigm shift possesses significant potential to transform the future of mobility and reshape our society as…

Robotics · Computer Science 2022-10-21 Richard Chakra

Systems modeling practice lacks security analysis tools that can interface with modeling languages to facilitate security by design. Security by design is a necessity in the age of safety critical cyber-physical systems, where security…

Cryptography and Security · Computer Science 2020-10-19 Georgios Bakirtzis , Garrett L. Ward , Christopher J. Deloglos , Carl R. Elks , Barry M. Horowitz , Cody H. Fleming

The rising popularity of self-driving cars has led to the emergence of a new research field in the recent years: Autonomous racing. Researchers are developing software and hardware for high performance race vehicles which aim to operate…

Understanding human driving behavior is crucial to develop autonomous vehicles' algorithms. However, most low level automation, such as the one in advanced driving assistance systems (ADAS), is based on objective safety measures, which are…

Robotics · Computer Science 2022-11-03 Enrico Del Re , Cristina Olaverri-Monreal

Testing autonomous driving systems for safety and reliability is extremely complex. A primary challenge is identifying the relevant test scenarios, especially the critical ones that may expose hazards or risks of harm to autonomous vehicles…

Software Engineering · Computer Science 2023-05-24 Qunying Song , Emelie Engström , Per Runeson

The rapid advancements in artificial intelligence (AI) have presented new opportunities for enhancing efficiency and economic competitiveness across various industries, espcially in banking. Machine learning (ML), as a subset of artificial…

Cryptography and Security · Computer Science 2024-12-09 Ana Kovacevic , Sonja D. Radenkovic , Dragana Nikolic