English
Related papers

Related papers: A Structured Approach to Trustworthy Autonomous/Co…

200 papers

With ubiquitous exposure of AI systems today, we believe AI development requires crucial considerations to be deemed trustworthy. While the potential of AI systems is bountiful, though, is still unknown-as are their risks. In this work, we…

Computers and Society · Computer Science 2023-09-19 Jamell Dacon

The use of Artificial Intelligence (AI) in high-risk, decision-making scenarios presents technical, safety, and normative challenges; problems that may only be ameliorated by human oversight. However, notions of human oversight lack a…

Many intelligent transportation systems are multi-agent systems, i.e., both the traffic participants and the subsystems within the transportation infrastructure can be modeled as interacting agents. The use of AI-based methods to achieve…

Artificial Intelligence · Computer Science 2021-11-09 Mingxi Cheng , Junyao Zhang , Shahin Nazarian , Jyotirmoy Deshmukh , Paul Bogdan

To facilitate the widespread acceptance of AI systems guiding decision-making in real-world applications, it is key that solutions comprise trustworthy, integrated human-AI systems. Not only in safety-critical applications such as…

Artificial Intelligence · Computer Science 2020-01-16 Florian Buettner , John Piorkowski , Ian McCulloh , Ulli Waltinger

In the ever-expanding landscape of Artificial Intelligence (AI), where innovation thrives and new products and services are continuously being delivered, ensuring that AI systems are designed and developed responsibly throughout their…

Software Engineering · Computer Science 2024-05-10 Maria Teresa Baldassarre , Domenico Gigante , Marcos Kalinowski , Azzurra Ragone

Long-term autonomy of robotic systems implicitly requires dependable platforms that are able to naturally handle hardware and software faults, problems in behaviors, or lack of knowledge. Model-based dependable platforms additionally…

Robotics · Computer Science 2022-07-21 Stalin Muñoz Gutiérrez , Gerald Steinbauer-Wagner

Autonomous systems (AS) are systems that have the capability to take decisions free from direct human control. AS are increasingly being considered for adoption for applications where their behaviour may cause harm, such as when used for…

Software Engineering · Computer Science 2022-08-02 Richard Hawkins , Matt Osborne , Mike Parsons , Mark Nicholson , John McDermid , Ibrahim Habli

The debate on AI ethics largely focuses on technical improvements and stronger regulation to prevent accidents or misuse of AI, with solutions relying on holding individual actors accountable for responsible AI development. While useful and…

Artificial Intelligence · Computer Science 2019-11-11 Agnes Schim van der Loeff , Iggy Bassi , Sachin Kapila , Jevgenij Gamper

Background: Due to their diversity, complexity, and above all importance, safety-critical and dependable systems must be developed with special diligence. Criticality increases as these systems likely contain artificial intelligence (AI)…

Software Engineering · Computer Science 2025-06-03 Amra Ramic , Stefan Kugele

Artificial Intelligence (AI) has emerged as a key technology, driving advancements across a range of applications. Its integration into modern autonomous systems requires assuring safety. However, the challenge of assuring safety in systems…

Machine Learning · Computer Science 2024-12-19 Ronald Schnitzer , Lennart Kilian , Simon Roessner , Konstantinos Theodorou , Sonja Zillner

The era of pervasive computing has resulted in countless devices that continuously monitor users and their environment, generating an abundance of user behavioural data. Such data may support improving the quality of service, but may also…

Computers and Society · Computer Science 2020-02-14 Abhishek Kumar , Tristan Braud , Sasu Tarkoma , Pan Hui

Autonomous vehicles often make complex decisions via machine learning-based predictive models applied to collected sensor data. While this combination of methods provides a foundation for real-time actions, self-driving behavior primarily…

Robotics · Computer Science 2024-04-12 Shahin Atakishiyev , Mohammad Salameh , Randy Goebel

Building trustworthy autonomous systems is challenging for many reasons beyond simply trying to engineer agents that 'always do the right thing.' There is a broader context that is often not considered within AI and HRI: that the problem of…

Computers and Society · Computer Science 2020-10-15 Alexis Morris , Hallie Siegel , Jonathan Kelly

As artificial intelligence (AI) becomes increasingly embedded in the core functions of social, political, and economic life, it catalyzes structural transformations with far-reaching societal implications. This paper advances the concept of…

Computers and Society · Computer Science 2025-05-19 Kyle A Kilian

The gigantic complexity and heterogeneity of today's advanced cyber-physical systems and systems of systems is multiplied by the use of avant-garde computing architectures to employ artificial intelligence based autonomy in the system.…

Computers and Society · Computer Science 2019-09-09 Maksim Jenihhin , Matteo Sonza Reorda , Aneesh Balakrishnan , Dan Alexandrescu

The interaction between humans and AI in safety-critical systems presents a unique set of challenges that remain partially addressed by existing frameworks. These challenges stem from the complex interplay of requirements for transparency,…

Since Artificial Intelligence (AI) software uses techniques like deep lookahead search and stochastic optimization of huge neural networks to fit mammoth datasets, it often results in complex behavior that is difficult for people to…

Artificial Intelligence · Computer Science 2018-10-16 Daniel S. Weld , Gagan Bansal

Collaboration in multi-agent autonomous systems is critical to increase performance while ensuring safety. However, due to heterogeneity of their features in, e.g., perception qualities, some autonomous systems have to be considered more…

Multiagent Systems · Computer Science 2023-05-22 Selma Saidi

The advent of advanced AI underscores the urgent need for comprehensive safety evaluations, necessitating collaboration across communities (i.e., AI, software engineering, and governance). However, divergent practices and terminologies…

Software Engineering · Computer Science 2024-05-17 Boming Xia , Qinghua Lu , Liming Zhu , Zhenchang Xing

Artificial intelligence (AI) has been advancing at a fast pace and it is now poised for deployment in a wide range of applications, such as autonomous systems, medical diagnosis and natural language processing. Early adoption of AI…

Machine Learning · Computer Science 2023-09-21 Marta Kwiatkowska , Xiyue Zhang