English
Related papers

Related papers: Explainability Requirements as Hyperproperties

200 papers

Explainable artificial intelligence is a research field that tries to provide more transparency for autonomous intelligent systems. Explainability has been used, particularly in reinforcement learning and robotic scenarios, to better…

Artificial Intelligence · Computer Science 2022-07-08 Francisco Cruz , Charlotte Young , Richard Dazeley , Peter Vamplew

Hyperproperties are commonly used in computer security to define information-flow policies and other requirements that reason about the relationship between multiple computations. In this paper, we study a novel class of hyperproperties…

Logic in Computer Science · Computer Science 2022-06-01 Raven Beutner , Bernd Finkbeiner

We investigate the complexity of the satisfiability problem for a modal logic expressing `knowing how' assertions, related to an agent's abilities to achieve a certain goal. We take one of the most standard semantics for this kind of logics…

Logic in Computer Science · Computer Science 2023-10-02 Carlos Areces , Valentin Cassano , Raul Fervari , Pablo Castro , Andres Saravia

We introduce the problem of temporal coverability for realizability and synthesis. Namely, given a language of words that must be covered by a produced system, how to automatically produce such a system. We consider the case of coverability…

Logic in Computer Science · Computer Science 2018-04-11 Krishnendu Chatterjee , Nir Piterman

Interpretable classification models are built with the purpose of providing a comprehensible description of the decision logic to an external oversight agent. When considered in isolation, a decision tree, a set of classification rules, or…

Machine Learning · Computer Science 2019-03-18 Riccardo Guidotti , Salvatore Ruggieri

There is a growing interest on formal methods-based robotic planning for temporal logic objectives. In this work, we extend the scope of existing synthesis methods to hyper-temporal logics. We are motivated by the fact that important…

Robotics · Computer Science 2020-04-30 Yu Wang , Siddhartha Nalluri , Miroslav Pajic

Designing and implementing explainable systems is seen as the next step towards increasing user trust in, acceptance of and reliance on Artificial Intelligence (AI) systems. While explaining choices made by black-box algorithms such as…

Multiagent Systems · Computer Science 2022-08-23 Sharadhi Alape Suryanarayana , David Sarne , Sarit Kraus

Machine learning-based systems are rapidly gaining popularity and in-line with that there has been a huge research surge in the field of explainability to ensure that machine learning models are reliable, fair, and can be held liable for…

Machine Learning · Computer Science 2021-04-12 Rohit Saluja , Avleen Malhi , Samanta Knapič , Kary Främling , Cicek Cavdar

The semantics for counterfactuals due to David Lewis has been challenged on the basis of unlikely, or impossible, events. Such events may skew a given similarity order in favour of those possible worlds which exhibit them. By updating the…

Logic in Computer Science · Computer Science 2016-06-28 Patrick Girard , Marcus Anthony Triplett

Accountability is an often called for property of technical systems. It is a requirement for algorithmic decision systems, autonomous cyber-physical systems, and for software systems in general. As a concept, accountability goes back to the…

Software Engineering · Computer Science 2021-04-30 Severin Kacianka , Alexander Pretschner

The last decade witnessed an ever-increasing stream of successes in Machine Learning (ML). These successes offer clear evidence that ML is bound to become pervasive in a wide range of practical uses, including many that directly affect…

Artificial Intelligence · Computer Science 2023-01-31 Joao Marques-Silva

The past decade has seen a substantial rise in the amount of mis- and disinformation online, from targeted disinformation campaigns to influence politics, to the unintentional spreading of misinformation about public health. This…

Computation and Language · Computer Science 2021-12-09 Isabelle Augenstein

Information retrieval models have witnessed a paradigm shift from unsupervised statistical approaches to feature-based supervised approaches to completely data-driven ones that make use of the pre-training of large language models. While…

Information Retrieval · Computer Science 2024-03-05 Saran Pandian , Debasis Ganguly , Sean MacAvaney

We introduce a functional inductive framework to verify discrete-time dynamical systems against hyperproperties specified as Hyperlinear temporal logic formulae via a notion of HyperCertificates. Unlike linear temporal logic (LTL) formulae…

Systems and Control · Electrical Eng. & Systems 2026-05-04 Vishnu Murali , Amin Falah , Ashutosh Trivedi , Majid Zamani

The currently dominating artificial intelligence and machine learning technology, neural networks, builds on inductive statistical learning. Neural networks of today are information processing systems void of understanding and reasoning…

Artificial Intelligence · Computer Science 2022-08-26 Lars Holmberg

Necessity and sufficiency are the building blocks of all successful explanations. Yet despite their importance, these notions have been conceptually underdeveloped and inconsistently applied in explainable artificial intelligence (XAI), a…

Machine Learning · Computer Science 2021-06-11 David Watson , Limor Gultchin , Ankur Taly , Luciano Floridi

The large and still increasing popularity of deep learning clashes with a major limit of neural network architectures, that consists in their lack of capability in providing human-understandable motivations of their decisions. In situations…

Machine Learning · Computer Science 2023-05-22 Gabriele Ciravegna , Pietro Barbiero , Francesco Giannini , Marco Gori , Pietro Lió , Marco Maggini , Stefano Melacci

The search for information on the web is faced with several problems, which arise on the one hand from the vast number of available sources, and on the other hand from their heterogeneity. A promising approach is the use of multi-agent…

Multiagent Systems · Computer Science 2007-05-23 T. Eiter , M. Fink , G. Sabbatini , H. Tompits

Model explainability has become an important problem in machine learning (ML) due to the increased effect that algorithmic predictions have on humans. Explanations can help users understand not only why ML models make certain predictions,…

Machine Learning · Computer Science 2022-09-13 Ana Lucic

Post-hoc explanations of machine learning models are crucial for people to understand and act on algorithmic predictions. An intriguing class of explanations is through counterfactuals, hypothetical examples that show people how to obtain a…

Machine Learning · Computer Science 2019-12-09 Ramaravind Kommiya Mothilal , Amit Sharma , Chenhao Tan