English
Related papers

Related papers: From plane crashes to algorithmic harm: applicabil…

200 papers

Artificial intelligence (AI) and machine learning (ML) are increasingly broadly adopted in industry, However, based on well over a dozen case studies, we have learned that deploying industry-strength, production quality ML models in systems…

Machine Learning · Computer Science 2020-06-04 Jan Bosch , Ivica Crnkovic , Helena Holmström Olsson

Statistical learning is the process of estimating an unknown probabilistic input-output relationship of a system using a limited number of observations. A statistical learning machine (SLM) is the algorithm, function, model, or rule, that…

Machine Learning · Statistics 2026-04-26 Waleed A. Yousef

The irresponsible use of ML algorithms in practical settings has received a lot of deserved attention in the recent years. We posit that the traditional system analysis perspective is needed when designing and implementing ML algorithms and…

Machine Learning · Computer Science 2022-04-20 Virginia H. Goodwin , Rajmonda S. Caceres

The development of Machine Learning (ML) based systems is complex and requires multidisciplinary teams with diverse skill sets. This may lead to communication issues or misapplication of best practices. Process models can alleviate these…

Software Engineering · Computer Science 2024-08-29 Sergio Morales , Robert Clarisó , Jordi Cabot

The use of machine learning systems in clinical routine is still hampered by the necessity of a medical device certification and/or by difficulty to implement these systems in a clinic's quality management system. In this context, the key…

Medical Physics · Physics 2022-10-18 Lorenzo Mercolli , Axel Rominger , Kuangyu Shi

Fine-tuning language models is commonly believed to inevitably harm their safety, i.e., refusing to respond to harmful user requests, even when using harmless datasets, thus requiring additional safety measures. We challenge this belief…

Machine Learning · Computer Science 2025-08-19 Minseon Kim , Jin Myung Kwak , Lama Alssum , Bernard Ghanem , Philip Torr , David Krueger , Fazl Barez , Adel Bibi

Machine Learning (ML) models, such as deep neural networks, are widely applied in autonomous systems to perform complex perception tasks. New dependability challenges arise when ML predictions are used in safety-critical applications, like…

Machine Learning · Computer Science 2024-12-11 Raul Sena Ferreira , Joris Guérin , Kevin Delmas , Jérémie Guiochet , Hélène Waeselynck

In this paper we propose a framework for assessing the risk associated with deploying a machine learning model in a specified environment. For that we carry over the risk definition from decision theory to machine learning. We develop and…

Machine Learning (ML) seems to be one of the most promising solution to automate partially or completely some of the complex tasks currently realized by humans, such as driving vehicles, recognizing voice, etc. It is also an opportunity to…

Machine learning algorithms increasingly influence our decisions and interact with us in all parts of our daily lives. Therefore, just as we consider the safety of power plants, highways, and a variety of other engineered socio-technical…

Computers and Society · Computer Science 2017-08-23 Kush R. Varshney , Homa Alemzadeh

This paper highlights an important, if under-examined, set of questions about the deployment of machine learning technologies in the field of disaster risk management (DRM). While emerging tools show promising capacity to support scientific…

Computers and Society · Computer Science 2019-12-19 Robert Soden , Dennis Wagenaar , Dave Luo , Annegien Tijssen

The development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. The lack of diligence can lead to technical debt, scope creep and misaligned…

Software Engineering · Computer Science 2020-12-17 Alexander Lavin , Gregory Renard

In recent years, curial incidents and accidents have been reported due to un-intended control caused by misjudgment of statistical machine learning (SML), which include deep learning. The international functional safety standards for…

Software Engineering · Computer Science 2020-08-05 Akihisa Morikawa , Yutaka Matsubara

The integration of machine learning (ML) is critical for industrial competitiveness, yet its adoption is frequently stalled by the prohibitive costs and operational disruptions of upgrading legacy systems. The financial and logistical…

Machine Learning · Computer Science 2026-03-12 Ashiqur Rahman , Hamed Alhoori

Fatal accidents are a major issue hindering the wide acceptance of safety-critical systems that employ machine learning and deep learning models, such as automated driving vehicles. In order to use machine learning in a safety-critical…

Software Engineering · Computer Science 2019-08-23 Hiroshi Kuwajima , Hirotoshi Yasuoka , Toshihiro Nakae

Atmospheric Extreme Events (EEs) cause severe damages to human societies and ecosystems. The frequency and intensity of EEs and other associated events are increasing in the current climate change and global warming risk. The accurate…

Machine-learning (ML) techniques have become popular in the recent years. ML techniques rely on mathematics and on software engineering. Researchers and practitioners studying best practices for designing ML application systems and software…

Software Engineering · Computer Science 2019-10-14 Hironori Washizaki , Hiromu Uchida , Foutse Khomh , Yann-Gael Gueheneuc

Given the inherent non-deterministic nature of machine learning (ML) systems, their behavior in production environments can lead to unforeseen and potentially dangerous outcomes. For a timely detection of unwanted behavior and to prevent…

Software Engineering · Computer Science 2025-10-01 Hira Naveed , John Grundy , Chetan Arora , Hourieh Khalajzadeh , Omar Haggag

Machine Learning (ML) has become a ubiquitous tool for predicting and classifying data and has found application in several problem domains, including Software Development (SD). This paper reviews the literature between 2000 and 2019 on the…

Production machine learning (ML) systems fail silently -- not with crashes, but through wrong decisions. While observability is recognized as critical for ML operations, there is a lack empirical evidence of what practitioners actually…

Software Engineering · Computer Science 2025-10-29 Joran Leest , Ilias Gerostathopoulos , Patricia Lago , Claudia Raibulet