English
Related papers

Related papers: The Risks of Machine Learning Systems

200 papers

This PhD thesis investigates the societal impact of machine learning (ML). ML increasingly informs consequential decisions and recommendations, significantly affecting many aspects of our lives. As these data-driven systems are often…

Machine Learning · Computer Science 2025-10-29 Joachim Baumann

Machine learning (ML) has recently created many new success stories. Hence, there is a strong motivation to use ML technology in software-intensive systems, including safety-critical systems. This raises the issue of safety verification of…

Software Engineering · Computer Science 2020-07-01 Hermann Kaindl , Stefan Kramer

The Machine learning (ML) is a rapidly evolving field of technology that has the potential to greatly impact society in a variety of ways. However, there are also concerns about the potential negative effects of ML on society, such as job…

Computers and Society · Computer Science 2024-04-17 Md Kamrul Hossain Siam , Manidipa Bhattacharjee , Shakik Mahmud , Md. Saem Sarkar , Md. Masud Rana

As machine learning (ML) increasingly affects people and society, awareness of its potential unwanted consequences has also grown. To anticipate, prevent, and mitigate undesirable downstream consequences, it is critical that we understand…

Machine Learning · Computer Science 2021-12-03 Harini Suresh , John V. Guttag

Machine learning based system are increasingly being used for sensitive tasks such as security surveillance, guiding autonomous vehicle, taking investment decisions, detecting and blocking network intrusion and malware etc. However, recent…

Artificial Intelligence · Computer Science 2017-07-12 Atul Kumar , Sameep Mehta

There is growing recognition that machine learning (ML) exposes new security and privacy vulnerabilities in software systems, yet the technical community's understanding of the nature and extent of these vulnerabilities remains limited but…

Cryptography and Security · Computer Science 2018-11-06 Nicolas Papernot

Context: An increasing demand is observed in various domains to employ Machine Learning (ML) for solving complex problems. ML models are implemented as software components and deployed in Machine Learning Software Systems (MLSSs). Problem:…

Software Engineering · Computer Science 2022-08-23 Pierre-Olivier Côté , Amin Nikanjam , Rached Bouchoucha , Foutse Khomh

Artificial intelligence risks are multidimensional in nature, as the same risk scenarios may have legal, operational, and financial risk dimensions. With the emergence of new AI regulations, the state of the art of artificial intelligence…

Computers and Society · Computer Science 2025-09-24 Luis Enriquez Alvarez

The widespread adoption of machine learning (ML) systems increased attention to their security and emergence of adversarial machine learning (AML) techniques that exploit fundamental vulnerabilities in ML systems, creating an urgent need…

Machine Learning · Computer Science 2025-08-26 Avishag Shapira , Simon Shigol , Asaf Shabtai

Machine Learning (ML) techniques have been rapidly adopted by smart Cyber-Physical Systems (CPS) and Internet-of-Things (IoT) due to their powerful decision-making capabilities. However, they are vulnerable to various security and…

Cryptography and Security · Computer Science 2021-01-08 Muhammad Shafique , Mahum Naseer , Theocharis Theocharides , Christos Kyrkou , Onur Mutlu , Lois Orosa , Jungwook Choi

In this article, we propose the Artificial Intelligence Security Taxonomy to systematize the knowledge of threats, vulnerabilities, and security controls of machine-learning-based (ML-based) systems. We first classify the damage caused by…

Cryptography and Security · Computer Science 2023-01-20 Yusuke Kawamoto , Kazumasa Miyake , Koichi Konishi , Yutaka Oiwa

Although cyberattacks on machine learning (ML) production systems can be harmful, today, security practitioners are ill equipped, lacking methodologies and tactical tools that would allow them to analyze the security risks of their ML-based…

Cryptography and Security · Computer Science 2021-10-05 Ron Bitton , Nadav Maman , Inderjeet Singh , Satoru Momiyama , Yuval Elovici , Asaf Shabtai

In the last two years, more than 200 papers have been written on how machine learning (ML) systems can fail because of adversarial attacks on the algorithms and data; this number balloons if we were to incorporate papers covering…

Machine Learning · Computer Science 2019-11-26 Ram Shankar Siva Kumar , David O Brien , Kendra Albert , Salomé Viljöen , Jeffrey Snover

Machine learning (ML) provides us with numerous opportunities, allowing ML systems to adapt to new situations and contexts. At the same time, this adaptability raises uncertainties concerning the run-time product quality or dependability,…

Software Engineering · Computer Science 2022-10-18 Lalli Myllyaho , Mikko Raatikainen , Tomi Männistö , Jukka K. Nurminen , Tommi Mikkonen

In this paper we propose a framework for assessing the risk associated with deploying a machine learning model in a specified environment. For that we carry over the risk definition from decision theory to machine learning. We develop and…

The idea of applying machine learning(ML) to solve problems in security domains is almost 3 decades old. As information and communications grow more ubiquitous and more data become available, many security risks arise as well as appetite to…

Cryptography and Security · Computer Science 2016-11-11 Heju Jiang , Jasvir Nagra , Parvez Ahammad

Adversarial attacks for machine learning models have become a highly studied topic both in academia and industry. These attacks, along with traditional security threats, can compromise confidentiality, integrity, and availability of…

Cryptography and Security · Computer Science 2020-12-10 Jakub Breier , Adrian Baldwin , Helen Balinsky , Yang Liu

Given the inherent non-deterministic nature of machine learning (ML) systems, their behavior in production environments can lead to unforeseen and potentially dangerous outcomes. For a timely detection of unwanted behavior and to prevent…

Software Engineering · Computer Science 2025-10-01 Hira Naveed , John Grundy , Chetan Arora , Hourieh Khalajzadeh , Omar Haggag

Although machine learning is widely used in practice, little is known about practitioners' understanding of potential security challenges. In this work, we close this substantial gap and contribute a qualitative study focusing on…

Cryptography and Security · Computer Science 2022-06-30 Lukas Bieringer , Kathrin Grosse , Michael Backes , Battista Biggio , Katharina Krombholz

With the growing processing power of computing systems and the increasing availability of massive datasets, machine learning algorithms have led to major breakthroughs in many different areas. This development has influenced computer…