English
Related papers

Related papers: Unsolved Problems in ML Safety

200 papers

Machine learning algorithms increasingly influence our decisions and interact with us in all parts of our daily lives. Therefore, just as we consider the safety of power plants, highways, and a variety of other engineered socio-technical…

Computers and Society · Computer Science 2017-08-23 Kush R. Varshney , Homa Alemzadeh

Machine learning is expected to fuel significant improvements in medical care. To ensure that fundamental principles such as beneficence, respect for human autonomy, prevention of harm, justice, privacy, and transparency are respected,…

Many mechanical engineering applications call for multiscale computational modeling and simulation. However, solving for complex multiscale systems remains computationally onerous due to the high dimensionality of the solution space.…

Machine Learning · Computer Science 2023-03-23 Phong C. H. Nguyen , Joseph B. Choi , H. S. Udaykumar , Stephen Baek

Despite the extent of recent advances in Machine Learning (ML) and Neural Networks, providing formal guarantees on the behavior of these systems is still an open problem, and a crucial requirement for their adoption in regulated or…

Machine Learning · Computer Science 2024-10-01 Matteo Francobaldi , Michele Lombardi

The speed and scale at which machine learning (ML) systems are deployed are accelerating even as an increasing number of studies highlight their potential for negative impact. There is a clear need for companies and regulators to manage the…

Computers and Society · Computer Science 2022-04-22 Samson Tan , Araz Taeihagh , Kathy Baxter

Machine Learning (ML) represents a pivotal technology for current and future information systems, and many domains already leverage the capabilities of ML. However, deployment of ML in cybersecurity is still at an early stage, revealing a…

Nowadays, we are witnessing a wide adoption of Machine learning (ML) models in many safety-critical systems, thanks to recent breakthroughs in deep learning and reinforcement learning. Many people are now interacting with systems based on…

Software Engineering · Computer Science 2018-12-07 Houssem Ben Braiek , Foutse Khomh

This systematic literature review examines the critical challenges and solutions related to scalability and maintainability in Machine Learning (ML) systems. As ML applications become increasingly complex and widespread across industries,…

Software Engineering · Computer Science 2025-04-16 Karthik Shivashankar , Ghadi S. Al Hajj , Antonio Martini

Machine Learning (ML) is now used in a range of systems with results that are reported to exceed, under certain conditions, human performance. Many of these systems, in domains such as healthcare , automotive and manufacturing, exhibit high…

Machine Learning · Computer Science 2021-02-03 Richard Hawkins , Colin Paterson , Chiara Picardi , Yan Jia , Radu Calinescu , Ibrahim Habli

Context: An increasing demand is observed in various domains to employ Machine Learning (ML) for solving complex problems. ML models are implemented as software components and deployed in Machine Learning Software Systems (MLSSs). Problem:…

Software Engineering · Computer Science 2022-08-23 Pierre-Olivier Côté , Amin Nikanjam , Rached Bouchoucha , Foutse Khomh

Studying the robustness of Large Language Models (LLMs) to unsafe behaviors is an important topic of research today. Building safety classification models or guard models, which are fine-tuned models for input/output safety classification…

Computation and Language · Computer Science 2025-07-30 Sowmya Vajjala

Many domains now leverage the benefits of Machine Learning (ML), which promises solutions that can autonomously learn to solve complex tasks by training over some data. Unfortunately, in cyberthreat detection, high-quality data is hard to…

Cryptography and Security · Computer Science 2023-12-12 Tobias Braun , Irdin Pekaric , Giovanni Apruzzese

Machine learning has become prevalent across a wide variety of applications. Unfortunately, machine learning has also shown to be susceptible to deception, leading to errors, and even fatal failures. This circumstance calls into question…

Software Engineering · Computer Science 2022-05-03 Dusica Marijan , Arnaud Gotlieb

There is growing recognition that machine learning (ML) exposes new security and privacy vulnerabilities in software systems, yet the technical community's understanding of the nature and extent of these vulnerabilities remains limited but…

Cryptography and Security · Computer Science 2018-11-06 Nicolas Papernot

Recent advances in Machine Learning(ML) have led to its broad adoption in a series of power system applications, ranging from meter data analytics, renewable/load/price forecasting to grid security assessment. Although these data-driven…

Systems and Control · Computer Science 2018-08-28 Yize Chen , Yushi Tan , Deepjyoti Deka

Machine learning based system are increasingly being used for sensitive tasks such as security surveillance, guiding autonomous vehicle, taking investment decisions, detecting and blocking network intrusion and malware etc. However, recent…

Artificial Intelligence · Computer Science 2017-07-12 Atul Kumar , Sameep Mehta

Recently, advances in deep learning have been observed in various fields, including computer vision, natural language processing, and cybersecurity. Machine learning (ML) has demonstrated its ability as a potential tool for anomaly…

Cryptography and Security · Computer Science 2023-10-31 D'Jeff Kanda Nkashama , Arian Soltani , Jean-Charles Verdier , Marc Frappier , Pierre-Martin Tardif , Froduald Kabanza

Machine Learning (ML) is used in critical highly regulated and high-stakes fields such as finance, medicine, and transportation. The correctness of these ML applications is important for human safety and economic benefit. Progress has been…

Software Engineering · Computer Science 2023-09-06 Sheng Wong , Scott Barnett , Jessica Rivera-Villicana , Anj Simmons , Hala Abdelkader , Jean-Guy Schneider , Rajesh Vasa

Machine learning (ML) techniques are increasingly applied to decision-making and control problems in Cyber-Physical Systems among which many are safety-critical, e.g., chemical plants, robotics, autonomous vehicles. Despite the significant…

Systems and Control · Electrical Eng. & Systems 2019-09-12 Xiaozhe Gu , Arvind Easwaran

Context and motivation: The development and operation of critical software that contains machine learning (ML) models requires diligence and established processes. Especially the training data used during the development of ML models have…

Software Engineering · Computer Science 2023-02-01 Hans-Martin Heyn , Eric Knauss , Iswarya Malleswaran , Shruthi Dinakaran