English
Related papers

Related papers: Unsolved Problems in ML Safety

200 papers

Machine learning (ML) models deployed in many safety- and business-critical systems are vulnerable to exploitation through adversarial examples. A large body of academic research has thoroughly explored the causes of these blind spots,…

Cryptography and Security · Computer Science 2020-07-15 Ivan Evtimov , Weidong Cui , Ece Kamar , Emre Kiciman , Tadayoshi Kohno , Jerry Li

Machine learning (ML) is finding its way into safety-critical systems (SCS). Current safety standards and practice were not designed to cope with ML techniques, and it is difficult to be confident that SCSs that contain ML components are…

Machine Learning · Computer Science 2021-11-30 Mehrnoosh Askarpour , Alan Wassyng , Mark Lawford , Richard Paige , Zinovy Diskin

The open-world deployment of Machine Learning (ML) algorithms in safety-critical applications such as autonomous vehicles needs to address a variety of ML vulnerabilities such as interpretability, verifiability, and performance limitations.…

Machine Learning · Computer Science 2022-03-09 Sina Mohseni , Haotao Wang , Zhiding Yu , Chaowei Xiao , Zhangyang Wang , Jay Yadawa

Machine Learning (ML) models, such as deep neural networks, are widely applied in autonomous systems to perform complex perception tasks. New dependability challenges arise when ML predictions are used in safety-critical applications, like…

Machine Learning · Computer Science 2024-12-11 Raul Sena Ferreira , Joris Guérin , Kevin Delmas , Jérémie Guiochet , Hélène Waeselynck

While Machine Learning (ML) technologies are widely adopted in many mission critical fields to support intelligent decision-making, concerns remain about system resilience against ML-specific security attacks and privacy breaches as well as…

Machine Learning · Computer Science 2022-02-15 Pulei Xiong , Scott Buffett , Shahrear Iqbal , Philippe Lamontagne , Mohammad Mamun , Heather Molyneaux

The rapid development of Machine Learning (ML) has demonstrated superior performance in many areas, such as computer vision, video and speech recognition. It has now been increasingly leveraged in software systems to automate the core…

Cryptography and Security · Computer Science 2023-12-19 Huaming Chen , M. Ali Babar

Machine Learning (ML) techniques have been rapidly adopted by smart Cyber-Physical Systems (CPS) and Internet-of-Things (IoT) due to their powerful decision-making capabilities. However, they are vulnerable to various security and…

Cryptography and Security · Computer Science 2021-01-08 Muhammad Shafique , Mahum Naseer , Theocharis Theocharides , Christos Kyrkou , Onur Mutlu , Lois Orosa , Jungwook Choi

Machine learning (ML) components are increasingly integrated into software products, yet their complexity and inherent uncertainty often lead to unintended and hazardous consequences, both for individuals and society at large. Despite these…

Software Engineering · Computer Science 2025-09-15 Yining Hong , Christopher S. Timperley , Christian Kästner

Machine learning (ML) pervades an increasing number of academic disciplines and industries. Its impact is profound, and several fields have been fundamentally altered by it, autonomy and computer vision for example; reliability engineering…

Machine Learning · Computer Science 2020-08-20 Zhaoyi Xu , Joseph Homer Saleh

Advances in machine learning (ML) in recent years have enabled a dizzying array of applications such as data analytics, autonomous systems, and security diagnostics. ML is now pervasive---new systems and models are being deployed in every…

Cryptography and Security · Computer Science 2016-11-14 Nicolas Papernot , Patrick McDaniel , Arunesh Sinha , Michael Wellman

As machine learning (ML) systems increasingly permeate high-stakes settings such as healthcare, transportation, military, and national security, concerns regarding their reliability have emerged. Despite notable progress, the performance of…

Machine Learning · Computer Science 2023-08-01 Anthony Corso , David Karamadian , Romeo Valentin , Mary Cooper , Mykel J. Kochenderfer

Autonomous vehicles rely on machine learning to solve challenging tasks in perception and motion planning. However, automotive software safety standards have not fully evolved to address the challenges of machine learning safety such as…

Machine Learning · Computer Science 2019-12-23 Sina Mohseni , Mandar Pitale , Vasu Singh , Zhangyang Wang

The idea of applying machine learning(ML) to solve problems in security domains is almost 3 decades old. As information and communications grow more ubiquitous and more data become available, many security risks arise as well as appetite to…

Cryptography and Security · Computer Science 2016-11-11 Heju Jiang , Jasvir Nagra , Parvez Ahammad

Large Reasoning Models (LRMs) have exhibited extraordinary prowess in tasks like mathematics and coding, leveraging their advanced reasoning capabilities. Nevertheless, as these capabilities progress, significant concerns regarding their…

Computation and Language · Computer Science 2025-05-27 Cheng Wang , Yue Liu , Baolong Bi , Duzhen Zhang , Zhong-Zhi Li , Yingwei Ma , Yufei He , Shengju Yu , Xinfeng Li , Junfeng Fang , Jiaheng Zhang , Bryan Hooi

Machine learning (ML) has recently created many new success stories. Hence, there is a strong motivation to use ML technology in software-intensive systems, including safety-critical systems. This raises the issue of safety verification of…

Software Engineering · Computer Science 2020-07-01 Hermann Kaindl , Stefan Kramer

The exponential increase in dependencies between the cyber and physical world leads to an enormous amount of data which must be efficiently processed and stored. Therefore, computing paradigms are evolving towards machine learning…

Machine Learning · Computer Science 2019-04-09 Faiq Khalid , Muhammad Abdullah Hanif , Semeen Rehman , Muhammad Shafique

In the rapidly evolving landscape of artificial intelligence, multimodal learning systems (MMLS) have gained traction for their ability to process and integrate information from diverse modality inputs. Their expanding use in vital sectors…

Computers and Society · Computer Science 2024-07-17 Tianyi Zhao , Liangliang Zhang , Yao Ma , Lu Cheng

Machine Learning (ML) has been widely applied to cybersecurity and is considered state-of-the-art for solving many of the open issues in that field. However, it is very difficult to evaluate how good the produced solutions are, since the…

Cryptography and Security · Computer Science 2023-09-06 Fabrício Ceschin , Marcus Botacin , Albert Bifet , Bernhard Pfahringer , Luiz S. Oliveira , Heitor Murilo Gomes , André Grégio

The real-world use cases of Machine Learning (ML) have exploded over the past few years. However, the current computing infrastructure is insufficient to support all real-world applications and scenarios. Apart from high efficiency…

The rapid development of Multimodal Large Reasoning Models (MLRMs) has demonstrated broad application potential, yet their safety and reliability remain critical concerns that require systematic exploration. To address this gap, we conduct…

Computation and Language · Computer Science 2025-10-14 Xinyue Lou , You Li , Jinan Xu , Xiangyu Shi , Chi Chen , Kaiyu Huang
‹ Prev 1 2 3 10 Next ›