English
Related papers

Related papers: Unsolved Problems in ML Safety

200 papers

Rapid progress in machine learning and artificial intelligence (AI) has brought increasing attention to the potential impacts of AI technologies on society. In this paper we discuss one such potential impact: the problem of accidents in…

Artificial Intelligence · Computer Science 2016-07-26 Dario Amodei , Chris Olah , Jacob Steinhardt , Paul Christiano , John Schulman , Dan Mané

Inappropriate design and deployment of machine learning (ML) systems leads to negative downstream social and ethical impact -- described here as social and ethical risks -- for users, society and the environment. Despite the growing need to…

Human-Computer Interaction · Computer Science 2022-10-10 Shalaleh Rismani , Renee Shelby , Andrew Smart , Edgar Jatho , Joshua Kroll , AJung Moon , Negar Rostamzadeh

The increasing use of Machine Learning (ML) components embedded in autonomous systems -- so-called Learning-Enabled Systems (LESs) -- has resulted in the pressing need to assure their functional safety. As for traditional functional safety,…

Software Engineering · Computer Science 2023-01-16 Yi Dong , Wei Huang , Vibhav Bharti , Victoria Cox , Alec Banks , Sen Wang , Xingyu Zhao , Sven Schewe , Xiaowei Huang

Speech-centric machine learning systems have revolutionized many leading domains ranging from transportation and healthcare to education and defense, profoundly changing how people live, work, and interact with each other. However, recent…

Recent advancements in artificial intelligence (AI), particularly in large language models (LLMs), have unlocked significant potential to enhance the quality and efficiency of medical care. By introducing a novel way to interact with AI and…

AI Safety is an emerging area of critical importance to the safe adoption and deployment of AI systems. With the rapid proliferation of AI and especially with the recent advancement of Generative AI (or GAI), the technology ecosystem behind…

Artificial Intelligence · Computer Science 2026-05-14 Chen Chen , Xueluan Gong , Ziyao Liu , Weifeng Jiang , Si Qi Goh , Kwok-Yan Lam

Machine learning (ML) has become a pervasive tool across computing systems. An emerging application that stress-tests the challenges of ML system design is tiny robot learning, the deployment of ML on resource-constrained low-cost…

Machine learning (ML) started to become widely deployed in cyber security settings for shortening the detection cycle of cyber attacks. To date, most ML-based systems are either proprietary or make specific choices of feature…

Cryptography and Security · Computer Science 2019-07-11 Talha Ongun , Timothy Sakharaov , Simona Boboila , Alina Oprea , Tina Eliassi-Rad

Recently software development companies started to embrace Machine Learning (ML) techniques for introducing a series of advanced functionality in their products such as personalisation of the user experience, improved search, content…

Human-Computer Interaction · Computer Science 2017-08-09 Ilias Flaounas

Connected and autonomous vehicles (CAVs) will form the backbone of future next-generation intelligent transportation systems (ITS) providing travel comfort, road safety, along with a number of value-added services. Such a…

Machine Learning · Computer Science 2020-02-24 Adnan Qayyum , Muhammad Usama , Junaid Qadir , Ala Al-Fuqaha

Machine Learning is gaining popularity in the network security domain as many more network-enabled devices get connected, as malicious activities become stealthier, and as new technologies like Software Defined Networking (SDN) emerge.…

Cryptography and Security · Computer Science 2019-01-10 Tam N. Nguyen

In recent years, the number of machine learning (ML) technologies gaining regulatory approval for healthcare has increased significantly allowing them to be placed on the market. However, the regulatory frameworks applied to them were…

Machine Learning · Computer Science 2022-09-02 Shakir Laher , Carla Brackstone , Sara Reis , An Nguyen , Sean White , Ibrahim Habli

Collectively, machine learning (ML) researchers are engaged in the creation and dissemination of knowledge about data-driven algorithms. In a given paper, researchers might aspire to any subset of the following goals, among others: to…

Machine Learning · Statistics 2018-07-27 Zachary C. Lipton , Jacob Steinhardt

Advanced classification algorithms are being increasingly used in safety-critical applications like health-care, engineering, etc. In such applications, miss-classifications made by ML algorithms can result in substantial financial or…

Machine Learning · Computer Science 2024-12-06 Disha Ghandwani , Neeraj Sarna , Yuanyuan Li , Yang Lin

Large language models (LLMs) have achieved record adoption in a short period of time across many different sectors including high importance areas such as education [4] and healthcare [23]. LLMs are open-ended models trained on diverse data…

Cryptography and Security · Computer Science 2024-12-24 Herve Debar , Sven Dietrich , Pavel Laskov , Emil C. Lupu , Eirini Ntoutsi

The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this paper, we observe that Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Jindong Gu , Yunshi Lan , Chao Yang , Yu Qiao

The robustness of modern machine learning (ML) models has become an increasing concern within the community. The ability to subvert a model into making errant predictions using seemingly inconsequential changes to input is startling, as is…

Machine Learning · Computer Science 2023-06-19 Edward Raff , Michel Benaroch , Andrew L. Farris

In the last few years, quantum computing has experienced a growth spurt. One exciting avenue of quantum computing is quantum machine learning (QML) which can exploit the high dimensional Hilbert space to learn richer representations from…

Cryptography and Security · Computer Science 2022-04-08 Satwik Kundu , Swaroop Ghosh

Reinforcement Learning (RL) has achieved tremendous success in many complex decision-making tasks. However, safety concerns are raised during deploying RL in real-world applications, leading to a growing demand for safe RL algorithms, such…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Long Yang , Yali Du , Guang Chen , Florian Walter , Jun Wang , Alois Knoll

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar