English
Related papers

Related papers: MLGuard: Defend Your Machine Learning Model!

200 papers

Artificial intelligence (AI) and machine learning (ML) are increasingly broadly adopted in industry, However, based on well over a dozen case studies, we have learned that deploying industry-strength, production quality ML models in systems…

Machine Learning · Computer Science 2020-06-04 Jan Bosch , Ivica Crnkovic , Helena Holmström Olsson

The irreversible nature of blockchain transactions makes the identification of smart contract vulnerabilities an essential requirement for secure system development. While Large Language Models (LLMs) are increasingly integrated into…

Cryptography and Security · Computer Science 2026-05-13 Stefan-Claudiu Susan , Andrei Arusoaie , Dorel Lucanu

Large language models (LLMs) are useful tools with the capacity for performing specific types of knowledge work at an effective scale. However, LLM deployments in high-risk and safety-critical domains pose unique challenges, notably the…

Computation and Language · Computer Science 2024-09-05 Joe B Hakim , Jeffery L Painter , Darmendra Ramcharran , Vijay Kara , Greg Powell , Paulina Sobczak , Chiho Sato , Andrew Bate , Andrew Beam

The increasing popularity of machine learning approaches and the rising awareness of data protection and data privacy presents an opportunity to build truly secure and trustworthy healthcare systems. Regulations such as GDPR and HIPAA…

Cryptography and Security · Computer Science 2020-11-17 Goutham Ramakrishnan , Aditya Nori , Hannah Murfet , Pashmina Cameron

Approaches to keeping a dynamical system within state constraints typically rely on a model-based safety condition to limit the control signals. In the face of significant modeling uncertainty, the system can suffer from important…

Systems and Control · Electrical Eng. & Systems 2022-02-08 Marc-Antoine Beaudoin , Benoit Boulet

Multiple studies have now demonstrated that machine learning (ML) can give improved skill for predicting or simulating fairly typical weather events, for tasks such as short-term and seasonal weather forecasting, downscaling simulations to…

Atmospheric and Oceanic Physics · Physics 2023-08-30 Peter AG Watson

Large Language Model (LLM) agents increasingly operate across domains such as robotics, virtual assistants, and web automation. However, their stochastic decision-making introduces safety risks that are difficult to anticipate during…

Artificial Intelligence · Computer Science 2026-03-30 Haoyu Wang , Christopher M. Poskitt , Jiali Wei , Jun Sun

Development of machine learning (ML) applications is hard. Producing successful applications requires, among others, being deeply familiar with a variety of complex and quickly evolving application programming interfaces (APIs). It is…

Software Engineering · Computer Science 2022-03-30 Lars Reimann , Günter Kniesel-Wünsche

The widespread adoption of ML systems across critical domains like hiring, finance, and healthcare raises growing concerns about their potential for discriminatory decision-making based on protected attributes. While efforts to ensure…

Artificial Intelligence · Computer Science 2024-06-27 Hussaini Mamman , Shuib Basri , Abdullateef Balogun , Abubakar Abdullahi Imam , Ganesh Kumar , Luiz Fernando Capretz

This article presents the current state of ML-security and of the documentation of ML-based systems, models and datasets in research and practice based on an extensive review of the existing literature. It shows a generally low awareness of…

Cryptography and Security · Computer Science 2025-07-17 Cara Ellen Appel

Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it…

Nowadays, intelligent systems and services are getting increasingly popular as they provide data-driven solutions to diverse real-world problems, thanks to recent breakthroughs in Artificial Intelligence (AI) and Machine Learning (ML).…

Software Engineering · Computer Science 2022-01-03 Md Saidur Rahman , Foutse Khomh , Alaleh Hamidi , Jinghui Cheng , Giuliano Antoniol , Hironori Washizaki

Translating machine learning (ML) models effectively to clinical practice requires establishing clinicians' trust. Explainability, or the ability of an ML model to justify its outcomes and assist clinicians in rationalizing the model…

Machine Learning · Computer Science 2019-08-08 Sana Tonekaboni , Shalmali Joshi , Melissa D McCradden , Anna Goldenberg

Forming a reliable judgement of a machine learning (ML) model's appropriateness for an application ecosystem is critical for its responsible use, and requires considering a broad range of factors including harms, benefits, and…

Machine Learning · Computer Science 2022-05-12 Ben Hutchinson , Negar Rostamzadeh , Christina Greer , Katherine Heller , Vinodkumar Prabhakaran

Countless domains rely on Machine Learning (ML) models, including safety-critical domains, such as autonomous driving, which this paper focuses on. While the black box nature of ML is simply a nuisance in some domains, in safety-critical…

Artificial Intelligence · Computer Science 2024-06-24 Lynn Vonderhaar , Timothy Elvira , Tyler Procko , Omar Ochoa

Money laundering is a financial crime that obscures the origin of illicit funds, necessitating the development and enforcement of anti-money laundering (AML) policies by governments and organizations. The proliferation of mobile payment…

Machine Learning · Computer Science 2025-03-14 Jiani Fan , Lwin Khin Shar , Ruichen Zhang , Ziyao Liu , Wenzhuo Yang , Dusit Niyato , Bomin Mao , Kwok-Yan Lam

Nowadays, systems containing components based on machine learning (ML) methods are becoming more widespread. In order to ensure the intended behavior of a software system, there are standards that define necessary quality aspects of the…

Software Engineering · Computer Science 2020-08-26 Julien Siebert , Lisa Joeckel , Jens Heidrich , Koji Nakamichi , Kyoko Ohashi , Isao Namba , Rieko Yamamoto , Mikio Aoyama

As machine learning (ML) systems increasingly impact critical sectors such as hiring, financial risk assessments, and criminal justice, the imperative to ensure fairness has intensified due to potential negative implications. While much ML…

Machine Learning · Computer Science 2025-01-09 Nurit Cohen-Inger , Seffi Cohen , Neomi Rabaev , Lior Rokach , Bracha Shapira

A central question in machine learning is how reliable the predictions of a trained model are. Reliability includes the identification of instances for which a model is likely not to be trusted based on an analysis of the learning system…

Quantum Physics · Physics 2026-01-21 Marie Kempkes , Jakob Spiegelberg , Evert van Nieuwenburg , Vedran Dunjko

Large Language Model (LLM) safeguards, which implement request refusals, have become a widely adopted mitigation strategy against misuse. At the intersection of adversarial machine learning and AI safety, safeguard red teaming has…

Cryptography and Security · Computer Science 2025-06-10 Zifan Wang , Christina Q. Knight , Jeremy Kritz , Willow E. Primack , Julian Michael