English
Related papers

Related papers: Ethical Testing in the Real World: Evaluating Phys…

200 papers

Recently demonstrated physical-world adversarial attacks have exposed vulnerabilities in perception systems that pose severe risks for safety-critical applications such as autonomous driving. These attacks place adversarial artifacts in the…

Machine Learning · Computer Science 2021-06-23 Jan Hendrik Metzen , Nicole Finnie , Robin Hutmacher

Deep Reinforcement Learning (RL) agents are susceptible to adversarial noise in their observations that can mislead their policies and decrease their performance. However, an adversary may be interested not only in decreasing the reward,…

Machine Learning · Computer Science 2022-12-13 Dennis Gross , Thiago D. Simao , Nils Jansen , Guillermo A. Perez

Testing practices within the machine learning (ML) community have centered around assessing a learned model's predictive performance measured against a test dataset, often drawn from the same distribution as the training dataset. While…

Machine Learning · Computer Science 2021-12-07 Negar Rostamzadeh , Ben Hutchinson , Christina Greer , Vinodkumar Prabhakaran

Machine Learning (ML) models are applied in a variety of tasks such as network intrusion detection or Malware classification. Yet, these models are vulnerable to a class of malicious inputs known as adversarial examples. These are slightly…

Cryptography and Security · Computer Science 2017-10-18 Kathrin Grosse , Praveen Manoharan , Nicolas Papernot , Michael Backes , Patrick McDaniel

Physiological computing uses human physiological data as system inputs in real time. It includes, or significantly overlaps with, brain-computer interfaces, affective computing, adaptive automation, health informatics, and physiological…

Machine Learning · Computer Science 2024-04-04 Dongrui Wu , Jiaxin Xu , Weili Fang , Yi Zhang , Liuqing Yang , Xiaodong Xu , Hanbin Luo , Xiang Yu

Machine learning (ML) models are known to be vulnerable to adversarial examples. Applications of ML to voice biometrics authentication are no exception. Yet, the implications of audio adversarial examples on these real-world systems remain…

Transparency around limitations can improve the scientific rigor of research, help ensure appropriate interpretation of research findings, and make research claims more credible. Despite these benefits, the machine learning (ML) research…

Machine Learning · Computer Science 2022-05-18 Jessie J. Smith , Saleema Amershi , Solon Barocas , Hanna Wallach , Jennifer Wortman Vaughan

Adversarial attacks pose a significant threat to the robustness and reliability of machine learning systems, particularly in computer vision applications. This study investigates the performance of adversarial patches for the YOLO object…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jakob Shack , Katarina Petrovic , Olga Saukh

The vulnerability of machine learning models in adversarial scenarios has garnered significant interest in the academic community over the past decade, resulting in a myriad of attacks and defenses. However, while the community appears to…

Machine Learning · Computer Science 2024-10-17 Kevin Eykholt , Farhan Ahmed , Pratik Vaishnavi , Amir Rahmati

In this article I describe a research agenda for securing machine learning models against adversarial inputs at test time. This article does not present results but instead shares some of my thoughts about where I think that the field needs…

Machine Learning · Computer Science 2019-03-18 Ian Goodfellow

Computational social science research, particularly online studies, often involves exposing participants to the adverse phenomenon the researchers aim to study. Examples include presenting conspiracy theories in surveys, exposing systems to…

Computers and Society · Computer Science 2026-03-03 Protiva Sen , Laurent Hébert-Dufresne , Pablo Bose , Juniper Lovato

Most existing evaluations of explainable machine learning (ML) methods rely on simplifying assumptions or proxies that do not reflect real-world use cases; the handful of more robust evaluations on real-world settings have shortcomings in…

Vision-Language Models (VLMs) have shown remarkable performance, yet their security remains insufficiently understood. Existing adversarial studies focus almost exclusively on the digital setting, leaving physical-world threats largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yingying Zhao , Chengyin Hu , Qike Zhang , Xin Li , Xin Wang , Yiwei Wei , Jiujiang Guo , Jiahuan Long , Tingsong Jiang , Wen Yao

Adversarial robustness studies the worst-case performance of a machine learning model to ensure safety and reliability. With the proliferation of deep-learning-based technology, the potential risks associated with model development and…

Machine Learning · Computer Science 2023-01-06 Pin-Yu Chen , Sijia Liu

Despite the large body of academic work on machine learning security, little is known about the occurrence of attacks on machine learning systems in the wild. In this paper, we report on a quantitative study with 139 industrial…

Machine Learning · Computer Science 2023-03-13 Kathrin Grosse , Lukas Bieringer , Tarek Richard Besold , Battista Biggio , Katharina Krombholz

Deep learning models have been used for a wide variety of tasks. They are prevalent in computer vision, natural language processing, speech recognition, and other areas. While these models have worked well under many scenarios, it has been…

Machine Learning · Computer Science 2022-02-15 Daniel Steinberg , Paul Munro

The modern open internet contains billions of public images of human faces across the web, especially on social media websites used by half the world's population. In this context, Face Recognition (FR) systems have the potential to match…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Benjamin Spetter-Goldstein , Nataniel Ruiz , Sarah Adel Bargal

Simulating hostile attacks of physical autonomous systems can be a useful tool to examine their robustness to attack and inform vulnerability-aware design. In this work, we examine this through the lens of multi-robot patrol, by presenting…

Robotics · Computer Science 2025-09-16 James C. Ward , Alex Bott , Connor York , Edmund R. Hunt

Recent studies have demonstrated that reinforcement learning (RL) agents are susceptible to adversarial manipulation, similar to vulnerabilities previously demonstrated in the supervised learning setting. While most existing work studies…

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

Artificial Intelligence · Computer Science 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel