English
Related papers

Related papers: On the Trade-Off Between Transparency and Security…

200 papers

Calls for transparency in AI systems are growing in number and urgency from diverse stakeholders ranging from regulators to researchers to users (with a comparative absence of companies developing AI). Notions of transparency for AI abound,…

Cryptography and Security · Computer Science 2025-02-03 Peter Hall , Olivia Mundahl , Sunoo Park

Recent research has found that many families of machine learning models are vulnerable to adversarial examples: inputs that are specifically designed to cause the target model to produce erroneous outputs. In this survey, we focus on…

Machine Learning · Computer Science 2019-11-19 Rey Reza Wiyatno , Anqi Xu , Ousmane Dia , Archy de Berker

In the last decade, the use of Machine Learning techniques in anomaly-based intrusion detection systems has seen much success. However, recent studies have shown that Machine learning in general and deep learning specifically are vulnerable…

Cryptography and Security · Computer Science 2023-03-14 Islam Debicha , Thibault Debatty , Jean-Michel Dricot , Wim Mees , Tayeb Kenaza

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, namely, AEs generated for a source model fool other (target) models. In this paper, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Miki Tanaka , Isao Echizen , Hitoshi Kiya

The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jindong Gu , Xiaojun Jia , Pau de Jorge , Wenqain Yu , Xinwei Liu , Avery Ma , Yuan Xun , Anjun Hu , Ashkan Khakzar , Zhijiang Li , Xiaochun Cao , Philip Torr

The ability to transfer adversarial attacks from one model (the surrogate) to another model (the victim) has been an issue of concern within the machine learning (ML) community. The ability to successfully evade unseen models represents an…

Machine Learning · Computer Science 2021-09-28 Luke E. Richards , André Nguyen , Ryan Capps , Steven Forsythe , Cynthia Matuszek , Edward Raff

Defensive deception is a promising approach for cyber defense. Via defensive deception, the defender can anticipate attacker actions; it can mislead or lure attacker, or hide real resources. Although defensive deception is increasingly…

Cryptography and Security · Computer Science 2021-05-11 Mu Zhu , Ahmed H. Anwar , Zelin Wan , Jin-Hee Cho , Charles Kamhoua , Munindar P. Singh

We formalize and analyze the trade-off between backdoor-based watermarks and adversarial defenses, framing it as an interactive protocol between a verifier and a prover. While previous works have primarily focused on this trade-off, our…

Machine Learning · Computer Science 2026-01-22 Grzegorz Głuch , Berkant Turan , Sai Ganesh Nagarajan , Sebastian Pokutta

Given that there are a variety of stakeholders involved in, and affected by, decisions from machine learning (ML) models, it is important to consider that different stakeholders have different transparency needs. Previous work found that…

Human-Computer Interaction · Computer Science 2021-06-02 Ana Lucic , Madhulika Srikumar , Umang Bhatt , Alice Xiang , Ankur Taly , Q. Vera Liao , Maarten de Rijke

Adversarial Machine Learning (AML) is emerging as a major field aimed at protecting machine learning (ML) systems against security threats: in certain scenarios there may be adversaries that actively manipulate input data to fool learning…

Artificial Intelligence · Computer Science 2024-02-23 David Rios Insua , Roi Naveiro , Victor Gallego , Jason Poulos

Adversarial attacks pose a severe risk to AI systems used in healthcare, capable of misleading models into dangerous misclassifications that can delay treatments or cause misdiagnoses. These attacks, often imperceptible to human perception,…

Machine Learning · Computer Science 2025-10-29 Alyssa Gerhart , Balaji Iyangar

As Artificial Intelligence (AI) continues to evolve, it has transitioned from a research-focused discipline to a widely adopted technology, enabling intelligent solutions across various sectors. In security, AI's role in strengthening…

Cryptography and Security · Computer Science 2025-09-30 Saskia Laura Schröer , Luca Pajola , Alberto Castagnaro , Giovanni Apruzzese , Mauro Conti

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model,…

Cryptography and Security · Computer Science 2016-05-25 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow

Artificial Intelligence (AI) is rapidly integrating into various aspects of our daily lives, influencing decision-making processes in areas such as targeted advertising and matchmaking algorithms. As AI systems become increasingly…

Artificial Intelligence · Computer Science 2025-03-11 Md. Tanzib Hosain , Mehedi Hasan Anik , Sadman Rafi , Rana Tabassum , Khaleque Insia , Md. Mehrab Siddiky

The increased adoption of Artificial Intelligence (AI) presents an opportunity to solve many socio-economic and environmental challenges; however, this cannot happen without securing AI-enabled technologies. In recent years, most AI models…

Cryptography and Security · Computer Science 2021-02-10 Ayodeji Oseni , Nour Moustafa , Helge Janicke , Peng Liu , Zahir Tari , Athanasios Vasilakos

Designing cyber defense systems to account for cognitive biases in human decision making has demonstrated significant success in improving performance against human attackers. However, much of the attention in this area has focused on…

Artificial Intelligence · Computer Science 2025-05-16 Tailia Malloy , Cleotilde Gonzalez

Reliable deployment of machine learning models such as neural networks continues to be challenging due to several limitations. Some of the main shortcomings are the lack of interpretability and the lack of robustness against adversarial…

Machine Learning · Computer Science 2025-02-18 Jon Vadillo , Roberto Santana , Jose A. Lozano

Historically, machine learning methods have not been designed with security in mind. In turn, this has given rise to adversarial examples, carefully perturbed input samples aimed to mislead detection at test time, which have been applied to…

Machine Learning · Computer Science 2022-01-11 Jamie Hayes

Today, the security of many domains rely on the use of Machine Learning to detect threats, identify vulnerabilities, and safeguard systems from attacks. Recently, transformer architectures have improved the state-of-the-art performance on a…

Cryptography and Security · Computer Science 2023-10-19 Kunyang Li , Kyle Domico , Jean-Charles Noirot Ferrand , Patrick McDaniel

Choosing a hard-to-guess secret is a prerequisite in many security applications. Whether it is a password for user authentication or a secret key for a cryptographic primitive, picking it requires the user to trade-off usability costs with…

Computer Science and Game Theory · Computer Science 2015-05-12 MHR Khouzani , Piotr Mardziel , Carlos Cid , Mudhakar Srivatsa