中文
相关论文

相关论文: Critical Checkpoints for Evaluating Defence Models…

200 篇论文

Machine learning models have been widely adopted in several fields. However, most recent studies have shown several vulnerabilities from attacks with a potential to jeopardize the integrity of the model, presenting a new window of research…

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

神经与进化计算 · 计算机科学 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

Adversarial examples are inputs to machine learning models that an attacker has intentionally designed to confuse the model into making a mistake. Such examples pose a serious threat to the applicability of machine-learning-based systems,…

机器学习 · 计算机科学 2023-10-18 Peiyu Xiong , Michael Tegegn , Jaskeerat Singh Sarin , Shubhraneel Pal , Julia Rubin

Privacy concerns have led to the development of privacy-preserving approaches for learning models from sensitive data. Yet, in practice, even models learned with privacy guarantees can inadvertently memorize unique training examples or leak…

机器学习 · 统计学 2019-11-11 Mario Diaz , Peter Kairouz , Jiachun Liao , Lalitha Sankar

Machine learning models have demonstrated remarkable success across diverse domains but remain vulnerable to adversarial attacks. Empirical defense mechanisms often fail, as new attacks constantly emerge, rendering existing defenses…

机器学习 · 计算机科学 2024-10-25 Anupriya Kumari , Devansh Bhardwaj , Sukrit Jindal

Machine learning (ML) models deployed in many safety- and business-critical systems are vulnerable to exploitation through adversarial examples. A large body of academic research has thoroughly explored the causes of these blind spots,…

密码学与安全 · 计算机科学 2020-07-15 Ivan Evtimov , Weidong Cui , Ece Kamar , Emre Kiciman , Tadayoshi Kohno , Jerry Li

Reliable deployment of machine learning models such as neural networks continues to be challenging due to several limitations. Some of the main shortcomings are the lack of interpretability and the lack of robustness against adversarial…

机器学习 · 计算机科学 2025-02-18 Jon Vadillo , Roberto Santana , Jose A. Lozano

It is becoming increasingly imperative to design robust ML defenses. However, recent work has found that many defenses that initially resist state-of-the-art attacks can be broken by an adaptive adversary. In this work we take steps to…

机器学习 · 计算机科学 2023-02-28 Keane Lucas , Matthew Jagielski , Florian Tramèr , Lujo Bauer , Nicholas Carlini

Adaptive defenses, which optimize at test time, promise to improve adversarial robustness. We categorize such adaptive test-time defenses, explain their potential benefits and drawbacks, and evaluate a representative variety of the latest…

机器学习 · 计算机科学 2022-07-14 Francesco Croce , Sven Gowal , Thomas Brunner , Evan Shelhamer , Matthias Hein , Taylan Cemgil

Deep learning has come a long way and has enjoyed an unprecedented success. Despite high accuracy, however, deep models are brittle and are easily fooled by imperceptible adversarial perturbations. In contrast to common inference-time…

计算机视觉与模式识别 · 计算机科学 2020-05-14 Ali Borji

Model providers increasingly release open weights or allow users to fine-tune foundation models through APIs. Although these models are safety-aligned before release, their safeguards can often be removed by fine-tuning on harmful data.…

密码学与安全 · 计算机科学 2026-05-26 Itay Zloczower , Eyal Lenga , Gilad Gressel , Yisroel Mirsky

Machine learning models were shown to be vulnerable to model stealing attacks, which lead to intellectual property infringement. Among other methods, substitute model training is an all-encompassing attack applicable to any machine learning…

机器学习 · 计算机科学 2025-03-11 Daryna Oliynyk , Rudolf Mayer , Andreas Rauber

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models. However,…

计算与语言 · 计算机科学 2021-10-07 Zongyi Li , Jianhan Xu , Jiehang Zeng , Linyang Li , Xiaoqing Zheng , Qi Zhang , Kai-Wei Chang , Cho-Jui Hsieh

Adversarial examples tremendously threaten the availability and integrity of machine learning-based systems. While the feasibility of such attacks has been observed first in the domain of image processing, recent research shows that speech…

声音 · 计算机科学 2020-10-15 Tom Dörr , Karla Markert , Nicolas M. Müller , Konstantin Böttinger

Adversarial examples pose a unique challenge for deep learning systems. Despite recent advances in both attacks and defenses, there is still a lack of clarity and consensus in the community about the true nature and underlying properties of…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Shishira R Maiya , Max Ehrlich , Vatsal Agarwal , Ser-Nam Lim , Tom Goldstein , Abhinav Shrivastava

Deep learning has successfully solved a wide range of tasks in 2D vision as a dominant AI technique. Recently, deep learning on 3D point clouds is becoming increasingly popular for addressing various tasks in this field. Despite remarkable…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Hanieh Naderi , Ivan V. Bajić

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

机器学习 · 计算机科学 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Defensive deception is a promising approach for cyber defense. Via defensive deception, the defender can anticipate attacker actions; it can mislead or lure attacker, or hide real resources. Although defensive deception is increasingly…

密码学与安全 · 计算机科学 2021-05-11 Mu Zhu , Ahmed H. Anwar , Zelin Wan , Jin-Hee Cho , Charles Kamhoua , Munindar P. Singh

Machine learning algorithms are effective in several applications, but they are not as much successful when applied to intrusion detection in cyber security. Due to the high sensitivity to their training data, cyber detectors based on…

密码学与安全 · 计算机科学 2021-06-15 Giovanni Apruzzese , Mauro Andreolini , Michele Colajanni , Mirco Marchetti

Short answer: Yes, Long answer: No! Indeed, research on adversarial robustness has led to invaluable insights helping us understand and explore different aspects of the problem. Many attacks and defenses have been proposed over the last…

计算机视觉与模式识别 · 计算机科学 2022-08-05 Ali Borji