中文
相关论文

相关论文: Effects of Loss Functions And Target Representatio…

200 篇论文

Deep models, while being extremely versatile and accurate, are vulnerable to adversarial attacks: slight perturbations that are imperceptible to humans can completely flip the prediction of deep models. Many attack and defense mechanisms…

机器学习 · 计算机科学 2019-07-30 Kaiwen Wu , Yaoliang Yu

Non-adversarial robustness, also known as natural robustness, is a property of deep learning models that enables them to maintain performance even when faced with distribution shifts caused by natural variations in data. However, achieving…

机器学习 · 计算机科学 2023-05-25 Gorana Gojić , Vladimir Vincan , Ognjen Kundačina , Dragiša Mišković , Dinu Dragan

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

All machine learning algorithms use a loss, cost, utility or reward function to encode the learning objective and oversee the learning process. This function that supervises learning is a frequently unrecognized hyperparameter that…

神经与进化计算 · 计算机科学 2024-11-06 Mathew Mithra Noel , Arindam Banerjee , Yug Oswal , Geraldine Bessie Amali D , Venkataraman Muthiah-Nakarajan

Neural networks trained on visual data are well-known to be vulnerable to often imperceptible adversarial perturbations. The reasons for this vulnerability are still being debated in the literature. Recently Ilyas et al. (2019) showed that…

机器学习 · 计算机科学 2021-02-11 Jacob M. Springer , Melanie Mitchell , Garrett T. Kenyon

Like many other tasks involving neural networks, Speech Recognition models are vulnerable to adversarial attacks. However recent research has pointed out differences between attacks and defenses on ASR models compared to image models.…

密码学与安全 · 计算机科学 2022-04-06 Raphael Olivier , Bhiksha Raj

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

神经与进化计算 · 计算机科学 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

While the literature on security attacks and defense of Machine Learning (ML) systems mostly focuses on unrealistic adversarial examples, recent research has raised concern about the under-explored field of realistic adversarial attacks and…

机器学习 · 计算机科学 2023-05-23 Salijona Dyrmishi , Salah Ghamizi , Thibault Simonetto , Yves Le Traon , Maxime Cordy

Increasing the model capacity is a known approach to enhance the adversarial robustness of deep learning networks. On the other hand, various model compression techniques, including pruning and quantization, can reduce the size of the…

机器学习 · 计算机科学 2023-11-28 Svetlana Pavlitska , Hannes Grolig , J. Marius Zöllner

Previous work has proposed many new loss functions and regularizers that improve test accuracy on image classification tasks. However, it is not clear whether these loss functions learn better representations for downstream tasks. This…

计算机视觉与模式识别 · 计算机科学 2021-11-05 Simon Kornblith , Ting Chen , Honglak Lee , Mohammad Norouzi

As the adoption of machine learning models increases, ensuring robust models against adversarial attacks is increasingly important. With unsupervised machine learning gaining more attention, ensuring it is robust against attacks is vital.…

机器学习 · 计算机科学 2023-06-02 Mathias Lundteigen Mohus , Jinyue Li

Adversarial robustness has become an emerging challenge for neural network owing to its over-sensitivity to small input perturbations. While being critical, we argue that solving this singular issue alone fails to provide a comprehensive…

机器学习 · 计算机科学 2021-03-02 Yu-Lin Tsai , Chia-Yi Hsu , Chia-Mu Yu , Pin-Yu Chen

State-of-the-art classifiers have been shown to be largely vulnerable to adversarial perturbations. One of the most effective strategies to improve robustness is adversarial training. In this paper, we investigate the effect of adversarial…

机器学习 · 计算机科学 2018-11-27 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Jonathan Uesato , Pascal Frossard

Machine learning classifiers are known to be vulnerable to inputs maliciously constructed by adversaries to force misclassification. Such adversarial examples have been extensively studied in the context of computer vision applications. In…

机器学习 · 计算机科学 2017-02-09 Sandy Huang , Nicolas Papernot , Ian Goodfellow , Yan Duan , Pieter Abbeel

Adversarial robustness measures the susceptibility of a classifier to imperceptible perturbations made to the inputs at test time. In this work we highlight the benefits of natural low rank representations that often exist for real data…

机器学习 · 计算机科学 2020-08-04 Pranjal Awasthi , Himanshu Jain , Ankit Singh Rawat , Aravindan Vijayaraghavan

In this paper, we present a novel nonlinear programming-based approach to fine-tune pre-trained neural networks to improve robustness against adversarial attacks while maintaining high accuracy on clean data. Our method introduces…

机器学习 · 计算机科学 2024-10-28 Shudian Zhao , Jan Kronqvist

As large-scale training regimes have gained popularity, the use of pretrained models for downstream tasks has become common practice in machine learning. While pretraining has been shown to enhance the performance of models in practice, the…

机器学习 · 计算机科学 2023-10-10 Laura Fee Nern , Harsh Raj , Maurice Georgi , Yash Sharma

We introduce a Noise-based prior Learning (NoL) approach for training neural networks that are intrinsically robust to adversarial attacks. We find that the implicit generative modeling of random noise with the same loss function used…

机器学习 · 计算机科学 2019-06-04 Priyadarshini Panda , Kaushik Roy

This work studies the threats of adversarial attack on multivariate probabilistic forecasting models and viable defense mechanisms. Our studies discover a new attack pattern that negatively impact the forecasting of a target time series via…

机器学习 · 计算机科学 2023-04-17 Linbo Liu , Youngsuk Park , Trong Nghia Hoang , Hilaf Hasson , Jun Huan

Adversarial training is by far the most successful strategy for improving robustness of neural networks to adversarial attacks. Despite its success as a defense mechanism, adversarial training fails to generalize well to unperturbed test…

机器学习 · 计算机科学 2019-10-18 Yogesh Balaji , Tom Goldstein , Judy Hoffman