English
Related papers

Related papers: Adversarial Robustness via Label-Smoothing

200 papers

Extensive Unsupervised Domain Adaptation (UDA) studies have shown great success in practice by learning transferable representations across a labeled source domain and an unlabeled target domain with deep models. However, previous works…

Machine Learning · Computer Science 2021-09-03 Muhammad Awais , Fengwei Zhou , Hang Xu , Lanqing Hong , Ping Luo , Sung-Ho Bae , Zhenguo Li

With the widespread use of machine learning, concerns over its security and reliability have become prevalent. As such, many have developed defenses to harden neural networks against adversarial examples, imperceptibly perturbed inputs that…

Machine Learning · Computer Science 2022-05-09 Pratik Vaishnavi , Kevin Eykholt , Amir Rahmati

Deep neural networks (DNNs) are found to be vulnerable to adversarial noise. They are typically misled by adversarial samples to make wrong predictions. To alleviate this negative effect, in this paper, we investigate the dependence between…

Machine Learning · Computer Science 2022-07-26 Dawei Zhou , Nannan Wang , Xinbo Gao , Bo Han , Xiaoyu Wang , Yibing Zhan , Tongliang Liu

Adversarial attacks insert small, imperceptible perturbations to input samples that cause large, undesired changes to the output of deep learning models. Despite extensive research on generating adversarial attacks and building defense…

Machine Learning · Computer Science 2023-06-27 Vyas Raina , Mark Gales

Deep neural networks are vulnerable to adversarial examples, which becomes one of the most important research problems in the development of deep learning. While a lot of efforts have been made in recent years, it is of great significance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yinpeng Dong , Qi-An Fu , Xiao Yang , Tianyu Pang , Hang Su , Zihao Xiao , Jun Zhu

Deep neural networks (DNNs) are incredibly brittle due to adversarial examples. To robustify DNNs, adversarial training was proposed, which requires large-scale but well-labeled data. However, it is quite expensive to annotate large-scale…

Machine Learning · Computer Science 2019-11-21 Jingfeng Zhang , Bo Han , Gang Niu , Tongliang Liu , Masashi Sugiyama

Deep learning is a standard tool in the field of high-energy physics, facilitating considerable sensitivity enhancements for numerous analysis strategies. In particular, in identification of physics objects, such as jet flavor tagging,…

Data Analysis, Statistics and Probability · Physics 2022-09-20 Annika Stein , Xavier Coubez , Spandan Mondal , Andrzej Novak , Alexander Schmidt

This paper investigates a family of methods for defending against adversarial attacks that owe part of their success to creating a noisy, discontinuous, or otherwise rugged loss landscape that adversaries find difficult to navigate. A…

Machine Learning · Computer Science 2022-08-08 Panagiotis Eustratiadis , Henry Gouk , Da Li , Timothy Hospedales

Label smoothing is commonly used in training deep learning models, wherein one-hot training labels are mixed with uniform label vectors. Empirically, smoothing has been shown to improve both predictive performance and model calibration. In…

Machine Learning · Computer Science 2020-03-06 Michal Lukasik , Srinadh Bhojanapalli , Aditya Krishna Menon , Sanjiv Kumar

Deep neural networks are proven to be vulnerable to fine-designed adversarial examples, and adversarial defense algorithms draw more and more attention nowadays. Pre-processing based defense is a major strategy, as well as learning robust…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Decheng Liu , Tao Chen , Chunlei Peng , Nannan Wang , Ruimin Hu , Xinbo Gao

Paucity of large curated hand-labeled training data for every domain-of-interest forms a major bottleneck in the deployment of machine learning models in computer vision and other fields. Recent work (Data Programming) has shown how distant…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Arghya Pal , Vineeth N Balasubramanian

Recently, a multitude of methods for image-to-image translation have demonstrated impressive results on problems such as multi-domain or multi-attribute transfer. The vast majority of such works leverages the strengths of adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 James Oldfield , Yannis Panagakis , Mihalis A. Nicolaou

Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is…

Machine Learning · Computer Science 2021-02-16 Thomas Kobber Panum , Zi Wang , Pengyu Kan , Earlence Fernandes , Somesh Jha

Randomized smoothing is a defensive technique to achieve enhanced robustness against adversarial examples which are small input perturbations that degrade the performance of neural network models. Conventional randomized smoothing adds…

Machine Learning · Computer Science 2024-07-17 Ryo Hase , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons

Increasing the model capacity is a known approach to enhance the adversarial robustness of deep learning networks. On the other hand, various model compression techniques, including pruning and quantization, can reduce the size of the…

Machine Learning · Computer Science 2023-11-28 Svetlana Pavlitska , Hannes Grolig , J. Marius Zöllner

Machine learning models are vulnerable to adversarial attacks. One approach to addressing this vulnerability is certification, which focuses on models that are guaranteed to be robust for a given perturbation size. A drawback of recent…

Machine Learning · Computer Science 2020-10-07 Ryan Campbell , Chris Finlay , Adam M Oberman

This paper investigates the theory of robustness against adversarial attacks. We focus on randomized classifiers (\emph{i.e.} classifiers that output random variables) and provide a thorough analysis of their behavior through the lens of…

Machine Learning · Computer Science 2021-02-23 Rafael Pinot , Laurent Meunier , Florian Yger , Cédric Gouy-Pailler , Yann Chevaleyre , Jamal Atif

Recent studies show that models trained by continual learning can achieve the comparable performances as the standard supervised learning and the learning flexibility of continual learning models enables their wide applications in the real…

Machine Learning · Computer Science 2023-04-03 Tao Bai , Chen Chen , Lingjuan Lyu , Jun Zhao , Bihan Wen

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

Machine Learning · Computer Science 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Deep neural network-based image compression has been extensively studied. However, the model robustness which is crucial to practical application is largely overlooked. We propose to examine the robustness of prevailing learned image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Tong Chen , Zhan Ma