中文
相关论文

相关论文: MixedNUTS: Training-Free Accuracy-Robustness Balan…

200 篇论文

As deep learning applications, especially programs of computer vision, are increasingly deployed in our lives, we have to think more urgently about the security of these applications.One effective way to improve the security of deep…

计算机视觉与模式识别 · 计算机科学 2022-06-02 Xiao Tan , Jingbo Gao , Ruolin Li

Large deep neural networks are powerful, but exhibit undesirable behaviors such as memorization and sensitivity to adversarial examples. In this work, we propose mixup, a simple learning principle to alleviate these issues. In essence,…

机器学习 · 计算机科学 2018-05-01 Hongyi Zhang , Moustapha Cisse , Yann N. Dauphin , David Lopez-Paz

Robust classification methods predominantly concentrate on algorithms that address a specific threat model, resulting in ineffective defenses against other threat models. Real-world applications are exposed to this vulnerability, as…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Tsachi Blau , Roy Ganz , Chaim Baskin , Michael Elad , Alex M. Bronstein

Mixed-signal hardware accelerators for deep learning achieve orders of magnitude better power efficiency than their digital counterparts. In the ultra-low power consumption regime, limited signal precision inherent to analog computation…

新兴技术 · 计算机科学 2019-04-04 Michael Klachko , Mohammad Reza Mahmoodi , Dmitri B. Strukov

Training multiple deep neural networks (DNNs) and averaging their outputs is a simple way to improve the predictive performance. Nevertheless, the multiplied training cost prevents this ensemble method to be practical and efficient. Several…

机器学习 · 计算机科学 2021-10-27 Feng Wang , Guoyizhe Wei , Qiao Liu , Jinxiang Ou , Xian Wei , Hairong Lv

Deep convolutional neural networks accurately classify a diverse range of natural images, but may be easily deceived when designed, imperceptible perturbations are embedded in the images. In this paper, we design a multi-pronged training,…

计算机视觉与模式识别 · 计算机科学 2022-08-26 Nathaniel Dean , Dilip Sarkar

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

机器学习 · 计算机科学 2021-12-03 Fartash Faghri

Historically, machine learning methods have not been designed with security in mind. In turn, this has given rise to adversarial examples, carefully perturbed input samples aimed to mislead detection at test time, which have been applied to…

机器学习 · 计算机科学 2022-01-11 Jamie Hayes

A major drawback of adversarially robust models, in particular for large scale datasets like ImageNet, is the extremely long training time compared to standard ones. Moreover, models should be robust not only to one $l_p$-threat model but…

机器学习 · 计算机科学 2022-08-09 Francesco Croce , Matthias Hein

Neural architecture search (NAS) has become a key component of AutoML and a standard tool to automate the design of deep neural networks. Recently, training-free NAS as an emerging paradigm has successfully reduced the search costs of…

机器学习 · 计算机科学 2024-03-13 Zhenfeng He , Yao Shu , Zhongxiang Dai , Bryan Kian Hsiang Low

Quantized neural networks (QNNs) are among the main approaches for deploying deep neural networks on low resource edge devices. Training QNNs using different levels of precision throughout the network (dynamic quantization) typically…

机器学习 · 计算机科学 2021-02-19 Benjamin J. Bodner , Gil Ben Shalom , Eran Treister

Adversarial training has proven to be effective in hardening networks against adversarial examples. However, the gained robustness is limited by network capacity and number of training samples. Consequently, to build more robust models, it…

机器学习 · 计算机科学 2020-06-02 Zheng Xu , Ali Shafahi , Tom Goldstein

Adversarial Training (AT) is one of the most effective methods to train robust Deep Neural Networks (DNNs). However, AT creates an inherent trade-off between clean accuracy and adversarial robustness, which is commonly attributed to the…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yanyun Wang , Li Liu

Deep neural networks are susceptible to adversarial examples, posing a significant security risk in critical applications. Adversarial Training (AT) is a well-established technique to enhance adversarial robustness, but it often comes at…

机器学习 · 计算机科学 2023-08-08 Kaijie Zhu , Jindong Wang , Xixu Hu , Xing Xie , Ge Yang

Domain reweighting can improve sample efficiency and downstream generalization, but data-mixture optimization for multimodal midtraining remains largely unexplored. Current multimodal training recipes tune mixtures along a single dimension,…

机器学习 · 计算机科学 2026-04-17 Bingbing Wen , Sirajul Salekin , Feiyang Kang , Bill Howe , Lucy Lu Wang , Javier Movellan , Manjot Bilkhu

Adversarial examples reveal critical vulnerabilities in deep neural networks by exploiting their sensitivity to imperceptible input perturbations. While adversarial training remains the predominant defense strategy, it often incurs…

机器学习 · 计算机科学 2025-11-04 Longwei Wang , Ifrat Ikhtear Uddin , KC Santosh , Chaowei Zhang , Xiao Qin , Yang Zhou

Adversarial training enhances neural network robustness but suffers from a tendency to overfit and increased generalization errors on clean data. This work introduces CLAT, an innovative approach that mitigates adversarial overfitting by…

机器学习 · 计算机科学 2024-12-25 Bhavna Gopal , Huanrui Yang , Jingyang Zhang , Mark Horton , Yiran Chen

In adversarial machine learning, there was a common belief that robustness and accuracy hurt each other. The belief was challenged by recent studies where we can maintain the robustness and improve the accuracy. However, the other…

机器学习 · 计算机科学 2021-06-01 Jingfeng Zhang , Jianing Zhu , Gang Niu , Bo Han , Masashi Sugiyama , Mohan Kankanhalli

Randomized smoothing is a technique for providing provable robustness guarantees against adversarial attacks while making minimal assumptions about a classifier. This method relies on taking a majority vote of any base classifier over…

机器学习 · 计算机科学 2023-05-09 Ambar Pal , Jeremias Sulam

Supervised classification methods often assume that evaluation data is drawn from the same distribution as training data and that all classes are present for training. However, real-world classifiers must handle inputs that are far from the…

计算机视觉与模式识别 · 计算机科学 2020-09-11 Ryne Roady , Tyler L. Hayes , Christopher Kanan