中文
相关论文

相关论文: Using Intuition from Empirical Properties to Simpl…

200 篇论文

With the emergence of large language models, such as LLaMA and OpenAI GPT-3, In-Context Learning (ICL) gained significant attention due to its effectiveness and efficiency. However, ICL is very sensitive to the choice, order, and verbaliser…

计算与语言 · 计算机科学 2024-10-10 Simon Yu , Jie He , Pasquale Minervini , Jeff Z. Pan

Recently, many studies have demonstrated deep neural network (DNN) classifiers can be fooled by the adversarial example, which is crafted via introducing some perturbations into an original sample. Accordingly, some powerful defense…

密码学与安全 · 计算机科学 2019-01-10 Bin Liang , Hongcheng Li , Miaoqiang Su , Xirong Li , Wenchang Shi , Xiaofeng Wang

Adversarial training (AT) refers to integrating adversarial examples -- inputs altered with imperceptible perturbations that can significantly impact model predictions -- into the training process. Recent studies have demonstrated the…

机器学习 · 计算机科学 2024-10-22 Mengnan Zhao , Lihe Zhang , Jingwen Ye , Huchuan Lu , Baocai Yin , Xinchao Wang

Artificial neural networks in general and deep learning networks in particular established themselves as popular and powerful machine learning algorithms. While the often tremendous sizes of these networks are beneficial when solving…

机器学习 · 计算机科学 2020-05-28 Moritz Seiler , Heike Trautmann , Pascal Kerschke

Adversarial training is the most promising method for learning robust models against adversarial examples. A recent study has shown that knowledge distillation between the same architectures is effective in improving the performance of…

机器学习 · 计算机科学 2022-11-02 Tomokatsu Takahashi , Masanori Yamada , Yuuki Yamanaka , Tomoya Yamashita

As a new programming paradigm, deep learning has expanded its application to many real-world problems. At the same time, deep learning based software are found to be vulnerable to adversarial attacks. Though various defense mechanisms have…

密码学与安全 · 计算机科学 2021-03-16 Zhe Zhao , Guangke Chen , Jingyi Wang , Yiwei Yang , Fu Song , Jun Sun

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

机器学习 · 计算机科学 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

Existing segmentation models exhibit significant vulnerability to adversarial attacks.To improve robustness, adversarial training incorporates adversarial examples into model training. However, existing attack methods consider only global…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Yufei Song , Ziqi Zhou , Menghao Deng , Yifan Hu , Shengshan Hu , Minghui Li , Leo Yu Zhang

Adversarial training (AT) has shown excellent high performance in defending against adversarial examples. Recent studies demonstrate that examples are not equally important to the final robustness of models during AT, that is, the so-called…

机器学习 · 计算机科学 2022-06-27 Mengting Xu , Tao Zhang , Zhongnian Li , Daoqiang Zhang

Adversarial training and its many variants substantially improve deep network robustness, yet at the cost of compromising standard accuracy. Moreover, the training process is heavy and hence it becomes impractical to thoroughly explore the…

计算机视觉与模式识别 · 计算机科学 2020-11-11 Haotao Wang , Tianlong Chen , Shupeng Gui , Ting-Kuei Hu , Ji Liu , Zhangyang Wang

State-of-the-art deep neural networks are known to be vulnerable to adversarial examples, formed by applying small but malicious perturbations to the original inputs. Moreover, the perturbations can \textit{transfer across models}:…

机器学习 · 统计学 2018-02-28 Lei Wu , Zhanxing Zhu , Cheng Tai , Weinan E

Nowadays, Deep Learning as a service can be deployed in Internet of Things (IoT) to provide smart services and sensor data processing. However, recent research has revealed that some Deep Neural Networks (DNN) can be easily misled by adding…

密码学与安全 · 计算机科学 2020-10-22 Ling Wang , Cheng Zhang , Zejian Luo , Chenguang Liu , Jie Liu , Xi Zheng , Athanasios Vasilakos

In this paper, we delve into the essential components of adversarial training which is a pioneering defense technique against adversarial attacks. We indicate that some factors such as the loss function, learning rate scheduler, and data…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Hong Liu

We introduce a feature scattering-based adversarial training approach for improving model robustness against adversarial attacks. Conventional adversarial training approaches leverage a supervised scheme (either targeted or non-targeted) in…

计算机视觉与模式识别 · 计算机科学 2019-11-25 Haichao Zhang , Jianyu Wang

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

机器学习 · 计算机科学 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

Adversarial examples are known to mislead deep learning models to incorrectly classify them, even in domains where such models achieve state-of-the-art performance. Until recently, research on both attack and defense methods focused on…

密码学与安全 · 计算机科学 2019-11-22 Ishai Rosenberg , Asaf Shabtai , Yuval Elovici , Lior Rokach

It is well-known that deep neural networks (DNNs) are susceptible to adversarial attacks, exposing a severe fragility of deep learning systems. As the result, adversarial training (AT) method, by incorporating adversarial examples during…

机器学习 · 计算机科学 2022-03-01 Tuan Anh Bui , Trung Le , Quan Tran , He Zhao , Dinh Phung

We consider the problem of learning textual entailment models with limited supervision (5K-10K training examples), and present two complementary approaches for it. First, we propose knowledge-guided adversarial example generators for…

计算与语言 · 计算机科学 2018-05-15 Dongyeop Kang , Tushar Khot , Ashish Sabharwal , Eduard Hovy

Deep models are highly susceptible to adversarial attacks. Such attacks are carefully crafted imperceptible noises that can fool the network and can cause severe consequences when deployed. To encounter them, the model requires training…

机器学习 · 计算机科学 2022-04-11 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

The phenomenon of adversarial examples has been revealed in variant scenarios. Recent studies show that well-designed adversarial defense strategies can improve the robustness of deep learning models against adversarial examples. However,…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Jialiang Sun , Wen Yao , Tingsong Jiang , Xiaoqian Chen