中文
相关论文

相关论文: Parameterizing Activation Functions for Adversaria…

200 篇论文

Large Language Models (LLMs) with billions of parameters have drastically transformed AI applications. However, their demanding computation during inference has raised significant challenges for deployment on resource-constrained devices.…

Adversarial attacks pose a significant threat to the reliability of pre-trained language models (PLMs) such as GPT, BERT, RoBERTa, and T5. This paper presents Adversarial Robustness through Dynamic Ensemble Learning (ARDEL), a novel scheme…

密码学与安全 · 计算机科学 2025-05-14 Hetvi Waghela , Jaydip Sen , Sneha Rakshit

Artificial neural networks open up unprecedented machine learning capabilities at the cost of ever growing computational requirements. Sparsifying the parameters, often achieved through weight pruning, has been identified as a powerful…

机器学习 · 计算机科学 2024-11-28 Rishav Mukherji , Mark Schöne , Khaleelulla Khan Nazeer , Christian Mayr , Anand Subramoney

Deep neural network models are used today in various applications of artificial intelligence, the strengthening of which, in the face of adversarial attacks is of particular importance. An appropriate solution to adversarial attacks is…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Mohammad Khalooei , Mohammad Mehdi Homayounpour , Maryam Amirmazlaghani

We improve the robustness of Deep Neural Net (DNN) to adversarial attacks by using an interpolating function as the output activation. This data-dependent activation remarkably improves both the generalization and robustness of DNN. In the…

机器学习 · 计算机科学 2020-04-30 Bao Wang , Alex T. Lin , Wei Zhu , Penghang Yin , Andrea L. Bertozzi , Stanley J. Osher

In recent years, neural networks have enjoyed a renaissance as function approximators in reinforcement learning. Two decades after Tesauro's TD-Gammon achieved near top-level human performance in backgammon, the deep reinforcement learning…

机器学习 · 计算机科学 2017-11-03 Stefan Elfwing , Eiji Uchibe , Kenji Doya

With the prevalence of the Pretraining-Finetuning paradigm in transfer learning, the robustness of downstream tasks has become a critical concern. In this work, we delve into adversarial robustness in transfer learning and reveal the…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Andong Hua , Jindong Gu , Zhiyu Xue , Nicholas Carlini , Eric Wong , Yao Qin

This paper explores reinforcement learning (RL) policy robustness by systematically analyzing network parameters under internal and external stresses. \textcolor{black}{We apply synaptic filtering methods using high-pass, low-pass, and…

机器学习 · 计算机科学 2026-03-06 Zain ul Abdeen , Ming Jin

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

One of the arguments to explain the success of deep learning is the powerful approximation capacity of deep neural networks. Such capacity is generally accompanied by the explosive growth of the number of parameters, which, in turn, leads…

机器学习 · 计算机科学 2022-09-15 Zuowei Shen , Haizhao Yang , Shijun Zhang

Adversarial training is one of the most effective defenses against adversarial attacks. Previous works suggest that overfitting is a dominant phenomenon in adversarial training leading to a large generalization gap between test and train…

机器学习 · 计算机科学 2021-08-20 Vasu Singla , Sahil Singla , David Jacobs , Soheil Feizi

In practice, deep neural networks have been found to be vulnerable to various types of noise, such as adversarial examples and corruption. Various adversarial defense methods have accordingly been developed to improve adversarial robustness…

机器学习 · 计算机科学 2020-12-24 Aishan Liu , Xianglong Liu , Chongzhi Zhang , Hang Yu , Qiang Liu , Dacheng Tao

The possibility for one to recover the parameters-weights and biases-of a neural network thanks to the knowledge of its function on a subset of the input space can be, depending on the situation, a curse or a blessing. On one hand,…

统计理论 · 数学 2023-05-15 Joachim Bona-Pellissier , François Bachoc , François Malgouyres

Adversarial training has been widely acknowledged as the most effective method to improve the adversarial robustness against adversarial examples for Deep Neural Networks (DNNs). So far, most existing works focus on enhancing the overall…

机器学习 · 计算机科学 2023-03-28 Zeming Wei , Yifei Wang , Yiwen Guo , Yisen Wang

Adversarial training (AT) is one of the most effective strategies for promoting model robustness. However, recent benchmarks show that most of the proposed improvements on AT are less effective than simply early stopping the training…

机器学习 · 计算机科学 2021-04-01 Tianyu Pang , Xiao Yang , Yinpeng Dong , Hang Su , Jun Zhu

Large pre-trained Vision-Language Models (VLMs) like CLIP, despite having remarkable generalization ability, are highly vulnerable to adversarial examples. This work studies the adversarial robustness of VLMs from the novel perspective of…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Lin Li , Haoyan Guan , Jianing Qiu , Michael Spratling

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

机器学习 · 计算机科学 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

The usage of deep learning is being escalated in many applications. Due to its outstanding performance, it is being used in a variety of security and privacy-sensitive areas in addition to conventional applications. One of the key aspects…

密码学与安全 · 计算机科学 2022-05-17 Zhaoxi Zhang , Leo Yu Zhang , Xufei Zheng , Bilal Hussain Abbasi , Shengshan Hu

We have proposed orthogonal-Pad\'e activation functions, which are trainable activation functions and show that they have faster learning capability and improves the accuracy in standard deep learning datasets and models. Based on our…

神经与进化计算 · 计算机科学 2021-06-18 Koushik Biswas , Shilpak Banerjee , Ashish Kumar Pandey

It is necessary to improve the performance of some special classes or to particularly protect them from attacks in adversarial learning. This paper proposes a framework combining cost-sensitive classification and adversarial learning…

机器学习 · 计算机科学 2022-06-24 Haojing Shen , Sihong Chen , Ran Wang , Xizhao Wang