English
Related papers

Related papers: A Provable Defense for Deep Residual Networks

200 papers

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

In this paper, we propose a deep generative adversarial network for super-resolution considering the trade-off between perception and distortion. Based on good performance of a recently developed model for super-resolution, i.e., deep…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Manri Cheon , Jun-Hyuk Kim , Jun-Ho Choi , Jong-Seok Lee

Deep Neural Networks have been widely used in many fields. However, studies have shown that DNNs are easily attacked by adversarial examples, which have tiny perturbations and greatly mislead the correct judgment of DNNs. Furthermore, even…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shaowei Zhu , Wanli Lyu , Bin Li , Zhaoxia Yin , Bin Luo

Many techniques have been developed, such as model compression, to make Deep Neural Networks (DNNs) inference more efficiently. Nevertheless, DNNs still lack excellent run-time dynamic inference capability to enable users trade-off accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Li Yang , Zhezhi He , Yu Cao , Deliang Fan

Most recent semi-supervised deep learning (deep SSL) methods used a similar paradigm: use network predictions to update pseudo-labels and use pseudo-labels to update network parameters iteratively. However, they lack theoretical support and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Guo-Hua Wang , Jianxin Wu

An intriguing property of deep neural networks is their inherent vulnerability to adversarial inputs, which significantly hinders their application in security-critical domains. Most existing detection methods attempt to use carefully…

Machine Learning · Computer Science 2017-12-05 Chanh Nguyen , Georgi Georgiev , Yujie Ji , Ting Wang

Deep residual learning (ResNet) is a new method for training very deep neural networks using identity map-ping for shortcut connections. ResNet has won the ImageNet ILSVRC 2015 classification task, and achieved state-of-the-art performances…

Computation and Language · Computer Science 2017-07-28 Yi Yao Huang , William Yang Wang

Deep neural networks (DNNs) have provided brilliant performance across various tasks. However, this success often comes at the cost of unnecessarily large model sizes, high computational demands, and substantial memory footprints.…

Machine Learning · Computer Science 2025-11-26 Shaharyar Ahmed Khan Tareen , Filza Khan Tareen

Deep neural networks are vulnerable to adversarial examples, i.e., carefully-perturbed inputs aimed to mislead classification. This work proposes a detection method based on combining non-linear dimensionality reduction and density…

Machine Learning · Computer Science 2019-05-02 Francesco Crecchi , Davide Bacciu , Battista Biggio

Adversarial robustness is essential for security and reliability of machine learning systems. However, adversarial robustness enhanced by defense algorithms is easily erased as the neural network's weights update to learn new tasks. To…

Machine Learning · Computer Science 2024-08-14 Xiaolei Ru , Xiaowei Cao , Zijia Liu , Jack Murdoch Moore , Xin-Ya Zhang , Xia Zhu , Wenjia Wei , Gang Yan

Deep Neural Networks (DNNs) achieve strong performance in semantic segmentation for robotic perception but remain vulnerable to adversarial attacks, threatening safety-critical applications. While robustness has been studied for image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Ziad Sharawy , Mohammad Nakshbandi , Sorin Mihai Grigorescu

Deep neural networks (DNNs) have become a widely deployed model for numerous machine learning applications. However, their fixed architecture, substantial training cost, and significant model redundancy make it difficult to efficiently…

Neural and Evolutionary Computing · Computer Science 2019-05-28 Xiaoliang Dai , Hongxu Yin , Niraj K. Jha

A variety of forms of artificial intelligence systems have been developed. Two well-known techniques are neural networks and rule-fact expert systems. The former can be trained from presented data while the latter is typically developed by…

Artificial Intelligence · Computer Science 2024-04-19 Jordan Milbrath , Jonathan Rivard , Jeremy Straub

The vulnerability of Deep Neural Networks to Adversarial Attacks has fuelled research towards building robust models. While most Adversarial Training algorithms aim at defending attacks constrained within low magnitude Lp norm bounds,…

Machine Learning · Computer Science 2022-10-19 Sravanti Addepalli , Samyak Jain , Gaurang Sriramanan , R. Venkatesh Babu

The quality of open-weight language models has dramatically improved in recent years. Sharing weights greatly facilitates model adoption by enabling their use across diverse hardware and software platforms. They also allow for more open…

Machine Learning · Computer Science 2026-05-12 Keitaro Sakamoto , Pierre Ablin , Federico Danieli , Marco Cuturi

Adversarial attacks in deep learning represent a significant threat to the integrity and reliability of machine learning models. Adversarial training has been a popular defence technique against these adversarial attacks. In this work, we…

Machine Learning · Computer Science 2025-02-24 Akshay G Rao , Chandrashekhar Lakshminarayanan , Arun Rajkumar

High false alarm rate and low detection rate are the major sticking points for unknown threat perception. To address the problems, in the paper, we present a densely connected residual network (Densely-ResNet) for attack recognition.…

Cryptography and Security · Computer Science 2020-08-06 Peilun Wu , Nour Moustafa , Shiyi Yang , Hui Guo

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models. However,…

Computation and Language · Computer Science 2021-10-07 Zongyi Li , Jianhan Xu , Jiehang Zeng , Linyang Li , Xiaoqing Zheng , Qi Zhang , Kai-Wei Chang , Cho-Jui Hsieh

As deep neural networks (DNNs) are increasingly deployed in sensitive applications, ensuring their security and robustness has become critical. A major threat to DNNs arises from adversarial attacks, where small input perturbations can lead…

Machine Learning · Computer Science 2025-11-27 Erh-Chung Chen , Pin-Yu Chen , I-Hsin Chung , Che-Rung Lee

Despite their appealing flexibility, deep neural networks (DNNs) are vulnerable against adversarial examples. Various adversarial defense strategies have been proposed to resolve this problem, but they typically demonstrate restricted…

Machine Learning · Computer Science 2021-06-01 Zhijie Deng , Xiao Yang , Shizhen Xu , Hang Su , Jun Zhu