English
Related papers

Related papers: Skip Connections Matter: On the Transferability of…

200 papers

Recurrent neural networks are powerful models for sequential data, able to represent complex dependencies in the sequence that simpler models such as hidden Markov models cannot handle. Yet they are notoriously hard to train. Here we…

Neural and Evolutionary Computing · Computer Science 2015-02-04 Yann Ollivier

Rank collapse, a phenomenon where embedding vectors in sequence models rapidly converge to a uniform token or equilibrium state, has recently gained attention in the deep learning literature. This phenomenon leads to reduced expressivity…

Machine Learning · Computer Science 2025-02-14 Federico Arangath Joseph , Jerome Sieber , Melanie N. Zeilinger , Carmen Amo Alonso

Spiking Neural Networks (SNNs) claim to present many advantages in terms of biological plausibility and energy efficiency compared to standard Deep Neural Networks (DNNs). Recent works have shown that DNNs are vulnerable to adversarial…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Giorgio Nanfa , Faiq Khalid , Muhammad Abdullah Hanif , Maurizio Martina , Muhammad Shafique

The increasing complexity and energy demands of deep learning models have highlighted the limitations of traditional computing architectures, especially for edge devices with constrained resources. Spiking Neural Networks (SNNs) offer a…

Neural and Evolutionary Computing · Computer Science 2024-12-17 Wei-Ting Chen

Deep neural networks (DNNs) are known to be vulnerable to adversarial examples. It is thus imperative to devise effective attack algorithms to identify the deficiencies of DNNs beforehand in security-sensitive applications. To efficiently…

Machine Learning · Computer Science 2022-04-04 Jianping Zhang , Weibin Wu , Jen-tse Huang , Yizhan Huang , Wenxuan Wang , Yuxin Su , Michael R. Lyu

Transferable targeted adversarial attacks aim to mislead models into outputting adversary-specified predictions in black-box scenarios. Recent studies have introduced \textit{single-target} generative attacks that train a generator for each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Hao Fang , Jiawei Kong , Bin Chen , Tao Dai , Hao Wu , Shu-Tao Xia

This paper introduces generative Residual Networks (ResNet) as a surrogate Machine Learning (ML) tool for Large Eddy Simulation (LES) Sub Grid Scale (SGS) resolving. The study investigates the impact of incorporating Dual Scale Residual…

Fluid Dynamics · Physics 2024-09-13 Omar Sallam , Mirjam Fürth

Recent breakthroughs in defenses against adversarial examples, like adversarial training, make the neural networks robust against various classes of attackers (e.g., first-order gradient-based attacks). However, it is an open question…

Machine Learning · Computer Science 2019-06-07 Shiqi Wang , Yizheng Chen , Ahmed Abdou , Suman Jana

The most advanced diffusion models have recently adopted increasingly deep stacked networks (e.g., U-Net or Transformer) to promote the generative emergence capabilities of vision generation models similar to large language models (LLMs).…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhiyuan Ma , Liangliang Zhao , Biqing Qi , Bowen Zhou

Adversarial attacks pose a significant challenge to deploying deep learning models in safety-critical applications. Maintaining model robustness while ensuring interpretability is vital for fostering trust and comprehension in these models.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Amira Guesmi , Nishant Suresh Aswani , Muhammad Shafique

The graph neural network (GNN) models have presented impressive achievements in numerous machine learning tasks. However, many existing GNN models are shown to be vulnerable to adversarial attacks, which creates a stringent need to build…

Machine Learning · Computer Science 2022-10-04 Zepeng Zhang , Songtao Lu , Zengfeng Huang , Ziping Zhao

Recent advances in event-based neuromorphic systems have resulted in significant interest in the use and development of spiking neural networks (SNNs). However, the non-differentiable nature of spiking neurons makes SNNs incompatible with…

Neural and Evolutionary Computing · Computer Science 2020-07-10 Ali Lotfi Rezaabad , Sriram Vishwanath

Graph neural networks (GNNs) offer promising learning methods for graph-related tasks. However, GNNs are at risk of adversarial attacks. Two primary limitations of the current evasion attack methods are highlighted: (1) The current…

Machine Learning · Computer Science 2023-02-08 He Zhang , Xingliang Yuan , Chuan Zhou , Shirui Pan

Adversarial examples (AEs) with small adversarial perturbations can mislead deep neural networks (DNNs) into wrong predictions. The AEs created on one DNN can also fool another DNN. Over the last few years, the transferability of AEs has…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Wenqian Yu , Jindong Gu , Zhijiang Li , Philip Torr

Traditional deep learning networks (DNN) exhibit intriguing vulnerabilities that allow an attacker to force them to fail at their task. Notorious attacks such as the Fast Gradient Sign Method (FGSM) and the more powerful Projected Gradient…

Machine Learning · Computer Science 2022-02-16 Jasser Jasser , Ivan Garibay

Deep neural networks have been one of the dominant machine learning approaches in recent years. Several new network structures are proposed and have better performance than the traditional feedforward neural network structure.…

Computer Vision and Pattern Recognition · Computer Science 2018-10-04 Huan Li , Yibo Yang , Dongmin Chen , Zhouchen Lin

To foster the verifiability and testability of Deep Neural Networks (DNN), an increasing number of methods for test case generation techniques are being developed. When confronted with testing DNN models, the user can apply any existing…

Machine Learning · Computer Science 2024-05-21 Florian Tambon , Foutse Khomh , Giuliano Antoniol

Deep neural networks (DNNs) have transformed several artificial intelligence research areas including computer vision, speech recognition, and natural language processing. However, recent studies demonstrated that DNNs are vulnerable to…

Cryptography and Security · Computer Science 2020-01-01 Xiaoyu Cao , Neil Zhenqiang Gong

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Spiking Neural Networks (SNNs) have attracted growing interest in both computational neuroscience and artificial intelligence, primarily due to their inherent energy efficiency and compact memory footprint. However, achieving adversarial…

Neural and Evolutionary Computing · Computer Science 2025-12-04 Luu Trong Nhan , Luu Trung Duong , Pham Ngoc Nam , Truong Cong Thang