English
Related papers

Related papers: Correlation Analysis between the Robustness of Spa…

200 papers

Neural networks are often represented as graphs of connections between neurons. However, despite their wide use, there is currently little understanding of the relationship between the graph structure of the neural network and its…

Machine Learning · Computer Science 2020-08-28 Jiaxuan You , Jure Leskovec , Kaiming He , Saining Xie

Graph Neural Networks (GNNs) are gaining popularity across various domains due to their effectiveness in learning graph-structured data. Nevertheless, they have been shown to be susceptible to backdoor poisoning attacks, which pose serious…

Machine Learning · Computer Science 2024-07-10 Yuxuan Zhu , Michael Mandulak , Kerui Wu , George Slota , Yuseok Jeon , Ka-Ho Chow , Lei Yu

Thanks to their extensive capacity, over-parameterized neural networks exhibit superior predictive capabilities and generalization. However, having a large parameter space is considered one of the main suspects of the neural networks'…

Graph Neural Networks (GNNs) are powerful tools in representation learning for graphs. However, recent studies show that GNNs are vulnerable to carefully-crafted perturbations, called adversarial attacks. Adversarial attacks can easily fool…

Machine Learning · Computer Science 2020-06-30 Wei Jin , Yao Ma , Xiaorui Liu , Xianfeng Tang , Suhang Wang , Jiliang Tang

Sparse Neural Networks regained attention due to their potential for mathematical and computational advantages. We give motivation to study Artificial Neural Networks (ANNs) from a network science perspective, provide a technique to embed…

Neural and Evolutionary Computing · Computer Science 2021-12-15 Julian Stier , Michael Granitzer

Sparsity in the structure of Neural Networks can lead to less energy consumption, less memory usage, faster computation times on convenient hardware, and automated machine learning. If sparsity gives rise to certain kinds of structure, it…

Machine Learning · Computer Science 2021-07-28 Julian Stier , Harshil Darji , Michael Granitzer

We argue that the vulnerability of model parameters is of crucial value to the study of model robustness and generalization but little research has been devoted to understanding this matter. In this work, we propose an indicator to measure…

Machine Learning · Computer Science 2020-12-11 Xu Sun , Zhiyuan Zhang , Xuancheng Ren , Ruixuan Luo , Liangyou Li

Deep neural networks (DNNs) are computationally/memory-intensive and vulnerable to adversarial attacks, making them prohibitive in some real-world applications. By converting dense models into sparse ones, pruning appears to be a promising…

Machine Learning · Computer Science 2019-11-07 Yiwen Guo , Chao Zhang , Changshui Zhang , Yurong Chen

Graph neural networks (GNNs) have attracted significant attention for their outstanding performance in graph learning and node classification tasks. However, their vulnerability to adversarial attacks, particularly through susceptible…

Machine Learning · Computer Science 2024-11-19 Sepideh Neshatfar , Salimeh Yasaei Sekeh

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

In this paper, we focus on learning sparse graphs with a core-periphery structure. We propose a generative model for data associated with core-periphery structured networks to model the dependence of node attributes on core scores of the…

Machine Learning · Computer Science 2021-10-11 Sravanthi Gurugubelli , Sundeep Prabhakar Chepuri

Deep learning systems have become ubiquitous in many aspects of our lives. Unfortunately, it has been shown that such systems are vulnerable to adversarial attacks, making them prone to potential unlawful uses. Designing deep neural…

Machine Learning · Computer Science 2018-06-04 Jan Svoboda , Jonathan Masci , Federico Monti , Michael M. Bronstein , Leonidas Guibas

Graph neural networks (GNNs) have achieved state-of-the-art performance in many graph learning tasks. However, recent studies show that GNNs are vulnerable to both test-time evasion and training-time poisoning attacks that perturb the graph…

Cryptography and Security · Computer Science 2023-03-14 Binghui Wang , Meng Pang , Yun Dong

In the last a few decades, deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition. Recent studies however show that neural networks (both shallow and deep) may be easily fooled by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhuang Qian , Kaizhu Huang , Qiu-Feng Wang , Xu-Yao Zhang

We present a framework to define a large class of neural networks for which, by construction, training by gradient flow provably reaches arbitrarily low loss when the number of parameters grows. Distinct from the fixed-space global…

Optimization and Control · Mathematics 2025-01-13 David A. R. Robin , Kevin Scaman , Marc Lelarge

Graph Neural Networks (GNNs) have established themselves as a key component in addressing diverse graph-based tasks. Despite their notable successes, GNNs remain susceptible to input perturbations in the form of adversarial attacks. This…

Machine Learning · Computer Science 2024-09-13 Moshe Eliasof , Davide Murari , Ferdia Sherry , Carola-Bibiane Schönlieb

Recent work has put forth the hypothesis that adversarial vulnerabilities in neural networks are due to them overusing "non-robust features" inherent in the training data. We show empirically that for PGD-attacks, there is a training stage…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Zuowen Wang , Leo Horne

Despite the exploding interest in graph neural networks there has been little effort to verify and improve their robustness. This is even more alarming given recent findings showing that they are extremely vulnerable to adversarial attacks…

Machine Learning · Computer Science 2019-12-20 Aleksandar Bojchevski , Stephan Günnemann

Deep learning models, such as wide neural networks, can be conceptualized as nonlinear dynamical physical systems characterized by a multitude of interacting degrees of freedom. Such systems in the infinite limit, tend to exhibit simplified…

Machine Learning · Computer Science 2024-01-09 Ori Shem-Ur , Yaron Oz

Improvements in the performance of deep neural networks have often come through the design of larger and more complex networks. As a result, fast memory is a significant limiting factor in our ability to improve network performance. One…

Machine Learning · Computer Science 2019-12-25 Simon Alford , Ryan Robinett , Lauren Milechin , Jeremy Kepner