English
Related papers

Related papers: Neural Networks with Recurrent Generative Feedback

200 papers

Humans rely heavily on shape information to recognize objects. Conversely, convolutional neural networks (CNNs) are biased more towards texture. This is perhaps the main reason why CNNs are vulnerable to adversarial examples. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Ali Borji

Massive deployment of Graph Neural Networks (GNNs) in high-stake applications generates a strong demand for explanations that are robust to noise and align well with human intuition. Most existing methods generate explanations by…

Machine Learning · Computer Science 2022-07-14 Mohit Bajaj , Lingyang Chu , Zi Yu Xue , Jian Pei , Lanjun Wang , Peter Cho-Ho Lam , Yong Zhang

Network robustness is critical for various societal and industrial networks again malicious attacks. In particular, connectivity robustness and controllability robustness reflect how well a networked system can maintain its connectedness…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Yang Lou , Ruizi Wu , Junli Li , Lin Wang , Xiang Li , Guanrong Chen

Biological systems leverage top-down feedback for visual processing, yet most artificial vision models succeed in image classification using purely feedforward or recurrent architectures, calling into question the functional significance of…

Neurons and Cognition · Quantitative Biology 2025-08-12 Antonino Greco , Marco D'Alessandro , Karl J. Friston , Giovanni Pezzulo , Markus Siegel

We present a new algorithm to train a robust neural network against adversarial attacks. Our algorithm is motivated by the following two ideas. First, although recent work has demonstrated that fusing randomness can improve the robustness…

Machine Learning · Computer Science 2019-05-07 Xuanqing Liu , Yao Li , Chongruo Wu , Cho-Jui Hsieh

The determination of the physical parameters of gravitational wave events is a fundamental pillar in the analysis of the signals observed by the current ground-based interferometers. Typically, this is done using Bayesian inference…

General Relativity and Quantum Cosmology · Physics 2023-11-07 M. Andrés-Carcasona , M. Martinez , Ll. M. Mir

Neural generative models can be used to learn complex probability distributions from data, to sample from them, and to produce probability density estimates. We propose a computational framework for developing neural generative models…

Machine Learning · Computer Science 2022-01-06 Alexander Ororbia , Daniel Kifer

Several recent works have empirically observed that Convolutional Neural Nets (CNNs) are (approximately) invertible. To understand this approximate invertibility phenomenon and how to leverage it more effectively, we focus on a theoretical…

Machine Learning · Statistics 2017-05-25 Anna C. Gilbert , Yi Zhang , Kibok Lee , Yuting Zhang , Honglak Lee

Convolutional Neural Networks (CNNs) are a class of artificial neural networks whose computational blocks use convolution, together with other linear and non-linear operations, to perform classification or regression. This paper explores…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Victor Stamatescu , Mark D. McDonnell

Bayesian neural networks (BNNs) have been long considered an ideal, yet unscalable solution for improving the robustness and the predictive uncertainty of deep neural networks. While they could capture more accurately the posterior…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

Brain-inspired machine learning is gaining increasing consideration, particularly in computer vision. Several studies investigated the inclusion of top-down feedback connections in convolutional networks; however, it remains unclear how and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Andrea Alamia , Milad Mozafari , Bhavin Choksi , Rufin VanRullen

We propose a novel method that trains a conditional Generative Adversarial Network (GAN) to generate visual interpretations of a Convolutional Neural Network (CNN). To comprehend a CNN, the GAN is trained with information on how the CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 R T Akash Guna , Raul Benitez , O K Sikha

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

Adoption of deep neural networks in fields such as economics or finance has been constrained by the lack of interpretability of model outcomes. This paper proposes a generative neural network architecture - the parameter encoder neural…

Machine Learning · Statistics 2021-06-11 Johann Pfitzinger

Recent experiments in computer vision demonstrate texture bias as the primary reason for supreme results in models employing Convolutional Neural Networks (CNNs), conflicting with early works claiming that these networks identify objects…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Satyam Mohla , Anshul Nasery , Biplab Banerjee

Computational models of vision have traditionally been developed in a bottom-up fashion, by hierarchically composing a series of straightforward operations - i.e. convolution and pooling - with the aim of emulating simple and complex cells…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Simone Azeglio , Simone Poetto , Luca Savant Aira , Marco Nurisso

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

In recent years, plentiful evidence illustrates that Graph Convolutional Networks (GCNs) achieve extraordinary accomplishments on the node classification task. However, GCNs may be vulnerable to adversarial attacks on label-scarce dynamic…

Machine Learning · Computer Science 2022-03-09 Jun Zhuang , Mohammad Al Hasan

Attentional Neural Network is a new framework that integrates top-down cognitive bias and bottom-up feature extraction in one coherent architecture. The top-down influence is especially effective when dealing with high noise or difficult…

Computer Vision and Pattern Recognition · Computer Science 2014-11-20 Qian Wang , Jiaxing Zhang , Sen Song , Zheng Zhang

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro