English
Related papers

Related papers: Functional Stability of Software-Hardware Neural N…

200 papers

The decision logic for the ACAS X family of aircraft collision avoidance systems is represented as a large numeric table. Due to storage constraints of certified avionics hardware, neural networks have been suggested as a way to…

Systems and Control · Electrical Eng. & Systems 2020-05-07 Kyle D. Julian , Mykel J. Kochenderfer

Neural network controllers have become popular in control tasks thanks to their flexibility and expressivity. Stability is a crucial property for safety-critical dynamical systems, while stabilization of partially observed systems, in many…

Systems and Control · Electrical Eng. & Systems 2021-12-08 Fangda Gu , He Yin , Laurent El Ghaoui , Murat Arcak , Peter Seiler , Ming Jin

Large neural networks are often overparameterised and prone to overfitting, Dropout is a widely used regularization technique to combat overfitting and improve model generalization. However, unstructured Dropout is not always effective for…

Machine Learning · Computer Science 2022-10-07 Yiren Zhao , Oluwatomisin Dada , Xitong Gao , Robert D Mullins

In recent years, the notion of local robustness (or robustness for short) has emerged as a desirable property of deep neural networks. Intuitively, robustness means that small perturbations to an input do not cause the network to perform…

Programming Languages · Computer Science 2019-05-02 Greg Anderson , Shankara Pailoor , Isil Dillig , Swarat Chaudhuri

Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from…

Hardware Architecture · Computer Science 2023-12-05 Souvik Kundu , Rui-Jie Zhu , Akhilesh Jaiswal , Peter A. Beerel

Neural networks are very successful at detecting patterns in noisy data, and have become the technology of choice in many fields. However, their usefulness is hampered by their susceptibility to adversarial attacks. Recently, many methods…

Machine Learning · Computer Science 2022-07-14 Marco Casadio , Ekaterina Komendantskaya , Matthew L. Daggitt , Wen Kokke , Guy Katz , Guy Amir , Idan Refaeli

For many types of integrated circuits, accepting larger failure rates in computations can be used to improve energy efficiency. We study the performance of faulty implementations of certain deep neural networks based on pessimistic and…

Neural and Evolutionary Computing · Computer Science 2017-04-19 Jean-Charles Vialatte , François Leduc-Primeau

Spiking neural networks have gained significant attention due to their brain-like information processing capabilities. The use of surrogate gradients has made it possible to train spiking neural networks with backpropagation, leading to…

Neural and Evolutionary Computing · Computer Science 2023-05-24 Dongcheng Zhao , Guobin Shen , Yiting Dong , Yang Li , Yi Zeng

We address the efficiency issue for the construction of a deep graph neural network (GNN). The approach exploits the idea of representing each input graph as a fixed point of a dynamical system (implemented through a recurrent neural…

Machine Learning · Computer Science 2019-11-21 Claudio Gallicchio , Alessio Micheli

The stability and convergence of the neural networks are the fundamental characteristics in the Hopfield type networks. Since time delay is ubiquitous in most physical and biological systems, more attention is being made for the delayed…

Neural and Evolutionary Computing · Computer Science 2010-02-08 A. K. Ojha , Dushmanta Mallick , C. Mallick

Network robustness is a measure a network's ability to survive adversarial attacks. But not all parts of a network are equal. K-cores, which are dense subgraphs, are known to capture some of the key properties of many real-life networks.…

Social and Information Networks · Computer Science 2020-12-21 Palash Dey , Suman Kalyan Maity , Sourav Medya , Arlei Silva

Deep neural networks (DNNs) are increasingly being deployed in safety-critical systems such as personal healthcare devices and self-driving cars. In such DNN-based systems, error resilience is a top priority since faults in DNN inference…

Machine Learning · Computer Science 2021-12-28 Behnam Ghavami , Mani Sadati , Zhenman Fang , Lesley Shannon

Spintronic technology is emerging as a direction for the hardware implementation of neurons and synapses of neuromorphic architectures. In particular, a single spintronic device can be used to implement the nonlinear activation function of…

We introduce Harmonic Robustness, a powerful and intuitive method to test the robustness of any machine-learning model either during training or in black-box real-time inference monitoring without ground-truth labels. It is based on…

Machine Learning · Computer Science 2024-04-30 Nicholas S. Kersting , Yi Li , Aman Mohanty , Oyindamola Obisesan , Raphael Okochu

Serial-parallel redundancy is a reliable way to ensure service and systems will be available in cloud computing. That method involves making copies of the same system or program, with only one remaining active. When an error occurs, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-08 Gutha Jaya Krishna

Learning stable dynamics from observed time-series data is an essential problem in robotics, physical modeling, and systems biology. Many of these dynamics are represented as an inputs-output system to communicate with the external…

Dynamical Systems · Mathematics 2023-01-18 Yuji Okamoto , Ryosuke Kojima

Specialized hardware accelerators have been designed and employed to maximize the performance efficiency of Spiking Neural Networks (SNNs). However, such accelerators are vulnerable to transient faults (i.e., soft errors), which occur due…

Hardware Architecture · Computer Science 2023-03-06 Rachmad Vidya Wicaksana Putra , Muhammad Abdullah Hanif , Muhammad Shafique

Plasticity loss, a critical challenge in neural network training, limits a model's ability to adapt to new tasks or shifts in data distribution. This paper introduces AID (Activation by Interval-wise Dropout), a novel method inspired by…

Machine Learning · Computer Science 2025-06-24 Sangyeon Park , Isaac Han , Seungwon Oh , Kyung-Joong Kim

Making AI safe and dependable requires the generation of dependable models and dependable execution of those models. We propose redundant execution as a well-known technique that can be used to ensure reliable execution of the AI model.…

Artificial Intelligence · Computer Science 2024-05-10 Hans Dermot Doran , Suzana Veljanovska

This paper aims to enhance the computational efficiency of safety verification of neural network control systems by developing a guaranteed neural network model reduction method. First, a concept of model reduction precision is proposed to…

Machine Learning · Computer Science 2023-01-19 Weiming Xiang , Zhongzhu Shao