English
Related papers

Related papers: Self-Healing Robust Neural Networks via Closed-Loo…

200 papers

Deep neural networks give us a powerful method to model the training dataset's relationship between input and output. We can regard that as a complex adaptive system consisting of many artificial neurons that work as an adaptive memory as a…

Disordered Systems and Neural Networks · Physics 2024-05-08 Kenichi Nakazato

We address the problem of verifying closed-loop contraction in nonlinear control systems whose controller and contraction metric are both parameterized by neural networks. By leveraging interval analysis and interval bound propagation, we…

Systems and Control · Electrical Eng. & Systems 2025-12-03 Alexander Davydov

Deep neural networks (DNN) have found wide applicability in numerous fields due to their ability to accurately learn very complex input-output relations. Despite their accuracy and extensive use, DNNs are highly susceptible to adversarial…

Machine Learning · Computer Science 2023-08-25 Ali Haisam Muhammad Rafid , Adrian Sandu

This paper introduces an optimal control framework to address the inverse problem using a learned regularizer, with applications in image reconstruction. We build upon the concept of Learnable Optimization Algorithms (LOA), which combine…

Optimization and Control · Mathematics 2024-09-04 Wanyu Bian

A range of defense methods have been proposed to improve the robustness of neural networks on adversarial examples, among which provable defense methods have been demonstrated to be effective to train neural networks that are certifiably…

Machine Learning · Computer Science 2021-01-21 Mengting Xu , Tao Zhang , Zhongnian Li , Daoqiang Zhang

Recursive Neural Networks are non-linear adaptive models that are able to learn deep structured information. However, these models have not yet been broadly accepted. This fact is mainly due to its inherent complexity. In particular, not…

Neural and Evolutionary Computing · Computer Science 2009-11-18 Alejandro Chinea

Robustness against adversarial attack in neural networks is an important research topic in the machine learning community. We observe one major source of vulnerability of neural nets is from overparameterized fully-connected layers. In this…

Machine Learning · Computer Science 2021-02-01 Bingyuan Liu , Christopher Malon , Lingzhou Xue , Erik Kruus

Neural Collapse refers to the curious phenomenon in the end of training of a neural network, where feature vectors and classification weights converge to a very simple geometrical arrangement (a simplex). While it has been observed…

Machine Learning · Computer Science 2024-11-14 Jingtong Su , Ya Shi Zhang , Nikolaos Tsilivis , Julia Kempe

This paper tackles the problem of defending a neural network against adversarial attacks crafted with different norms (in particular $\ell_\infty$ and $\ell_2$ bounded adversarial examples). It has been observed that defense mechanisms…

Machine Learning · Computer Science 2020-02-14 Alexandre Araujo , Laurent Meunier , Rafael Pinot , Benjamin Negrevergne

Randomized smoothing is currently a state-of-the-art method to construct a certifiably robust classifier from neural networks against $\ell_2$-adversarial perturbations. Under the paradigm, the robustness of a classifier is aligned with the…

Machine Learning · Computer Science 2021-11-18 Jongheon Jeong , Sejun Park , Minkyu Kim , Heung-Chang Lee , Doguk Kim , Jinwoo Shin

Reinforcement learning is a general methodology of adaptive optimal control that has attracted much attention in various fields ranging from video game industry to robot manipulators. Despite its remarkable performance demonstrations, plain…

Dynamical Systems · Mathematics 2022-06-14 Pavel Osinenko , Grigory Yaremenko , Ilya Osokin

We propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. One of the weaknesses of self-training is the semantic drift problem, where noisy pseudo-labels accumulate…

Computation and Language · Computer Science 2024-01-02 Payam Karisani

The following work presents how autoencoding all the possible hidden activations of a network for a given problem can provide insight about its structure, behavior, and vulnerabilities. The method, termed self-introspection, can show that a…

In recent years, new regularization methods based on (deep) neural networks have shown very promising empirical performance for the numerical solution of ill-posed problems, e.g., in medical imaging and imaging science. Due to the…

Numerical Analysis · Mathematics 2024-06-07 Tim Jahn , Bangti Jin

Most work on the formal verification of neural networks has focused on bounding the set of outputs that correspond to a given set of inputs (for example, bounded perturbations of a nominal input). However, many use cases of neural network…

Machine Learning · Computer Science 2024-03-19 Suhas Kotha , Christopher Brix , Zico Kolter , Krishnamurthy Dvijotham , Huan Zhang

Graph Neural Networks (GNNs) have demonstrated significant application potential in various fields. However, GNNs are still vulnerable to adversarial attacks. Numerous adversarial defense methods on GNNs are proposed to address the problem…

Social and Information Networks · Computer Science 2024-06-21 Tao Wu , Xinwen Cao , Chao Wang , Shaojie Qiao , Xingping Xian , Lin Yuan , Canyixing Cui , Yanbing Liu

Neural networks have had discernible achievements in a wide range of applications. The wide-spread adoption also raises the concern of their dependability and reliability. Similar to traditional decision-making programs, neural networks can…

Software Engineering · Computer Science 2022-07-08 Bing Sun , Jun Sun , Hong Long Pham , Jie Shi

Despite significant progress in theoretical and laboratory quantum control, engineering quantum systems remains principally challenging due to manifestation of noise and uncertainties associated with the field and Hamiltonian parameters. In…

Quantum Physics · Physics 2021-12-15 Andrew Koswara , Vaibhav Bhutoria , Raj Chakrabarti

Neural networks are increasingly deployed in real-world safety-critical domains such as autonomous driving, aircraft collision avoidance, and malware detection. However, these networks have been shown to often mispredict on inputs with…

Machine Learning · Computer Science 2018-11-09 Shiqi Wang , Kexin Pei , Justin Whitehouse , Junfeng Yang , Suman Jana

The potential for neuromorphic computing to provide intrinsic fault tolerance has long been speculated, but the brain's robustness in neuromorphic applications has yet to be demonstrated. Here, we show that a previously described, natively…

Neural and Evolutionary Computing · Computer Science 2026-03-12 Bradley H. Theilman , James B. Aimone