中文
相关论文

相关论文: Robust Neural Networks inspired by Strong Stabilit…

200 篇论文

In this effort, we propose a new deep architecture utilizing residual blocks inspired by implicit discretization schemes. As opposed to the standard feed-forward networks, the outputs of the proposed implicit residual blocks are defined as…

机器学习 · 计算机科学 2021-02-23 Viktor Reshniak , Clayton Webster

Adversarial robustness is essential for security and reliability of machine learning systems. However, adversarial robustness enhanced by defense algorithms is easily erased as the neural network's weights update to learn new tasks. To…

机器学习 · 计算机科学 2024-08-14 Xiaolei Ru , Xiaowei Cao , Zijia Liu , Jack Murdoch Moore , Xin-Ya Zhang , Xia Zhu , Wenjia Wei , Gang Yan

High order strong stability preserving (SSP) time discretizations are often needed to ensure the nonlinear (and sometimes non-inner-product) strong stability properties of spatial discretizations specially designed for the solution of…

数值分析 · 数学 2018-10-22 Zachary Grant , Sigal Gottlieb , David C Seal

While deep neural networks are sensitive to adversarial noise, sparse coding using the Basis Pursuit (BP) method is robust against such attacks, including its multi-layer extensions. We prove that the stability theorem of BP holds upon the…

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

机器学习 · 计算机科学 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

Motivated by studies on fully discrete numerical schemes for linear hyperbolic conservation laws, we present a framework on analyzing the strong stability of explicit Runge-Kutta (RK) time discretizations for semi-negative autonomous linear…

数值分析 · 数学 2018-11-28 Zheng Sun , Chi-Wang Shu

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

神经与进化计算 · 计算机科学 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

This paper extends deterministic notions of Strong Stability Preservation (SSP) to the stochastic setting, enabling nonlinearly stable numerical solutions to stochastic differential equations (SDEs) and stochastic partial differential…

数值分析 · 数学 2024-12-10 James Woodfield

The inability to guarantee robustness is one of the major obstacles to the application of deep learning models in security-demanding domains. We identify that the most commonly used cross-entropy (CE) loss does not guarantee robust boundary…

机器学习 · 计算机科学 2023-02-21 Weiwei Gao , Dazhi Zhang , Yao Li , Zhichang Guo , Ovanes Petrosian

In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network. Such instability affects many deep…

计算机视觉与模式识别 · 计算机科学 2016-04-18 Stephan Zheng , Yang Song , Thomas Leung , Ian Goodfellow

Adversarial attacks pose a significant challenge to deploying deep learning models in safety-critical applications. Maintaining model robustness while ensuring interpretability is vital for fostering trust and comprehension in these models.…

计算机视觉与模式识别 · 计算机科学 2024-05-13 Amira Guesmi , Nishant Suresh Aswani , Muhammad Shafique

Certifying the safety or robustness of neural networks against input uncertainties and adversarial attacks is an emerging challenge in the area of safe machine learning and control. To provide such a guarantee, one must be able to bound the…

最优化与控制 · 数学 2021-09-16 Mahyar Fazlyab , Manfred Morari , George J. Pappas

Spiking Neural Networks (SNNs) utilize spike-based activations to mimic the brain's energy-efficient information processing. However, the binary and discontinuous nature of spike activations causes vanishing gradients, making adversarial…

机器学习 · 计算机科学 2026-02-10 Jihang Wang , Dongcheng Zhao , Ruolin Chen , Qian Zhang , Yi Zeng

In this paper we consider time-dependent PDEs discretized by a special class of Physics Informed Neural Networks whose design is based on the framework of Runge--Kutta and related time-Galerkin discretizations. The primary motivation for…

数值分析 · 数学 2026-02-10 Georgios Akrivis , Charalambos G. Makridakis , Costas Smaragdakis

The robustness of deep neural networks (DNNs) against adversarial attacks has been studied extensively in hopes of both better understanding how deep learning models converge and in order to ensure the security of these models in…

机器学习 · 计算机科学 2023-07-11 Jovon Craig , Josh Andle , Theodore S. Nowak , Salimeh Yasaei Sekeh

Deep neural networks are vulnerable to adversarial examples - small input perturbations that result in incorrect predictions. We study this problem for models of source code, where we want the network to be robust to source-code…

机器学习 · 计算机科学 2022-08-23 Goutham Ramakrishnan , Jordan Henkel , Zi Wang , Aws Albarghouthi , Somesh Jha , Thomas Reps

Connectivity robustness, a crucial aspect for understanding, optimizing, and repairing complex networks, has traditionally been evaluated through time-consuming and often impractical simulations. Fortunately, machine learning provides a new…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Wenjun Jiang , Tianlong Fan , Changhao Li , Chuanfu Zhang , Tao Zhang , Zong-fu Luo

With the rise of deep learning technology in practical applications, Convolutional Neural Networks (CNNs) have been able to assist humans in solving many real-world problems. To enhance the performance of CNNs, numerous network…

机器学习 · 计算机科学 2024-09-10 Qi Wang , Zijun Gao , Mingxiu Sui , Taiyuan Mei , Xiaohan Cheng , Iris Li

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

计算机视觉与模式识别 · 计算机科学 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

Deep neural networks (DNNs) are vulnerable to adversarial noises, which motivates the benchmark of model robustness. Existing benchmarks mainly focus on evaluating defenses, but there are no comprehensive studies of how architecture design…

计算机视觉与模式识别 · 计算机科学 2022-01-17 Shiyu Tang , Ruihao Gong , Yan Wang , Aishan Liu , Jiakai Wang , Xinyun Chen , Fengwei Yu , Xianglong Liu , Dawn Song , Alan Yuille , Philip H. S. Torr , Dacheng Tao