中文
相关论文

相关论文: Stochastic Local Winner-Takes-All Networks Enable …

200 篇论文

Previous robustness approaches for deep learning models such as data augmentation techniques via data transformation or adversarial training cannot capture real-world variations that preserve the semantics of the input, such as a change in…

计算机视觉与模式识别 · 计算机科学 2021-05-11 Shuo Wang , Lingjuan Lyu , Surya Nepal , Carsten Rudolph , Marthie Grobler , Kristen Moore

Recent works have shown the effectiveness of randomized smoothing as a scalable technique for building neural network-based classifiers that are provably robust to $\ell_2$-norm adversarial perturbations. In this paper, we employ…

机器学习 · 计算机科学 2020-01-13 Hadi Salman , Greg Yang , Jerry Li , Pengchuan Zhang , Huan Zhang , Ilya Razenshteyn , Sebastien Bubeck

Spiking Transformers, which combine the scalability of Transformers with the sparse, energy-efficient property of Spiking Neural Networks (SNNs), have achieved impressive results in neuromorphic and vision tasks and attracted increasing…

神经与进化计算 · 计算机科学 2026-04-14 Chenlin Zhou , Sihang Guo , Jiaqi Wang , Dongyang Ma , Kaiwei Che , Baiyu Chen , Qingyan Meng , Zhengyu Ma , Yonghong Tian

Weight averaging is a widely used technique for accelerating training and improving the generalization of deep neural networks (DNNs). While existing approaches like stochastic weight averaging (SWA) rely on pre-set weighting schemes, they…

机器学习 · 计算机科学 2025-02-11 Tao Li , Zhehao Huang , Yingwen Wu , Zhengbao He , Qinghua Tao , Xiaolin Huang , Chih-Jen Lin

Automating sign language translation (SLT) is a challenging real world application. Despite its societal importance, though, research progress in the field remains rather poor. Crucially, existing methods that yield viable performance…

Despite their empirical success, neural networks remain vulnerable to small, adversarial perturbations. A longstanding hypothesis suggests that flat minima, regions of low curvature in the loss landscape, offer increased robustness. While…

机器学习 · 计算机科学 2025-10-17 Nils Philipp Walter , Linara Adilova , Jilles Vreeken , Michael Kamp

We investigate to what extent alternative variants of Artificial Neural Networks (ANNs) are susceptible to adversarial attacks. We analyse the adversarial robustness of conventional, stochastic ANNs and Spiking Neural Networks (SNNs) in the…

机器学习 · 计算机科学 2020-03-12 Yi Xiang Marcus Tan , Yuval Elovici , Alexander Binder

We study the adversarial robustness of information bottleneck models for classification. Previous works showed that the robustness of models trained with information bottlenecks can improve upon adversarial training. Our evaluation under a…

机器学习 · 计算机科学 2021-07-14 Iryna Korshunova , David Stutz , Alexander A. Alemi , Olivia Wiles , Sven Gowal

Neural networks are known to be highly sensitive to adversarial examples. These may arise due to different factors, such as random initialization, or spurious correlations in the learning problem. To better understand these factors, we…

机器学习 · 统计学 2022-07-05 Elvis Dohmatob , Alberto Bietti

In this article, we propose a novel Winner-Take-All (WTA) architecture employing neurons with nonlinear dendrites and an online unsupervised structural plasticity rule for training it. Further, to aid hardware implementations, our network…

神经与进化计算 · 计算机科学 2015-12-07 Subhrajit Roy , Arindam Basu

Patch-based adversarial attacks introduce a perceptible but localized change to the input that induces misclassification. While progress has been made in defending against imperceptible attacks, it remains unclear how patch-based attacks…

计算机视觉与模式识别 · 计算机科学 2020-12-02 Christian Cosgrove , Adam Kortylewski , Chenglin Yang , Alan Yuille

Efforts to improve the adversarial robustness of convolutional neural networks have primarily focused on developing more effective adversarial training methods. In contrast, little attention was devoted to analyzing the role of…

计算机视觉与模式识别 · 计算机科学 2022-12-22 Shihua Huang , Zhichao Lu , Kalyanmoy Deb , Vishnu Naresh Boddeti

We propose a general framework for increasing local stability of Artificial Neural Nets (ANNs) using Robust Optimization (RO). We achieve this through an alternating minimization-maximization procedure, in which the loss of the network is…

机器学习 · 统计学 2018-05-07 Uri Shaham , Yutaro Yamada , Sahand Negahban

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

Adversarial training is a widely-applied approach to training deep neural networks to be robust against adversarial perturbation. However, although adversarial training has achieved empirical success in practice, it still remains unclear…

机器学习 · 计算机科学 2025-02-10 Binghui Li , Yuanzhi Li

Event-based dynamic vision sensors provide very sparse output in the form of spikes, which makes them suitable for low-power applications. Convolutional spiking neural networks model such event-based data and develop their full…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Julian Büchel , Gregor Lenz , Yalun Hu , Sadique Sheik , Martino Sorbaro

Strong adversarial examples are crucial for evaluating and enhancing the robustness of deep neural networks. However, the performance of popular attacks is usually sensitive, for instance, to minor image transformations, stemming from…

机器学习 · 计算机科学 2024-04-01 Zhengwei Fang , Rui Wang , Tao Huang , Liping Jing

Deep neural networks have been shown to perform well in many classical machine learning problems, especially in image classification tasks. However, researchers have found that neural networks can be easily fooled, and they are surprisingly…

计算机视觉与模式识别 · 计算机科学 2019-05-24 Huaxia Wang , Chun-Nam Yu

The widespread adoption of large language models (LLMs) has increased concerns about their robustness. Vulnerabilities in perturbations of tokenisation of the input indicate that models trained with a deterministic canonical tokenisation…

计算与语言 · 计算机科学 2026-04-20 Sophie Steger , Rui Li , Sofiane Ennadir , Anya Sims , Arno Solin , Franz Pernkopf , Martin Trapp

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

机器学习 · 计算机科学 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu