English
Related papers

Related papers: Dense Associative Memory is Robust to Adversarial …

200 papers

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jindong Gu , Xiaojun Jia , Pau de Jorge , Wenqain Yu , Xinwei Liu , Avery Ma , Yuan Xun , Anjun Hu , Ashkan Khakzar , Zhijiang Li , Xiaochun Cao , Philip Torr

Recently, deep residual networks have been successfully applied in many computer vision and natural language processing tasks, pushing the state-of-the-art performance with deeper and wider architectures. In this work, we interpret deep…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Bo Chang , Lili Meng , Eldad Haber , Lars Ruthotto , David Begert , Elliot Holtham

One of the fundamental limitations of Deep Neural Networks (DNN) is its inability to acquire and accumulate new cognitive capabilities. When some new data appears, such as new object classes that are not in the prescribed set of objects…

Machine Learning · Computer Science 2021-11-23 Xinyu Wei , Biing-Hwang Fred Juang , Ouya Wang , Shenglong Zhou , Geoffrey Ye Li

Neural Architecture Search (NAS) is increasingly popular to automatically explore the accuracy versus computational complexity trade-off of Deep Learning (DL) architectures. When targeting tiny edge devices, the main challenge for DL…

Machine Learning · Computer Science 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari

Deep Neural Network (DNN) are vulnerable to adversarial attacks. As a countermeasure, adversarial training aims to achieve robustness based on the min-max optimization problem and it has shown to be one of the most effective defense…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Yaxin Li , Xiaorui Liu , Han Xu , Wentao Wang , Jiliang Tang

Deep neural network (DNN) models have demonstrated impressive performance in various domains, yet their application in cognitive neuroscience is limited due to their lack of interpretability. In this study we employ two structurally…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Murat Kucukosmanoglu , Javier O. Garcia , Justin Brooks , Kanika Bansal

Deep learning networks excel at classification, yet identifying minimal architectures that reliably solve a task remains challenging. We present a computational methodology for systematically exploring and analyzing the relationships among…

Machine Learning · Computer Science 2026-01-27 Ziwei Zheng , Huizhi Liang , Vaclav Snasel , Vito Latora , Panos Pardalos , Giuseppe Nicosia , Varun Ojha

Adversarial examples, generated by adding small but intentionally imperceptible perturbations to normal examples, can mislead deep neural networks (DNNs) to make incorrect predictions. Although much work has been done on both adversarial…

Human-Computer Interaction · Computer Science 2020-01-29 Kelei Cao , Mengchen Liu , Hang Su , Jing Wu , Jun Zhu , Shixia Liu

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

Machine Learning · Computer Science 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

Various architectures (such as GoogLeNets, ResNets, and DenseNets) have been proposed. However, the existing networks usually suffer from either redundancy of convolutional layers or insufficient utilization of parameters. To handle these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Zhiyu Zhu , Zhen-Peng Bian , Junhui Hou , Yi Wang , Lap-Pui Chau

Deep Learning (DL) has shown potential in accelerating Magnetic Resonance Image acquisition and reconstruction. Nevertheless, there is a dearth of tailored methods to guarantee that the reconstruction of small features is achieved with high…

Image and Video Processing · Electrical Eng. & Systems 2021-04-28 Francesco Calivá , Kaiyang Cheng , Rutwik Shah , Valentina Pedoia

Outcomes with a natural order commonly occur in prediction tasks and often the available input data are a mixture of complex data like images and tabular predictors. Deep Learning (DL) models are state-of-the-art for image classification…

Machine Learning · Statistics 2021-04-21 Lucas Kook , Lisa Herzog , Torsten Hothorn , Oliver Dürr , Beate Sick

Neurons in real brains are enormously complex computational units. Among other things, they're responsible for transforming inbound electro-chemical vectors into outbound action potentials, updating the strengths of intermediate synapses,…

Artificial Intelligence · Computer Science 2020-11-16 Blake Camp , Jaya Krishna Mandivarapu , Rolando Estrada

Neural Additive Models (NAMs) have recently demonstrated promising predictive performance while maintaining interpretability. However, their capacity is limited to capturing only first-order feature interactions, which restricts their…

Machine Learning · Computer Science 2025-11-17 Minkyu Kim , Hyun-Soo Choi , Jinho Kim

Despite achieving remarkable performance on many image classification tasks, state-of-the-art machine learning (ML) classifiers remain vulnerable to small input perturbations. Especially, the existence of adversarial examples raises…

Machine Learning · Computer Science 2020-02-06 David Mickisch , Felix Assion , Florens Greßner , Wiebke Günther , Mariele Motta

DNN is presenting human-level performance for many complex intelligent tasks in real-world applications. However, it also introduces ever-increasing security concerns. For example, the emerging adversarial attacks indicate that even very…

Machine Learning · Computer Science 2018-03-21 Qi Liu , Tao Liu , Zihao Liu , Yanzhi Wang , Yier Jin , Wujie Wen

Since the emergence of Deep Neural Networks (DNNs) as a prominent technique in the field of computer vision, the ImageNet classification challenge has played a major role in advancing the state-of-the-art. While accuracy figures have…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Alfredo Canziani , Adam Paszke , Eugenio Culurciello

Deep neural networks (DNNs) depend on the storage of a large number of parameters, which consumes an important portion of the energy used during inference. This paper considers the case where the energy usage of memory elements can be…

Machine Learning · Computer Science 2019-12-24 Sébastien Henwood , François Leduc-Primeau , Yvon Savaria

Deep Neural Networks (DNNs) are commonly used for various traffic analysis problems, such as website fingerprinting and flow correlation, as they outperform traditional (e.g., statistical) techniques by large margins. However, deep neural…

Cryptography and Security · Computer Science 2020-02-18 Milad Nasr , Alireza Bahramali , Amir Houmansadr