English
Related papers

Related papers: Designing DNNs for a trade-off between robustness …

200 papers

When dealing with deep neural network (DNN) applications on edge devices, continuously updating the model is important. Although updating a model with real incoming data is ideal, using all of them is not always feasible due to limits, such…

Machine Learning · Computer Science 2023-03-23 Yuya Senzaki , Christian Hamelain

End-to-end performance estimation and measurement of deep neural network (DNN) systems become more important with increasing complexity of DNN systems consisting of hardware and software components. The methodology proposed in this paper…

Machine Learning · Computer Science 2019-11-19 Michael J. Klaiber , Sebastian Vogel , Axel Acosta , Robert Korn , Leonardo Ecco , Kristine Back , Andre Guntoro , Ingo Feldner

To shift the computational burden from real-time to offline in delay-critical power systems applications, recent works entertain the idea of using a deep neural network (DNN) to predict the solutions of the AC optimal power flow (AC-OPF)…

Optimization and Control · Mathematics 2021-11-12 Manish K. Singh , Vassilis Kekatos , Georgios B. Giannakis

A trend towards energy-efficiency, security and privacy has led to a recent focus on deploying DNNs on microcontrollers. However, limits on compute and memory resources restrict the size and the complexity of the ML models deployable in…

Machine Learning · Computer Science 2020-10-19 Fernando García-Redondo , Shidhartha Das , Glen Rosendale

A wide range of practically important problems is nowadays efficiently solved using artificial neural networks. This gave momentum to intensive development of their optical implementations, among which, the so-called diffractive neural…

Deep learning (DL) is characterised by its dynamic nature, with new deep neural network (DNN) architectures and approaches emerging every few years, driving the field's advancement. At the same time, the ever-increasing use of mobile…

Machine Learning · Computer Science 2023-07-25 Ioannis Panopoulos , Sokratis Nikolaidis , Stylianos I. Venieris , Iakovos S. Venieris

Fault-tolerant deep learning accelerator is the basis for highly reliable deep learning processing and critical to deploy deep learning in safety-critical applications such as avionics and robotics. Since deep learning is known to be…

Hardware Architecture · Computer Science 2023-12-22 Qing Zhang , Cheng Liu , Bo Liu , Haitong Huang , Ying Wang , Huawei Li , Xiaowei Li

Miniaturized autonomous unmanned aerial vehicles (UAVs) are gaining popularity due to their small size, enabling new tasks such as indoor navigation or people monitoring. Nonetheless, their size and simple electronics pose severe challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Matteo Risso , Francesco Daghero , Beatrice Alessandra Motetti , Daniele Jahier Pagliari , Enrico Macii , Massimo Poncino , Alessio Burrello

Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models…

Machine Learning · Computer Science 2020-02-21 Valentin Radu , Kuba Kaszyk , Yuan Wen , Jack Turner , Jose Cano , Elliot J. Crowley , Bjorn Franke , Amos Storkey , Michael O'Boyle

Analog hardware implemented deep learning models are promising for computation and energy constrained systems such as edge computing devices. However, the analog nature of the device and the associated many noise sources will cause changes…

Machine Learning · Computer Science 2020-12-18 Omobayode Fagbohungbe , Lijun Qian

Deep learning models are increasingly deployed in safety-critical tasks where predictions must satisfy hard constraints, such as physical laws, fairness requirements, or safety limits. However, standard architectures lack built-in…

Machine Learning · Computer Science 2025-11-26 Gonzalo E. Constante-Flores , Hao Chen , Can Li

This paper presents a dynamic network rewiring (DNR) method to generate pruned deep neural network (DNN) models that are robust against adversarial attacks yet maintain high accuracy on clean images. In particular, the disclosed DNR method…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Souvik Kundu , Mahdi Nazemi , Peter A. Beerel , Massoud Pedram

Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks. A range of defense methods have been proposed to train adversarially robust DNNs, among which adversarial training has demonstrated promising results. However,…

Machine Learning · Computer Science 2022-01-25 Hanxun Huang , Yisen Wang , Sarah Monazam Erfani , Quanquan Gu , James Bailey , Xingjun Ma

Deep neural networks (DNNs), the agents of deep learning (DL), require a massive number of parallel/sequential operations, which makes it difficult to comprehend them and impedes proper diagnosis. Without better knowledge of DNNs' internal…

Machine Learning · Computer Science 2024-11-19 Jung Hoon Lee , Sujith Vijayan

Soft errors in large VLSI circuits pose dramatic influence on computing- and memory-intensive neural network (NN) processing. Understanding the influence of soft errors on NNs is critical to protect against soft errors for reliable NN…

Machine Learning · Computer Science 2022-10-13 Haitong Huang , Xinghua Xue , Cheng Liu , Ying Wang , Tao Luo , Long Cheng , Huawei Li , Xiaowei Li

Deep neural networks (DNNs) have become an enabling component for a myriad of artificial intelligence applications. DNNs have shown sometimes superior performance, even compared to humans, in cases such as self-driving, health applications,…

Neural and Evolutionary Computing · Computer Science 2023-07-12 Ghada Alsuhli , Vasileios Sakellariou , Hani Saleh , Mahmoud Al-Qutayri , Baker Mohammad , Thanos Stouraitis

Machine learning systems based on deep neural networks (DNNs) have gained mainstream adoption in many applications. Recently, however, DNNs are shown to be vulnerable to adversarial example attacks with slight perturbations on the inputs.…

Machine Learning · Computer Science 2018-12-10 Bo Luo , Min Li , Yu Li , Qiang Xu

Model compression techniques allow to significantly reduce the computational cost associated with data processing by deep neural networks with only a minor decrease in average accuracy. Simultaneously, reducing the model size may have a…

Machine Learning · Computer Science 2021-09-28 Sebastian Cygert , Andrzej Czyżewski

We propose a reconfigurable hardware architecture for deep neural networks (DNNs) capable of online training and inference, which uses algorithmically pre-determined, structured sparsity to significantly lower memory and computational…

Neural and Evolutionary Computing · Computer Science 2017-11-07 Sourya Dey , Yinan Shao , Keith M. Chugg , Peter A. Beerel

In recent years, advances in deep learning have resulted in unprecedented leaps in diverse tasks spanning from speech and object recognition to context awareness and health monitoring. As a result, an increasing number of AI-enabled…

Machine Learning · Computer Science 2019-05-20 Mario Almeida , Stefanos Laskaridis , Ilias Leontiadis , Stylianos I. Venieris , Nicholas D. Lane