English
Related papers

Related papers: Maximal Brain Damage Without Data or Optimization:…

200 papers

Binary Neural Networks (BNNs) significantly reduce computational complexity and memory usage in machine and deep learning by representing weights and activations with just one bit. However, most existing training algorithms for BNNs rely on…

Machine Learning · Computer Science 2025-12-08 Luca Colombo , Fabrizio Pittorino , Manuel Roveri

Recent advancements in side-channel attacks have revealed the vulnerability of modern Deep Neural Networks (DNNs) to malicious adversarial weight attacks. The well-studied RowHammer attack has effectively compromised DNN performance by…

Hardware Architecture · Computer Science 2024-12-04 Ranyang Zhou , Jacqueline T. Liu , Sabbir Ahmed , Shaahin Angizi , Adnan Siraj Rakin

There has been a significant recent surge in deep neural network (DNN) techniques. Most of the existing DNN techniques have restricted model formats/assumptions. To overcome their limitations, we propose the nonparametric transformation…

Methodology · Statistics 2024-10-28 Tong Wang , Shunqin Zhang , Sanguo Zhang , Jian Huang , Shuangge Ma

Deep neural networks (DNN) consist of layers of neurons interconnected by synaptic weights. A high bit-precision in weights is generally required to guarantee high accuracy in many applications. Minimizing error accumulation between layers…

In this paper, we describe a Bayesian deep neural network (DNN) for predicting FreeSurfer segmentations of structural MRI volumes, in minutes rather than hours. The network was trained and evaluated on a large dataset (n = 11,480), obtained…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Patrick McClure , Nao Rho , John A. Lee , Jakub R. Kaczmarzyk , Charles Zheng , Satrajit S. Ghosh , Dylan Nielson , Adam G. Thomas , Peter Bandettini , Francisco Pereira

The state-of-the-art hardware platforms for training Deep Neural Networks (DNNs) are moving from traditional single precision (32-bit) computations towards 16 bits of precision -- in large part due to the high energy efficiency and smaller…

Machine Learning · Computer Science 2018-12-20 Naigang Wang , Jungwook Choi , Daniel Brand , Chia-Yu Chen , Kailash Gopalakrishnan

Deep neural networks (DNNs) have become powerful tools for modeling complex data structures through sequentially integrating simple functions in each hidden layer. In survival analysis, recent advances of DNNs primarily focus on enhancing…

Machine Learning · Statistics 2025-03-26 Changhui Yuan , Shishun Zhao , Shuwei Li , Xinyuan Song , Zhao Chen

Deep neural networks (DNNs) are becoming increasingly deeper, wider, and non-linear due to the growing demands on prediction accuracy and analysis quality. When training a DNN model, the intermediate activation data must be saved in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Sian Jin , Guanpeng Li , Shuaiwen Leon Song , Dingwen Tao

Deep neural networks (DNN) have achieved remarkable success in various fields, including computer vision and natural language processing. However, training an effective DNN model still poses challenges. This paper aims to propose a method…

Machine Learning · Computer Science 2024-07-03 Hejie Ying , Mengmeng Song , Yaohong Tang , Shungen Xiao , Zimin Xiao

Shift neural networks reduce computation complexity by removing expensive multiplication operations and quantizing continuous weights into low-bit discrete values, which are fast and energy efficient compared to conventional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Xinlin Li , Bang Liu , Yaoliang Yu , Wulong Liu , Chunjing Xu , Vahid Partovi Nia

Deep Neural Networks (DNNs) are powerful algorithms that have been proven capable of extracting non-Gaussian information from weak lensing (WL) data sets. Understanding which features in the data determine the output of these nested,…

Cosmology and Nongalactic Astrophysics · Physics 2021-04-14 José Manuel Zorrilla Matilla , Manasi Sharma , Daniel Hsu , Zoltán Haiman

When the training data are maliciously tampered, the predictions of the acquired deep neural network (DNN) can be manipulated by an adversary known as the Trojan attack (or poisoning backdoor attack). The lack of robustness of DNNs against…

Machine Learning · Computer Science 2020-08-03 Ren Wang , Gaoyuan Zhang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong , Meng Wang

Despite the rapid progress of neuromorphic computing, the inadequate depth and the resulting insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and…

Neural and Evolutionary Computing · Computer Science 2022-02-18 Yifan Hu , Yujie Wu , Lei Deng , Guoqi Li

Deep neural networks (DNNs) have demonstrated exceptional performance across various image segmentation tasks. However, the process of preparing datasets for training segmentation DNNs is both labor-intensive and costly, as it typically…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yixin Zhang , Shen Zhao , Hanxue Gu , Maciej A. Mazurowski

Deep neural networks (DNN) have shown promises in the lesion segmentation of multiple sclerosis (MS) from multicontrast MRI including T1, T2, proton density (PD) and FLAIR sequences. However, one challenge in deploying such networks into…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Yushan Feng , Huitong Pan , Craig Meyer , Xue Feng

Deep neural network (DNN) accelerators received considerable attention in past years due to saved energy compared to mainstream hardware. Low-voltage operation of DNN accelerators allows to further reduce energy consumption significantly,…

Machine Learning · Computer Science 2021-04-12 David Stutz , Nandhini Chandramoorthy , Matthias Hein , Bernt Schiele

In recent times, deep neural networks (DNNs) have been successfully adopted for various applications. Despite their notable achievements, it has become evident that DNNs are vulnerable to sophisticated adversarial attacks, restricting their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Alik Pramanick , Mayank Bansal , Utkarsh Srivastava , Suklav Ghosh , Arijit Sur

Deep neural networks (DNNs) are ubiquitous in computer vision and natural language processing, but suffer from high inference cost. This problem can be addressed by quantization, which consists in converting floating point operations into a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Edouard Yvinec , Arnaud Dapgony , Matthieu Cord , Kevin Bailly

Deep neural networks (DNNs) are vulnerable to adversarial examples and other data perturbations. Especially in safety critical applications of DNNs, it is therefore crucial to detect misclassified samples. The current state-of-the-art…

Machine Learning · Computer Science 2020-04-21 Julia Lust , Alexandru Paul Condurache

Deep neural networks (DNNs) are vulnerable to maliciously generated adversarial examples. These examples are intentionally designed by making imperceptible perturbations and often mislead a DNN into making an incorrect prediction. This…

Machine Learning · Computer Science 2018-10-10 Mengchen Liu , Shixia Liu , Hang Su , Kelei Cao , Jun Zhu