English
Related papers

Related papers: Thanks for Nothing: Predicting Zero-Valued Activat…

200 papers

Convolutional Neural Networks (CNNs) are extremely efficient, since they exploit the inherent translation-invariance of natural images. However, translation is just one of a myriad of useful spatial transformations. Can the same efficiency…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 João F. Henriques , Andrea Vedaldi

The high accuracy of detector simulation is crucial for modern particle physics experiments. However, this accuracy comes with a high computational cost, which will be exacerbated by the large datasets and complex detector upgrades…

Lattice gauge-equivariant convolutional neural networks (L-CNNs) can be used to form arbitrarily shaped Wilson loops and can approximate any gauge-covariant or gauge-invariant function on the lattice. Here we use L-CNNs to describe fixed…

High Energy Physics - Lattice · Physics 2024-01-22 Kieran Holland , Andreas Ipp , David I. Müller , Urs Wenger

Deep neural networks (DNNs) can be made hardware-efficient by reducing the numerical precision of the weights and activations of the network and by improving the network's resilience to noise. However, this gain in efficiency often comes at…

The current trend of applying transfer learning from convolutional neural networks (CNNs) trained on large datasets can be an overkill when the target application is a custom and delimited problem, with enough data to train a network from…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Andrea Mattia Garavagno , Daniele Leonardis , Antonio Frisoli

The XENON1T experiment uses a time projection chamber (TPC) with liquid Xenon to search for Weakly Interacting Massive Particles (WIMPs), a proposed Dark Matter particle, via direct detection. As this experiment relies on capturing rare…

High Energy Physics - Phenomenology · Physics 2020-08-03 Charanjit K. Khosa , Lucy Mars , Joel Richards , Veronica Sanz

Convolutional neural networks (CNNs) are a popular choice of model for tasks in computer vision. When CNNs are made with many layers, resulting in a deep neural network, skip connections may be added to create an easier gradient…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Johnny Joyce , Jan Verschelde

In this work we describe a Convolutional Neural Network (CNN) to accurately predict the scene illumination. Taking image patches as input, the CNN works in the spatial domain without using hand-crafted features that are employed by most…

Computer Vision and Pattern Recognition · Computer Science 2015-04-20 Simone Bianco , Claudio Cusano , Raimondo Schettini

Millimeter-wave radars are being increasingly integrated into commercial vehicles to support new advanced driver-assistance systems by enabling robust and high-performance object detection, localization, as well as recognition - a key…

Signal Processing · Electrical Eng. & Systems 2022-05-02 Xiangyu Gao , Guanbin Xing , Sumit Roy , Hui Liu

Training convolutional neural networks (CNNs) with back-propagation (BP) is time-consuming and resource-intensive particularly in view of the need to visit the dataset multiple times. In contrast, analytic learning attempts to obtain the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Huiping Zhuang , Zhiping Lin , Yimin Yang , Kar-Ann Toh

Binary Convolutional Neural Networks (CNNs) can significantly reduce the number of arithmetic operations and the size of memory storage, which makes the deployment of CNNs on mobile or embedded systems more promising. However, the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Baozhou Zhu , Zaid Al-Ars , Wei Pan

In modern artificial intelligence, convolutional neural networks (CNNs) have become a cornerstone for visual and perceptual tasks. However, their implementation on conventional electronic hardware faces fundamental bottlenecks in speed and…

The Convolutional Neural Network (CNN) is a widely used deep learning architecture for computer vision. However, its black box nature makes it difficult to interpret the behavior of the model. To mitigate this issue, AI practitioners have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Seok-Yong Byun , Wonju Lee

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Conventional deep convolutional neural networks (CNNs) apply convolution operators uniformly in space across all feature maps for hundreds of layers - this incurs a high computational cost for real-time applications. For many problems such…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mengye Ren , Andrei Pokrovsky , Bin Yang , Raquel Urtasun

To reduce the computational cost of convolutional neural networks (CNNs) on resource-constrained devices, structured pruning approaches have shown promise in lowering floating-point operations (FLOPs) without substantial drops in accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Lukas Meiner , Jens Mehnert , Alexandru Paul Condurache

We show that, during inference with Convolutional Neural Networks (CNNs), more than 2x to $8x ineffectual work can be exposed if instead of targeting those weights and activations that are zero, we target different combinations of value…

Neural and Evolutionary Computing · Computer Science 2018-03-13 Alberto Delmas , Patrick Judd , Dylan Malone Stuart , Zissis Poulos , Mostafa Mahmoud , Sayeh Sharify , Milos Nikolic , Andreas Moshovos

In modern communication systems operating with Orthogonal Frequency-Division Multiplexing (OFDM), channel estimation requires minimal complexity with one-tap equalizers. However, this depends on cyclic prefixes, which must be sufficiently…

Information Theory · Computer Science 2024-08-20 Heitor dos Santos Sousa , Jonathan Aguiar Soares , Kayol Soares Mayer , Dalton Soares Arantes

Complex-valued neural networks (CVNNs) are a powerful modeling tool for domains where data can be naturally interpreted in terms of complex numbers. However, several analytical properties of the complex domain (e.g., holomorphicity) make…

Neural and Evolutionary Computing · Computer Science 2018-02-23 Simone Scardapane , Steven Van Vaerenbergh , Amir Hussain , Aurelio Uncini

Convolutional neural networks (CNNs) are similar to "ordinary" neural networks in the sense that they are made up of hidden layers consisting of neurons with "learnable" parameters. These neurons receive inputs, performs a dot product, and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Abien Fred Agarap