English
Related papers

Related papers: Partitioning Compute Units in CNN Acceleration for…

200 papers

Random Linear Network Coding (RLNC) has emerged as a powerful tool for robust high-throughput multicast. Projection analysis - a recently introduced technique - shows that the distributed packetized RLNC protocol achieves (order) optimal…

Information Theory · Computer Science 2011-02-17 Bernhard Haeupler , Muriel Médard

The latest trends in high-performance computing systems show an increasing demand on the use of a large scale multicore systems in a efficient way, so that high compute-intensive applications can be executed reasonably well. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-02-25 Juliana M. N. Silva , Cristina Boeres , Lúcia M. A. Drummond , Artur A. Pessoa

In this paper, a scalable neural network hardware architecture for image segmentation is proposed. By sharing the same computing resources, both convolution and deconvolution operations are handled by the same process element array. In…

Signal Processing · Electrical Eng. & Systems 2020-06-02 Lin Bai , Yecheng Lyu , Xinming Huang

In order to satisfy timing constraints, modern real-time applications require massively parallel accelerators such as General Purpose Graphic Processing Units (GPGPUs). Generation after generation, the number of computing clusters made…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-24 Houssam-Eddine Zahaf , Ignacio Sanudo Olmedo , Jayati Singh , Nicola Capodieci , Sebastien Faucou

Security-constrained unit commitment (SCUC) model is used for power system day-ahead scheduling. However, current SCUC model uses a static network to deliver power and meet demand optimally. A dynamic network can provide a lower optimal…

Optimization and Control · Mathematics 2021-12-16 Arun Venkatesh Ramesh , Xingpeng Li , Kory W. Hedman

Neural networks have been widely used, and most networks achieve excellent performance by stacking certain types of basic units. Compared to increasing the depth and width of the network, designing more effective basic units has become an…

Machine Learning · Computer Science 2020-06-05 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

Recently, deep convolutional neural networks have achieved great success for medical image segmentation. However, unlike segmentation of natural images, most medical images such as MRI and CT are volumetric data. In order to make full use…

Image and Video Processing · Electrical Eng. & Systems 2022-02-08 Yichi Zhang , Qingcheng Liao , Le Ding , Jicong Zhang

Many-core neuromorphic systems accelerate Spiking Neural Networks (SNNs), yet their packet-based spike communication can spend substantial traffic and energy repeatedly transmitting destination addresses. This overhead is amplified by the…

Neural and Evolutionary Computing · Computer Science 2026-05-25 Qinghui Xing , Zhuo Chen , Xin Du , Ouwen Jin , Ming Zhang , Pan Lv , Ying Li , Shuiguang Deng , Gang Pan

We resolve the question of optimality for a well-studied packetized implementation of random linear network coding, called PNC. In PNC, in contrast to the classical memoryless setting, nodes store received information in memory to later…

Information Theory · Computer Science 2011-02-18 Bernhard Haeupler , MinJi Kim , Muriel Médard

As recurrent neural networks become larger and deeper, training times for single networks are rising into weeks or even months. As such there is a significant incentive to improve the performance and scalability of these networks. While…

Machine Learning · Computer Science 2016-04-08 Jeremy Appleyard , Tomas Kocisky , Phil Blunsom

Binary Neural Networks (BNNs) are showing tremendous success on realistic image classification tasks. Notably, their accuracy is similar to the state-of-the-art accuracy obtained by full-precision models tailored to edge devices. In this…

Hardware Architecture · Computer Science 2022-12-02 Franyell Silfa , Jose Maria Arnau , Antonio González

Edge computing has emerged as a pivotal technology, offering significant advantages such as low latency, enhanced data security, and reduced reliance on centralized cloud infrastructure. These benefits are crucial for applications requiring…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-24 Tomasz Szydlo , Viacheslav Horbanov , Devki Nandan Jha , Shashikant Ilager , Aleksander Slominski , Rajiv Ranjan

In the era of artificial intelligence, convolutional neural networks (CNNs) are emerging as a powerful technique for computational imaging. They have shown superior quality for reconstructing fine textures from badly-distorted images and…

Neural and Evolutionary Computing · Computer Science 2021-04-20 Chao-Tsung Huang

The computational workload involved in Convolutional Neural Networks (CNNs) is typically out of reach for low-power embedded devices. There are a large number of approximation techniques to address this problem. These methods have…

Machine Learning · Computer Science 2021-02-03 Etienne Dupuis , David Novo , Ian O'Connor , Alberto Bosio

Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained large-scale models or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Chen Zhang , Yinghao Xu , Yujun Shen

Spatially-coupled (SC) codes, known for their threshold saturation phenomenon and low-latency windowed decoding algorithms, are ideal for streaming applications. They also find application in various data storage systems because of their…

Information Theory · Computer Science 2021-01-26 Siyi Yang , Ahmed Hareedy , Shyam Venkatasubramanian , Robert Calderbank , Lara Dolecek

Convolutional neural networks (CNNs) are commonly trained using a fixed spatial image size predetermined for a given model. Although trained on images of aspecific size, it is well established that CNNs can be used to evaluate a wide range…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Elad Hoffer , Berry Weinstein , Itay Hubara , Tal Ben-Nun , Torsten Hoefler , Daniel Soudry

Network coding is known to improve the throughput and the resilience to losses in most network scenarios. In a practical network scenario, however, the accurate modeling of the traffic is often too complex and/or infeasible. The goal is…

Information Theory · Computer Science 2009-08-25 Anoosheh Heidarzadeh , Amir H. Banihashemi

Spiking Neural Networks (SNNs) compute in an event-based matter to achieve a more efficient computation than standard Neural Networks. In SNNs, neuronal outputs (i.e. activations) are not encoded with real-valued activations but with…

Hardware Architecture · Computer Science 2023-08-08 Jan Sommer , M. Akif Özkan , Oliver Keszocze , Jürgen Teich

In the twilight of Moore's law, GPUs and other specialized hardware accelerators have dramatically sped up neural network training. However, earlier stages of the training pipeline, such as disk I/O and data preprocessing, do not run on…

Machine Learning · Computer Science 2020-05-11 Dami Choi , Alexandre Passos , Christopher J. Shallue , George E. Dahl