English
Related papers

Related papers: Inverted Activations: Reducing Memory Footprint in…

200 papers

General purpose computing systems are used for a large variety of applications. Extensive supports for flexibility in these systems limit their energy efficiencies. Neural networks, including deep networks, are widely used for signal…

Machine Learning · Computer Science 2016-06-16 Raqibul Hasan , Tarek Taha

Training deep learning models can be computationally expensive. Prior works have shown that increasing the batch size can potentially lead to better overall throughput. However, the batch size is frequently limited by the accelerator memory…

Machine Learning · Computer Science 2023-01-25 Muralidhar Andoorveedu , Zhanda Zhu , Bojian Zheng , Gennady Pekhimenko

We present an alternative layer to convolution layers in convolutional neural networks (CNNs). Our approach reduces the complexity of convolutions by replacing it with binary decisions. Those binary decisions are used as indexes to…

Machine Learning · Computer Science 2020-02-12 Wolfgang Fuhl , Gjergji Kasneci , Wolfgang Rosenstiel , Enkelejda Kasneci

Factors that limit the size of the input and output of a neural network include memory requirements for the network states/activations to compute gradients, as well as memory for the convolutional kernels or other weights. The memory…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Bas Peters , Eldad Haber , Keegan Lensink

With increasing scale in model and dataset size, the training of deep neural networks becomes a massive computational burden. One approach to speed up the training process is Selective Backprop. For this approach, we perform a forward pass…

Machine Learning · Computer Science 2023-12-11 Lukas Balles , Cedric Archambeau , Giovanni Zappella

While bigger and deeper neural network architectures continue to advance the state-of-the-art for many computer vision tasks, real-world adoption of these networks is impeded by hardware and speed constraints. Conventional model compression…

Machine Learning · Computer Science 2017-12-19 Anubhav Ashok , Nicholas Rhinehart , Fares Beainy , Kris M. Kitani

Traditional von Neumann architecture based processors become inefficient in terms of energy and throughput as they involve separate processing and memory units, also known as~\textit{memory wall}. The memory wall problem is further…

Signal Processing · Electrical Eng. & Systems 2020-05-20 Abhash Kumar , Jawar Singh , Sai Manohar Beeraka , Bharat Gupta

This work aims to help resolve the two main stumbling blocks in the application of Deep Neural Networks (DNNs), that is, the exceedingly large number of trainable parameters and their physical interpretability. This is achieved through a…

Machine Learning · Computer Science 2020-01-07 Giuseppe G. Calvi , Ahmad Moniri , Mahmoud Mahfouz , Qibin Zhao , Danilo P. Mandic

Recent advances in deep neural networks (DNNs) owe their success to training algorithms that use backpropagation and gradient-descent. Backpropagation, while highly effective on von Neumann architectures, becomes inefficient when scaling to…

Neural and Evolutionary Computing · Computer Science 2019-05-10 Brian Crafton , Abhinav Parihar , Evan Gebhardt , Arijit Raychowdhury

TensorDash is a hardware level technique for enabling data-parallel MAC units to take advantage of sparsity in their input operand streams. When used to compose a hardware accelerator for deep learning, TensorDash can speedup the training…

Hardware Architecture · Computer Science 2022-03-28 Mostafa Mahmoud , Isak Edo , Ali Hadi Zadeh , Omar Mohamed Awad , Gennady Pekhimenko , Jorge Albericio , Andreas Moshovos

Decompositions of tensors into factor matrices, which interact through a core tensor, have found numerous applications in signal processing and machine learning. A more general tensor model which represents data as an ordered network of…

Numerical Analysis · Computer Science 2016-09-30 Anh-Huy Phan , Andrzej Cichocki , Andre Uschmajew , Petr Tichavsky , George Luta , Danilo Mandic

Fine-tuning pretrained large models to downstream tasks is an important problem, which however suffers from huge memory overhead due to large-scale parameters. This work strives to reduce memory overhead in fine-tuning from perspectives of…

Machine Learning · Computer Science 2024-06-25 Yuchen Yang , Yingdong Shi , Cheems Wang , Xiantong Zhen , Yuxuan Shi , Jun Xu

Inference efficiency is the predominant consideration in designing deep learning accelerators. Previous work mainly focuses on skipping zero values to deal with remarkable ineffectual computation, while zero bits in non-zero values, as…

Machine Learning · Computer Science 2018-11-19 Hang Lu , Xin Wei , Ning Lin , Guihai Yan , and Xiaowei Li

The residual loss in Physics-Informed Neural Networks (PINNs) alters the simple recursive relation of layers in a feed-forward neural network by applying a differential operator, resulting in a loss landscape that is inherently different…

Machine Learning · Computer Science 2024-06-14 Nima Hosseini Dashtbayaz , Ghazal Farhani , Boyu Wang , Charles X. Ling

Despite the recent success of deep learning models in numerous applications, their widespread use on mobile devices is seriously impeded by storage and computational requirements. In this paper, we propose a novel network compression method…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Zhisheng Zhong , Fangyin Wei , Zhouchen Lin , Chao Zhang

We replace the output layer of deep neural nets, typically the softmax function, by a novel interpolating function. And we propose end-to-end training and testing algorithms for this new architecture. Compared to classical neural nets with…

Machine Learning · Computer Science 2018-06-19 Bao Wang , Xiyang Luo , Zhen Li , Wei Zhu , Zuoqiang Shi , Stanley J. Osher

Deep neural networks (DNN) can be applied at the post-processing stage for the improvement of the results of quantum computations on noisy intermediate-scale quantum (NISQ) processors. Here, we propose a method based on this idea, which is…

Quantum Physics · Physics 2022-09-09 A. A. Zhukov , W. V. Pogosov

Deep neural networks have dramatically advanced the state of the art for many areas of machine learning. Recently they have been shown to have a remarkable ability to generate highly complex visual artifacts such as images and text rather…

Computer Vision and Pattern Recognition · Computer Science 2016-07-08 Andrey Zhmoginov , Mark Sandler

With the growing significance of graphs as an effective representation of data in numerous applications, efficient graph analysis using modern machine learning is receiving a growing level of attention. Deep learning approaches often…

When training neural networks with custom objectives, such as ranking losses and shortest-path losses, a common problem is that they are, per se, non-differentiable. A popular approach is to continuously relax the objectives to provide…

Machine Learning · Computer Science 2024-10-28 Felix Petersen , Christian Borgelt , Tobias Sutter , Hilde Kuehne , Oliver Deussen , Stefano Ermon