English
Related papers

Related papers: Efficient Processing of Deep Neural Networks: A Tu…

200 papers

Deep neural networks (DNNs) have emerged as key enablers of machine learning. Applying larger DNNs to more diverse applications is an important challenge. The computations performed during DNN training and inference are dominated by…

Machine Learning · Computer Science 2018-12-17 Jeremy Kepner , Vijay Gadepally , Hayden Jananthan , Lauren Milechin , Sid Samsi

Dynamic neural networks (DyNNs) have become viable techniques to enable intelligence on resource-constrained edge devices while maintaining computational efficiency. In many cases, the implementation of DyNNs can be sub-optimal due to its…

Machine Learning · Computer Science 2022-12-08 Halima Bouzidi , Mohanad Odema , Hamza Ouarnoughi , Mohammad Abdullah Al Faruque , Smail Niar

Much of the present-day Artificial Intelligence (AI) utilizes artificial neural networks, which are sophisticated computational models designed to recognize patterns and solve complex problems by learning from data. However, a major…

Machine Learning · Computer Science 2024-06-21 Aditya Datar , Pramit Saha

Deep Neural Networks (DNN) have improved the quality of several non-safety related products in the past years. However, before DNNs should be deployed to safety-critical applications, their robustness needs to be systematically analyzed. A…

Deep neural networks (DNNs) have substantial computational requirements, which greatly limit their performance in resource-constrained environments. Recently, there are increasing efforts on optical neural networks and optical computing…

Machine Learning · Computer Science 2021-04-05 Yingjie Li , Ruiyang Chen , Berardi Sensale Rodriguez , Weilu Gao , Cunxi Yu

Deep neural networks (DNNs) may outperform human brains in complex tasks, but the lack of transparency in their decision-making processes makes us question whether we could fully trust DNNs with high stakes problems. As DNNs' operations…

Machine Learning · Computer Science 2020-03-19 Jung Hoon Lee

As a key technology of enabling Artificial Intelligence (AI) applications in 5G era, Deep Neural Networks (DNNs) have quickly attracted widespread attention. However, it is challenging to run computation-intensive DNN-based tasks on mobile…

Networking and Internet Architecture · Computer Science 2019-10-14 En Li , Liekang Zeng , Zhi Zhou , Xu Chen

Deep Neural Networks (DNNs) have been established as the state-of-the-art algorithm for advanced machine learning applications. Recently, CapsuleNets have improved the generalization ability, as compared to DNNs, due to their…

Machine Learning · Computer Science 2019-04-15 Alberto Marchisio , Muhammad Abdullah Hanif , Mohammad Taghi Teimoori , Muhammad Shafique

Deep Neural Networks (DNNs) have been established as the state-of-the-art algorithm for advanced machine learning applications. Recently proposed by the Google Brain's team, the Capsule Networks (CapsNets) have improved the generalization…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Vojtech Mrazek , Muhammad Abdullah Hanif , Muhammad Shafique

Deep Neural Networks (DNNs) are intensively used to solve a wide variety of complex problems. Although powerful, such systems require manual configuration and tuning. To this end, we view DNNs as configurable systems and propose an…

Machine Learning · Computer Science 2019-04-10 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Recently, deep neural network (DNN) has been widely adopted in the design of intelligent communication systems thanks to its strong learning ability and low testing complexity. However, most current offline DNN-based methods still suffer…

Information Theory · Computer Science 2022-02-08 Jiabao Gao , Caijun Zhong , Geoffrey Ye Li , Zhaoyang Zhang

Neural networks have become the standard model for various computer vision tasks in automated driving including semantic segmentation, moving object detection, depth estimation, visual odometry, etc. The main flavors of neural networks…

Neural and Evolutionary Computing · Computer Science 2019-03-07 Sambit Mohapatra , Heinrich Gotzig , Senthil Yogamani , Stefan Milz , Raoul Zollner

The recent popularity of deep neural networks (DNNs) has generated a lot of research interest in performing DNN-related computation efficiently. However, the primary focus is usually very narrow and limited to (i) inference -- i.e. how to…

Machine Learning · Computer Science 2018-04-17 Hongyu Zhu , Mohamed Akrout , Bojian Zheng , Andrew Pelegris , Amar Phanishayee , Bianca Schroeder , Gennady Pekhimenko

Deep learning has delivered its powerfulness in many application domains, especially in image and speech recognition. As the backbone of deep learning, deep neural networks (DNNs) consist of multiple layers of various types with hundreds to…

Machine Learning · Computer Science 2017-12-14 Sheng Lin , Ning Liu , Mahdi Nazemi , Hongjia Li , Caiwen Ding , Yanzhi Wang , Massoud Pedram

Deep Neural Networks (DNNs) have emerged as the core enabler of many major applications on mobile devices. To achieve high accuracy, DNN models have become increasingly deep with hundreds or even thousands of operator layers, leading to…

Machine Learning · Computer Science 2021-12-02 Wei Niu , Jiexiong Guan , Yanzhi Wang , Gagan Agrawal , Bin Ren

While machine learning is traditionally a resource intensive task, embedded systems, autonomous navigation and the vision of the Internet-of-Things fuel the interest in resource efficient approaches. These approaches require a carefully…

Deep neural networks (DNN) are the state of the art on many engineering problems such as computer vision and audition. A key factor in the success of the DNN is scalability - bigger networks work better. However, the reason for this…

Machine Learning · Computer Science 2015-02-13 Andrew J. R. Simpson

In this paper, we present a novel technique to search for hardware architectures of accelerators optimized for end-to-end training of deep neural networks (DNNs). Our approach addresses both single-device and distributed pipeline and tensor…

Hardware Architecture · Computer Science 2024-04-24 Muhammad Adnan , Amar Phanishayee , Janardhan Kulkarni , Prashant J. Nair , Divya Mahajan

In today's digital age, Convolutional Neural Networks (CNNs), a subset of Deep Learning (DL), are widely used for various computer vision tasks such as image classification, object detection, and image segmentation. There are numerous types…

Machine Learning · Computer Science 2024-02-29 Abolfazl Younesi , Mohsen Ansari , MohammadAmin Fazli , Alireza Ejlali , Muhammad Shafique , Jörg Henkel

In this paper, we present a novel multi-objective hardware-aware neural architecture search (NAS) framework, namely HSCoNAS, to automate the design of deep neural networks (DNNs) with high accuracy but low latency upon target hardware. To…

Machine Learning · Computer Science 2021-03-16 Xiangzhong Luo , Di Liu , Shuo Huai , Weichen Liu