English
Related papers

Related papers: Interleaver Design for Deep Neural Networks

200 papers

Deep neural networks (DNN) have achieved unprecedented performance in computer-vision tasks almost ubiquitously in business, technology, and science. While substantial efforts are made to engineer highly accurate architectures and provide…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Sumedha Singla

Balancing mutually diverging performance metrics, such as end-to-end latency, accuracy, and device energy consumption, is a challenging undertaking for deep neural network (DNN) inference in Just-in-Time edge environments that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-03 Motahare Mounesan , Xiaojie Zhang , Saptarshi Debroy

Deep neural networks (DNNs) must cater to a variety of users with different performance needs and budgets, leading to the costly practice of training, storing, and maintaining numerous user/task-specific models. There are solutions in the…

Translating neural networks from theory to clinical practice has unique challenges, specifically in the field of neuroimaging. In this paper, we present DeepNeuro, a deep learning framework that is best-suited to putting deep learning…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Andrew Beers , James Brown , Ken Chang , Katharina Hoebel , Elizabeth Gerstner , Bruce Rosen , Jayashree Kalpathy-Cramer

Emerging research in edge devices and micro-controller units (MCU) enables on-device computation of Deep Learning Training and Inferencing tasks. More recently, contemporary trends focus on making the Deep Neural Net (DNN) Models runnable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Ziliang Zhang

We present a novel framework for applying deep neural networks (DNN) to soft decoding of linear codes at arbitrary block lengths. Unlike other approaches, our framework allows unconstrained DNN design, enabling the free application of…

Information Theory · Computer Science 2018-02-27 Amir Bennatan , Yoni Choukroun , Pavel Kisilev

Deep Neural Networks (DNNs) are everywhere, frequently performing a fairly complex task that used to be unimaginable for machines to carry out. In doing so, they do a lot of decision making which, depending on the application, may be…

Machine Learning · Computer Science 2022-11-17 Avriti Chauhan , Mohammad Afzal , Hrishikesh Karmarkar , Yizhak Elboher , Kumar Madhukar , Guy Katz

Deep neural networks (DNNs) have achieved unprecedented success in the field of artificial intelligence (AI), including computer vision, natural language processing and speech recognition. However, their superior performance comes at the…

Machine Learning · Computer Science 2022-04-26 Han Cai , Ji Lin , Yujun Lin , Zhijian Liu , Haotian Tang , Hanrui Wang , Ligeng Zhu , Song Han

Classic algorithms and machine learning systems like neural networks are both abundant in everyday life. While classic computer science algorithms are suitable for precise execution of exactly defined tasks such as finding the shortest path…

Machine Learning · Computer Science 2022-09-02 Felix Petersen

In the past few years, deep learning (DL) techniques have been introduced for designing sparse arrays. These methods offer the advantages of feature engineering and low prediction-stage complexity, which is helpful in tackling the…

Signal Processing · Electrical Eng. & Systems 2023-08-10 Kumar Vijay Mishra , Ahmet M. Elbir , Koichi Ichige

Over the last five years Deep Neural Nets have offered more accurate solutions to many problems in speech recognition, and computer vision, and these solutions have surpassed a threshold of acceptability for many applications. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Forrest Iandola , Kurt Keutzer

Deep Neural Networks (DNNs) have revolutionized a wide range of industries, from healthcare and finance to automotive, by offering unparalleled capabilities in data analysis and decision-making. Despite their transforming impact, DNNs face…

Machine Learning · Computer Science 2024-02-08 Zhenyu Liu , Garrett Gagnon , Swagath Venkataramani , Liu Liu

Learning predictive models from observations using deep neural networks (DNNs) is a promising new approach to many real-world planning and control problems. However, common DNNs are too unstructured for effective planning, and current…

Robotics · Computer Science 2023-12-21 Ziang Liu , Genggeng Zhou , Jeff He , Tobia Marcucci , Li Fei-Fei , Jiajun Wu , Yunzhu Li

Sparsity has become popular in machine learning, because it can save computational resources, facilitate interpretations, and prevent overfitting. In this paper, we discuss sparsity in the framework of neural networks. In particular, we…

Machine Learning · Computer Science 2020-06-30 Mohamed Hebiri , Johannes Lederer

Sparse Neural Networks (SNNs) have emerged as powerful tools for efficient feature selection. Leveraging the dynamic sparse training (DST) algorithms within SNNs has demonstrated promising feature selection capabilities while drastically…

Designing deep learning models for highly-constrained hardware would allow imbuing many edge devices with intelligence. Microcontrollers (MCUs) are an attractive platform for building smart devices due to their low cost, wide availability,…

Machine Learning · Computer Science 2020-03-04 Edgar Liberis , Nicholas D. Lane

Deep neural networks (DNN) have been widely used and play a major role in the field of computer vision and autonomous navigation. However, these DNNs are computationally complex and their deployment over resource-constrained platforms is…

Machine Learning · Computer Science 2022-08-01 Mee Seong Im , Venkat R. Dasari

Advanced deep neural networks (DNNs), designed by either human or AutoML algorithms, are growing increasingly complex. Diverse operations are connected by complicated connectivity patterns, e.g., various types of skip connections. Those…

Machine Learning · Computer Science 2022-10-13 Wuyang Chen , Wei Huang , Xinyu Gong , Boris Hanin , Zhangyang Wang

Sparse neural networks are important for achieving better generalization and enhancing computation efficiency. This paper proposes a novel learning approach to obtain sparse fully connected layers in neural networks (NNs) automatically. We…

Machine Learning · Computer Science 2021-04-28 Mengqiao Han , Xiabi Liu , Zhaoyang Hai , Zhengwen Li

With the advancement in computing power over last decades, deep neural networks (DNN), consisting of two or more hidden layers with large number of nodes, are being suggested as an alternate to commonly used single-hidden-layer neural…

Neural and Evolutionary Computing · Computer Science 2019-10-10 Mahesh Pal