English
Related papers

Related papers: Dynamic Deep Neural Networks: Optimizing Accuracy-…

200 papers

Low precision deep neural network (DNN) training is one of the most effective techniques for boosting DNNs' training efficiency, as it trims down the training cost from the finest bit level. While existing works mostly fix the model…

Machine Learning · Computer Science 2022-03-16 Zhongzhi Yu , Yonggan Fu , Shang Wu , Mengquan Li , Haoran You , Yingyan Lin

Deep neural network (DNN) inference is increasingly being executed on mobile and embedded platforms due to several key advantages in latency, privacy and always-on availability. However, due to limited computing resources, efficient DNN…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Lei Xun , Jonathon Hare , Geoff V. Merrett

We proposed a broad-spectrum diffractive deep neural network (BS-D2NN) framework, which incorporates multi-wavelength channels of input lightfields and performs a parallel phase-only modulation utilizing a layered passive mask architecture.…

Emerging Technologies · Computer Science 2022-02-09 Jiashuo Shi , Yingshi Chen , Xinyu Zhang

For the past couple of decades, numerical optimization has played a central role in addressing wireless resource management problems such as power control and beamformer design. However, optimization algorithms often entail considerable…

Information Theory · Computer Science 2018-09-18 Haoran Sun , Xiangyi Chen , Qingjiang Shi , Mingyi Hong , Xiao Fu , Nicholas D. Sidiropoulos

Inspired by the brain, deep neural networks (DNN) are thought to learn abstract representations through their hierarchical architecture. However, at present, how this happens is not well understood. Here, we demonstrate that DNN learn…

Machine Learning · Computer Science 2015-02-16 Andrew J. R. Simpson

Edge offloading for deep neural networks (DNNs) can be adaptive to the input's complexity by using early-exit DNNs. These DNNs have side branches throughout their architecture, allowing the inference to end earlier in the edge. The branches…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Roberto G. Pacheco , Fernanda D. V. R. Oliveira , Rodrigo S. Couto

Recently, dynamic inference has emerged as a promising way to reduce the computational cost of deep convolutional neural network (CNN). In contrast to static methods (e.g. weight pruning), dynamic inference adaptively adjusts the inference…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Zhihang Yuan , Bingzhe Wu , Zheng Liang , Shiwan Zhao , Weichen Bi , Guangyu Sun

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Neural Networks (NN), although successfully applied to several Artificial Intelligence tasks, are often unnecessarily over-parametrised. In edge/fog computing, this might make their training prohibitive on resource-constrained devices,…

Machine Learning · Computer Science 2022-01-20 Lorenzo Valerio , Franco Maria Nardini , Andrea Passarella , Raffaele Perego

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript, we describe a custom DNN specially designed to solve problems in the RF…

Signal Processing · Electrical Eng. & Systems 2021-09-23 Brian Shevitski , Yijing Watkins , Nicole Man , Michael Girard

Deep neural network (DNN)-based adaptive controllers can be used to compensate for unstructured uncertainties in nonlinear dynamic systems. However, DNNs are also very susceptible to overfitting and co-adaptation. Dropout regularization is…

Systems and Control · Electrical Eng. & Systems 2023-11-01 Saiedeh Akbari , Emily J. Griffis , Omkar Sudhir Patil , Warren E. Dixon

Deep neural networks (DNN) have achieved remarkable success in various fields, including computer vision and natural language processing. However, training an effective DNN model still poses challenges. This paper aims to propose a method…

Machine Learning · Computer Science 2024-07-03 Hejie Ying , Mengmeng Song , Yaohong Tang , Shungen Xiao , Zimin Xiao

Deep Neural Networks (DNNs) are the key to the state-of-the-art machine vision, sensor fusion and audio/video signal processing. Unfortunately, their computation complexity and tight resource constraints on the Edge make them hard to…

Machine Learning · Computer Science 2017-12-05 Ranko Sredojevic , Shaoyi Cheng , Lazar Supic , Rawan Naous , Vladimir Stojanovic

We apply supervised deep neural networks (DNNs) for pricing and calibration of both vanilla and exotic options under both diffusion and pure jump processes with and without stochastic volatility. We train our neural network models under…

Pricing of Securities · Quantitative Finance 2019-02-18 Ali Hirsa , Tugce Karatas , Amir Oskoui

Aiming for the median solution between cyber-intensive optimal power flow (OPF) solutions and subpar local control, this work advocates deciding inverter injection setpoints using deep neural networks (DNNs). Instead of fitting OPF…

Optimization and Control · Mathematics 2020-07-14 Sarthak Gupta , Vassilis Kekatos , Ming Jin

This paper integrates deep neural networks (DNNs) into structural economic models to increase flexibility and capture rich heterogeneity while preserving interpretability. Economic structure and machine learning are complements in empirical…

Econometrics · Economics 2025-04-28 Max H. Farrell , Tengyuan Liang , Sanjog Misra

Deep neural networks (DNN) have been widely used and play a major role in the field of computer vision and autonomous navigation. However, these DNNs are computationally complex and their deployment over resource-constrained platforms is…

Machine Learning · Computer Science 2022-08-01 Mee Seong Im , Venkat R. Dasari

Neural networks are effective function approximators, but hard to train in the reinforcement learning (RL) context mainly because samples are correlated. For years, scholars have got around this by employing experience replay or an…

Machine Learning · Computer Science 2020-05-06 Budi Kurniawan , Peter Vamplew , Michael Papasimeon , Richard Dazeley , Cameron Foale

The inherent diversity of computation types within the deep neural network (DNN) models often requires a variety of specialized units in hardware processors, which limits computational efficiency, increasing both inference latency and power…

Machine Learning · Computer Science 2024-08-21 Ruiqi Sun , Siwei Ye , Jie Zhao , Xin He , Jianzhe Lin , Yiran Li , An Zou

The current work reports an efficient deep neural network (DNN) accelerator where synaptic weight elements are controlled by ferroelectric domain dynamics. An integrated device-to-algorithm framework for benchmarking novel synaptic devices…

Emerging Technologies · Computer Science 2022-10-14 Sayani Majumdar