English
Related papers

Related papers: Hierarchical Multi-task Deep Neural Network Archit…

200 papers

Deep Neural Networks (DNNs) are becoming an important tool in modern computing applications. Accelerating their training is a major challenge and techniques range from distributed algorithms to low-level circuit design. In this survey, we…

Machine Learning · Computer Science 2018-09-18 Tal Ben-Nun , Torsten Hoefler

The rapid advancement of Artificial Intelligence (AI) has introduced Deep Neural Network (DNN)-based tasks to the ecosystem of vehicular networks. These tasks are often computation-intensive, requiring substantial computation resources,…

Machine Learning · Computer Science 2024-06-12 Zhang Liu , Hongyang Du , Junzhe Lin , Zhibin Gao , Lianfen Huang , Seyyedali Hosseinalipour , Dusit Niyato

This work presents an online learning-based control method for improved trajectory tracking of unmanned aerial vehicles using both deep learning and expert knowledge. The proposed method does not require the exact model of the system to be…

Robotics · Computer Science 2019-05-28 Andriy Sarabakha , Erdal Kayacan

Deep Neural Networks (DNNs) training can be difficult due to vanishing and exploding gradients during weight optimization through backpropagation. To address this problem, we propose a general class of Hamiltonian DNNs (H-DNNs) that stem…

Machine Learning · Computer Science 2023-01-02 Clara Lucía Galimberti , Luca Furieri , Liang Xu , Giancarlo Ferrari-Trecate

Deep neural networks (DNNs) are state-of-the-art techniques for solving most computer vision problems. DNNs require billions of parameters and operations to achieve state-of-the-art results. This requirement makes DNNs extremely compute,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Ishmeet Kaur , Adwaita Janardhan Jadhav

The pioneer deep neural networks (DNNs) have emerged to be deeper or wider for improving their accuracy in various applications of artificial intelligence. However, DNNs are often too heavy to deploy in practice, and it is often required to…

Machine Learning · Computer Science 2018-07-10 Hankook Lee , Jinwoo Shin

We propose Trusted Neural Network (TNN) models, which are deep neural network models that satisfy safety constraints critical to the application domain. We investigate different mechanisms for incorporating rule-based knowledge in the form…

Machine Learning · Computer Science 2018-05-21 Shalini Ghosh , Amaury Mercier , Dheeraj Pichapati , Susmit Jha , Vinod Yegneswaran , Patrick Lincoln

Grid maps obtained from fused sensory information are nowadays among the most popular approaches for motion planning for autonomous driving cars. In this paper, we introduce Deep Grid Net (DGN), a deep learning (DL) system designed for…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Liviu Marina , Bogdan Trasnea , Cocias Tiberiu , Andrei Vasilcoi , Florin Moldoveanu , Sorin Grigorescu

As research in deep neural networks advances, deep convolutional networks become promising for autonomous driving tasks. In particular, there is an emerging trend of employing end-to-end neural network models for autonomous driving.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Han Wu , Syed Yunas , Sareh Rowlands , Wenjie Ruan , Johan Wahlstrom

Deep neural networks (DNNs) were shown to facilitate the operation of uplink multiple-input multiple-output (MIMO) receivers, with emerging architectures augmenting modules of classic receiver processing. Current designs consider static…

Information Theory · Computer Science 2024-08-23 Tomer Raviv , Nir Shlezinger

Focusing on the task of point-to-point navigation for an autonomous driving vehicle, we propose a novel deep learning model trained with end-to-end and multi-task learning manners to perform both perception and control tasks simultaneously.…

Robotics · Computer Science 2022-06-23 Oskar Natan , Jun Miura

Highway traffic modeling and forecasting approaches are critical for intelligent transportation systems. Recently, deep-learning-based traffic forecasting methods have emerged as state of the art for a wide range of traffic forecasting…

Machine Learning · Computer Science 2020-04-21 Tanwi Mallick , Prasanna Balaprakash , Eric Rask , Jane Macfarlane

In this paper, we study the linear transport model by adopting the deep learning method, in particular the deep neural network (DNN) approach. While the interest of using DNN to study partial differential equations is arising, here we adapt…

Numerical Analysis · Mathematics 2021-02-19 Zheng Chen , Liu Liu , Lin Mu

Deep neural networks (DNNs) achieve remarkable performance on a wide range of tasks, yet their mathematical analysis remains fragmented: stability and generalization are typically studied in disparate frameworks and on a case-by-case basis.…

Machine Learning · Statistics 2026-01-29 Jonathan Vacher

Developing Intelligent Systems involves artificial intelligence approaches including artificial neural networks. Here, we present a tutorial of Deep Neural Networks (DNNs), and some insights about the origin of the term "deep"; references…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Juan C. Cuevas-Tello , Manuel Valenzuela-Rendon , Juan A. Nolazco-Flores

This paper gives an overview of our ongoing work on the design space exploration of efficient deep neural networks (DNNs). Specifically, we cover two aspects: (1) static architecture design efficiency and (2) dynamic model execution…

Hardware Architecture · Computer Science 2020-11-24 Fuxun Yu , Dimitrios Stamoulis , Di Wang , Dimitrios Lymberopoulos , Xiang Chen

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

This work focuses on designing low complexity hybrid tensor networks by considering trade-offs between the model complexity and practical performance. Firstly, we exploit a low-rank tensor-train deep neural network (TT-DNN) to build an…

Machine Learning · Computer Science 2022-03-14 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Javier Tejedor

Large neural networks are typically trained for a fixed computational budget, creating a rigid trade-off between performance and efficiency that is ill-suited for deployment in resource-constrained or dynamic environments. Existing…

Machine Learning · Computer Science 2026-03-05 Paulius Rauba , Mihaela van der Schaar

In recent years, considerable progress has been made towards a vehicle's ability to operate autonomously. An end-to-end approach attempts to achieve autonomous driving using a single, comprehensive software component. Recent breakthroughs…

Robotics · Computer Science 2019-05-17 Hege Haavaldsen , Max Aasboe , Frank Lindseth