中文
相关论文

相关论文: How to Train your DNN: The Network Operator Editio…

200 篇论文

Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch learning setting, which requires the entire training data to be made available prior to the learning task. This is not scalable for many real-world scenarios…

机器学习 · 计算机科学 2017-11-13 Doyen Sahoo , Quang Pham , Jing Lu , Steven C. H. Hoi

Recognition of objects using Deep Neural Networks is an active area of research and many breakthroughs have been made in the last few years. The paper attempts to indicate how far this field has progressed. The paper briefly describes the…

计算机视觉与模式识别 · 计算机科学 2014-12-12 Soren Goyal , Paul Benjamin

Deep neural networks (DNNs) have achieved remarkable empirical success, yet the absence of a principled theoretical foundation continues to hinder their systematic development. In this survey, we present differential equations as a…

人工智能 · 计算机科学 2026-03-20 Hongjue Zhao , Yizhuo Chen , Yuchen Wang , Hairong Qi , Lui Sha , Tarek Abdelzaher , Huajie Shao

Safe use of Deep Neural Networks (DNNs) requires careful testing. However, deployed models are often trained further to improve in performance. As rigorous testing and evaluation is expensive, triggers are in need to determine the degree of…

机器学习 · 计算机科学 2021-11-04 Konstantin Schürholt , Damian Borth

The recent growth of emergent network applications (e.g., satellite networks, vehicular networks) is increasing the complexity of managing modern communication networks. As a result, the community proposed the Digital Twin Networks (DTN) as…

网络与互联网体系结构 · 计算机科学 2022-02-02 Carlos Güemes-Palau , Paul Almasan , Shihan Xiao , Xiangle Cheng , Xiang Shi , Pere Barlet-Ros , Albert Cabellos-Aparicio

A residual network (or ResNet) is a standard deep neural net architecture, with state-of-the-art performance across numerous applications. The main premise of ResNets is that they allow the training of each layer to focus on fitting just…

机器学习 · 计算机科学 2018-09-28 Ohad Shamir

Zeroing neural networks (ZNNs) have demonstrated outstanding performance on time-varying optimization and control problems. Nonetheless, few studies are committed to illustrating the relationship among different ZNNs and the derivation of…

神经与进化计算 · 计算机科学 2025-07-02 Chengze Jiang , Jie Gui , Long Jin , Shuai Li

The growing use of deep neural networks in safety-critical applications makes it necessary to carry out adequate testing to detect and correct any incorrect behavior for corner case inputs before they can be actually used. Deep neural…

软件工程 · 计算机科学 2019-02-19 Jasmine Sekhon , Cody Fleming

The field of deep learning has witnessed a remarkable shift towards extremely compute- and memory-intensive neural networks. These newer larger models have enabled researchers to advance state-of-the-art tools across a variety of fields.…

机器学习 · 计算机科学 2022-07-04 Daniel Nichols , Siddharth Singh , Shu-Huai Lin , Abhinav Bhatele

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

机器学习 · 计算机科学 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Deep neural network (DNN) partition is a research problem that involves splitting a DNN into multiple parts and offloading them to specific locations. Because of the recent advancement in multi-access edge computing and edge intelligence,…

分布式、并行与集群计算 · 计算机科学 2023-04-21 Di Xu , Xiang He , Tonghua Su , Zhongjie Wang

Deep Learning is currently used to perform multiple tasks, such as object recognition, face recognition, and natural language processing. However, Deep Neural Networks (DNNs) are vulnerable to perturbations that alter the network prediction…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Joana C. Costa , Tiago Roxo , Hugo Proença , Pedro R. M. Inácio

Optimizing a neural network's performance is a tedious and time taking process, this iterative process does not have any defined solution which can work for all the problems. Optimization can be roughly categorized into - Architecture and…

机器学习 · 计算机科学 2019-12-16 Siddhartha Dhar Choudhury , Shashank Pandey , Kunal Mehrotra

Neural networks are one of the most investigated and widely used techniques in Machine Learning. In spite of their success, they still find limited application in safety- and security-related contexts, wherein assurance about networks'…

人工智能 · 计算机科学 2018-05-28 Francesco Leofante , Nina Narodytska , Luca Pulina , Armando Tacchella

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model…

计算机视觉与模式识别 · 计算机科学 2023-09-15 Simone Bianco , Remi Cadene , Luigi Celona , Paolo Napoletano

Deep neural networks have proved to be a very effective way to perform classification tasks. They excel when the input data is high dimensional, the relationship between the input and the output is complicated, and the number of labeled…

机器学习 · 计算机科学 2017-11-28 Nicholas Frosst , Geoffrey Hinton

Deep neural networks (DNNs) have achieved the state of the art performance in numerous fields. However, DNNs need high computation times, and people always expect better performance in a lower computation. Therefore, we study the human…

计算机视觉与模式识别 · 计算机科学 2024-07-16 H M Dipu Kabir , Moloud Abdar , Seyed Mohammad Jafar Jalali , Abbas Khosravi , Amir F Atiya , Saeid Nahavandi , Dipti Srinivasan

Deep Neural Networks (DNN) have improved the quality of several non-safety related products in the past years. However, before DNNs should be deployed to safety-critical applications, their robustness needs to be systematically analyzed. A…

Deep neural networks (DNNs) have achieved remarkable success in computer vision; however, training DNNs for satisfactory performance remains challenging and suffers from sensitivity to empirical selections of an optimization algorithm for…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Haichao Zhang , Kuangrong Hao , Lei Gao , Bing Wei , Xuesong Tang