中文
相关论文

相关论文: Shallow-Deep Networks: Understanding and Mitigatin…

200 篇论文

We propose doubly nested network(DNNet) where all neurons represent their own sub-models that solve the same task. Every sub-model is nested both layer-wise and channel-wise. While nesting sub-models layer-wise is straight-forward with…

机器学习 · 计算机科学 2018-06-21 Jaehong Kim , Sungeun Hong , Yongseok Choi , Jiwon Kim

Assisted by the availability of data and high performance computing, deep learning techniques have achieved breakthroughs and surpassed human performance empirically in difficult tasks, including object recognition, speech recognition, and…

机器学习 · 计算机科学 2019-01-23 Shaeke Salman , Xiuwen Liu

Trained with a sufficiently large training and testing dataset, Deep Neural Networks (DNNs) are expected to generalize. However, inputs may deviate from the training dataset distribution in real deployments. This is a fundamental issue with…

机器学习 · 计算机科学 2021-10-07 Yan Xiao , Yun Lin , Ivan Beschastnikh , Changsheng Sun , David S. Rosenblum , Jin Song Dong

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

机器学习 · 计算机科学 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

机器学习 · 计算机科学 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

Deep Neural Network (DNN) based super-resolution algorithms have greatly improved the quality of the generated images. However, these algorithms often yield significant artifacts when dealing with real-world super-resolution problems due to…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Kangfu Mei , Shenglong Ye , Rui Huang

The capabilities and adoption of deep neural networks (DNNs) grow at an exhilarating pace: Vision models accurately classify human actions in videos and identify cancerous tissue in medical scans as precisely than human experts; large…

机器学习 · 计算机科学 2023-06-26 Lukas Hedegaard

Deep neural network (DNN) inference has become an important part of many data-center workloads. This has prompted focused efforts to design ever-faster deep learning accelerators such as GPUs and TPUs. However, an end-to-end DNN-based…

分布式、并行与集群计算 · 计算机科学 2024-04-23 Ahmed F. AbouElhamayed , Susanne Balle , Deshanand Singh , Mohamed S. Abdelfattah

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

神经与进化计算 · 计算机科学 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

Deep neural networks (DNNs) have been shown to perform well on exclusive, multi-class classification tasks. However, when different classes have similar visual features, it becomes challenging for human annotators to differentiate them.…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Changbin Li , Kangshuo Li , Yuzhe Ou , Lance M. Kaplan , Audun Jøsang , Jin-Hee Cho , Dong Hyun Jeong , Feng Chen

Deep Neural Networks (DNN) are becoming increasingly more important in assisted and automated driving. Using such entities which are obtained using machine learning is inevitable: tasks such as recognizing traffic signs cannot be developed…

密码学与安全 · 计算机科学 2024-10-11 Akshay Dhonthi , Ernst Moritz Hahn , Vahid Hashemi

Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a…

机器学习 · 计算机科学 2021-10-14 Akib Mashrur , Wei Luo , Nayyar A. Zaidi , Antonio Robles-Kelly

Deep neural networks (DNNs) demonstrate outstanding performance across most computer vision tasks. Some critical applications, such as autonomous driving or medical imaging, also require investigation into their behavior and the reasons…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly , Xavier Fischer

Deep neural networks (DNN) are black box algorithms. They are trained using a gradient descent back propagation technique which trains weights in each layer for the sole goal of minimizing training error. Hence, the resulting weights cannot…

机器学习 · 计算机科学 2018-11-05 Daniel Goldfarb

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

机器学习 · 计算机科学 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

Developing strong AI signifies the arrival of technological singularity, contributing greatly to advancing human civilization and resolving social issues. Neural networks (NNs) and deep learning, which utilize NNs, are expected to lead to…

机器学习 · 计算机科学 2024-09-09 Kei Itoh

It is well-known that deep neural networks (DNNs) have shown remarkable success in many fields. However, when adding an imperceptible magnitude perturbation on the model input, the model performance might get rapid decrease. To address this…

机器学习 · 计算机科学 2022-01-04 Hao Yang , Min Wang , Zhengfei Yu , Yun Zhou

Deep neural networks (DNN) have achieved unprecedented performance in computer-vision tasks almost ubiquitously in business, technology, and science. While substantial efforts are made to engineer highly accurate architectures and provide…

图像与视频处理 · 电气工程与系统科学 2022-09-08 Sumedha Singla

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

机器学习 · 计算机科学 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Despite the recent progress in deep neural networks (DNNs), it remains challenging to explain the predictions made by DNNs. Existing explanation methods for DNNs mainly focus on post-hoc explanations where another explanatory model is…

机器学习 · 计算机科学 2024-01-04 Wei Qian , Chenxu Zhao , Yangyi Li , Fenglong Ma , Chao Zhang , Mengdi Huai