中文
相关论文

相关论文: Shallow-Deep Networks: Understanding and Mitigatin…

200 篇论文

We propose a novel method to explain trained deep neural networks (DNNs), by distilling them into surrogate models using unsupervised clustering. Our method can be applied flexibly to any subset of layers of a DNN architecture and can…

计算机视觉与模式识别 · 计算机科学 2020-07-17 Yu-han Liu , Sercan O. Arik

Adversarial examples, generated by adding small but intentionally imperceptible perturbations to normal examples, can mislead deep neural networks (DNNs) to make incorrect predictions. Although much work has been done on both adversarial…

人机交互 · 计算机科学 2020-01-29 Kelei Cao , Mengchen Liu , Hang Su , Jing Wu , Jun Zhu , Shixia Liu

Improving sparsity of deep neural networks (DNNs) is essential for network compression and has drawn much attention. In this work, we disclose a harmful sparsifying process called filter collapse, which is common in DNNs with batch…

机器学习 · 计算机科学 2020-02-03 Sheng Zhou , Xinjiang Wang , Ping Luo , Litong Feng , Wenjie Li , Wei Zhang

Despite the remarkable performance, modern deep neural networks are inevitably accompanied by a significant amount of computational cost for learning and deployment, which may be incompatible with their usage on edge devices. Recent efforts…

计算机视觉与模式识别 · 计算机科学 2022-03-11 Seul-Ki Yeom , Kyung-Hwan Shim , Jee-Hyun Hwang

Whereas deep neural network (DNN) is increasingly applied to choice analysis, it is challenging to reconcile domain-specific behavioral knowledge with generic-purpose DNN, to improve DNN's interpretability and predictive power, and to…

机器学习 · 计算机科学 2021-04-06 Shenhao Wang , Baichuan Mo , Jinhua Zhao

This work investigates how using reduced precision data in Convolutional Neural Networks (CNNs) affects network accuracy during classification. More specifically, this study considers networks where each layer may use different precision…

Deep neural networks (DNNs) have become one of the enabling technologies in many safety-critical applications, e.g., autonomous driving and medical image analysis. DNN systems, however, suffer from various kinds of threats, such as…

机器学习 · 计算机科学 2020-10-19 Yu Li , Min Li , Bo Luo , Ye Tian , Qiang Xu

Recent theoretical work has demonstrated that deep neural networks have superior performance over shallow networks, but their training is more difficult, e.g., they suffer from the vanishing gradient problem. This problem can be typically…

机器学习 · 统计学 2021-11-03 Lu Lu , Yanhui Su , George Em Karniadakis

Deep neural networks (DNNs) have demonstrated remarkable success in various fields. However, the large number of floating-point operations (FLOPs) in DNNs poses challenges for their deployment in resource-constrained applications, e.g.,…

人工智能 · 计算机科学 2024-02-20 Mengnan Jiang , Jingcun Wang , Amro Eldebiky , Xunzhao Yin , Cheng Zhuo , Ing-Chao Lin , Grace Li Zhang

Deep neural networks (DNNs) are widely used in various application domains such as image processing, speech recognition, and natural language processing. However, testing DNN models may be challenging due to the complexity and size of their…

机器学习 · 计算机科学 2024-03-04 Zohreh Aghababaeyan , Manel Abdellatif , Mahboubeh Dadkhah , Lionel Briand

Semantic segmentation and instance level segmentation made substantial progress in recent years due to the emergence of deep neural networks (DNNs). A number of deep architectures with Convolution Neural Networks (CNNs) were proposed that…

计算机视觉与模式识别 · 计算机科学 2019-09-18 Pulak Purkait , Christopher Zach , Ian Reid

While researchers increasingly use deep neural networks (DNN) to analyze individual choices, overfitting and interpretability issues remain as obstacles in theory and practice. By using statistical learning theory, this study presents a…

综合经济学 · 经济学 2019-09-18 Shenhao Wang , Qingyi Wang , Nate Bailey , Jinhua Zhao

Oversampling is a common characteristic of data representing dynamic networks. It introduces noise into representations of dynamic networks, but there has been little work so far to compensate for it. Oversampling can affect the quality of…

社会与信息网络 · 计算机科学 2015-08-12 Benjamin Fish , Rajmonda S. Caceres

Deep Neural Networks (DNNs) have already become a crucial computational approach to revealing the spatial patterns in the human brain; however, there are three major shortcomings in utilizing DNNs to detect the spatial patterns in…

机器学习 · 计算机科学 2022-05-26 Wei Zhang , Yu Bao

Recent data-driven approaches to scene interpretation predominantly pose inference as an end-to-end black-box mapping, commonly performed by a Convolutional Neural Network (CNN). However, decades of work on perceptual organization in both…

计算机视觉与模式识别 · 计算机科学 2018-07-23 Chi Li , M. Zeeshan Zia , Quoc-Huy Tran , Xiang Yu , Gregory D. Hager , Manmohan Chandraker

Contemporary Deep Neural Network (DNN) contains millions of synaptic connections with tens to hundreds of layers. The large computation and memory requirements pose a challenge to the hardware design. In this work, we leverage the intrinsic…

机器学习 · 计算机科学 2017-11-07 Jingyang Zhu , Jingbo Jiang , Xizi Chen , Chi-Ying Tsui

Despite the great achievements of deep neural networks (DNNs), the vulnerability of state-of-the-art DNNs raises security concerns of DNNs in many application domains requiring high reliability.We propose the fault sneaking attack on DNNs,…

机器学习 · 计算机科学 2025-07-08 Pu Zhao , Siyue Wang , Cheng Gongye , Yanzhi Wang , Yunsi Fei , Xue Lin

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

机器学习 · 计算机科学 2024-07-08 Chang Yue , Niraj K. Jha

Deep neural networks (DNNs) are powerful types of artificial neural networks (ANNs) that use several hidden layers. They have recently gained considerable attention in the speech transcription and image recognition community (Krizhevsky et…

机器学习 · 计算机科学 2017-06-15 Matthew Dixon , Diego Klabjan , Jin Hoon Bang

Spiking Neural Networks (SNNs) promise higher energy efficiency over conventional Quantized Artificial Neural Networks (QNNs) due to their event-driven, spike-based computation. However, prevailing energy evaluations often oversimplify,…

神经与进化计算 · 计算机科学 2026-05-13 Zhanglu Yan , Zhenyu Bai , Weng-Fai Wong