中文
相关论文

相关论文: Explaining Generalization Power of a DNN Using Int…

200 篇论文

Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now…

机器学习 · 统计学 2017-11-08 Randall Balestriero , Richard Baraniuk

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

机器学习 · 计算机科学 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Recent advancements in deep neural networks (DNNs), particularly large-scale language models, have demonstrated remarkable capabilities in image and natural language understanding. Although scaling up model parameters with increasing volume…

机器学习 · 计算机科学 2025-05-15 Jiaxuan Chen , Yu Qi , Yueming Wang , Gang Pan

Pre-trained Deep Neural Network (DNN) models are increasingly used in smartphones and other user devices to enable prediction services, leading to potential disclosures of (sensitive) information from training data captured inside these…

密码学与安全 · 计算机科学 2019-07-16 Fan Mo , Ali Shahin Shamsabadi , Kleomenis Katevas , Andrea Cavallaro , Hamed Haddadi

This paper aims to define, quantify, and analyze the feature complexity that is learned by a DNN. We propose a generic definition for the feature complexity. Given the feature of a certain layer in the DNN, our method disentangles feature…

机器学习 · 计算机科学 2023-12-04 Jie Ren , Mingjie Li , Zexu Liu , Quanshi Zhang

Explainable AI has emerged to be a key component for black-box machine learning approaches in domains with a high demand for reliability or transparency. Examples are medical assistant systems, and applications concerned with the General…

机器学习 · 计算机科学 2021-05-18 Johannes Rabold , Gesina Schwalbe , Ute Schmid

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

机器学习 · 计算机科学 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

Overparameterized deep networks that generalize well have been key to the dramatic success of deep learning in recent years. The reasons for their remarkable ability to generalize are not well understood yet. When class labels in the…

机器学习 · 计算机科学 2026-02-03 Simran Ketha , Venkatakrishnan Ramaswamy

In this technical note, we aim to explain a deep neural network (DNN) by quantifying the encoded interactions between input variables, which reflects the DNN's inference logic. Specifically, we first rethink the definition of interactions,…

机器学习 · 计算机科学 2024-08-02 Mingjie Li , Quanshi Zhang

The vulnerability to slight input perturbations is a worrying yet intriguing property of deep neural networks (DNNs). Despite many previous works studying the reason behind such adversarial behavior, the relationship between the…

机器学习 · 统计学 2019-06-07 Yujun Shi , Benben Liao , Guangyong Chen , Yun Liu , Ming-Ming Cheng , Jiashi Feng

A longstanding problem for Deep Neural Networks (DNNs) is understanding their puzzling ability to generalize well. We approach this problem through the unconventional angle of \textit{cognitive abstraction mechanisms}, drawing inspiration…

机器学习 · 计算机科学 2020-04-20 Alex Gain , Hava Siegelmann

Deep neural networks have achieved remarkable success in various challenging tasks. However, the black-box nature of such networks is not acceptable to critical applications, such as healthcare. In particular, the existence of adversarial…

机器学习 · 计算机科学 2019-09-12 Shaeke Salman , Seyedeh Neelufar Payrovnaziri , Xiuwen Liu , Pablo Rengifo-Moreno , Zhe He

Despite their unprecedented success, DNNs are notoriously fragile to small shifts in data distribution, demanding effective testing techniques that can assess their dependability. Despite recent advances in DNN testing, there is a lack of…

机器学习 · 计算机科学 2024-03-26 Sondess Missaoui , Simos Gerasimou , Nikolaos Matragkas

Deep neural networks (DNNs) transform stimuli across multiple processing stages to produce representations that can be used to solve complex tasks, such as object recognition in images. However, a full understanding of how they achieve this…

神经元与认知 · 定量生物学 2018-11-01 David G. T. Barrett , Ari S. Morcos , Jakob H. Macke

Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor generalization, i.e., may prove…

机器学习 · 计算机科学 2023-05-11 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Inspired by the immense success of deep learning, graph neural networks (GNNs) are widely used to learn powerful node representations and have demonstrated promising performance on different graph learning tasks. However, most real-world…

机器学习 · 计算机科学 2020-01-24 Kaize Ding , Yichuan Li , Jundong Li , Chenghao Liu , Huan Liu

We study the problem of explaining a rich class of behavioral properties of deep neural networks. Distinctively, our influence-directed explanations approach this problem by peering inside the network to identify neurons with high influence…

机器学习 · 计算机科学 2018-11-14 Klas Leino , Shayak Sen , Anupam Datta , Matt Fredrikson , Linyi Li

Deep learning has been widely applied and brought breakthroughs in speech recognition, computer vision, and many other domains. The involved deep neural network architectures and computational issues have been well studied in machine…

机器学习 · 计算机科学 2018-07-23 Ding-Xuan Zhou

State-of-the-art deep neural networks (DNNs) are highly effective at tackling many real-world tasks. However, their wide adoption in mission-critical contexts is hampered by two major weaknesses - their susceptibility to adversarial attacks…

机器学习 · 计算机科学 2022-11-17 Ofir Moshe , Gil Fidel , Ron Bitton , Asaf Shabtai

Deep Neural Networks (DNNs) excel at many tasks, often rivaling or surpassing human performance. Yet their internal processes remain elusive, frequently described as "black boxes." While performance can be refined experimentally, achieving…

无序系统与神经网络 · 物理学 2025-02-03 Sebastiano Ariosto