中文
相关论文

相关论文: Confidence Dimension for Deep Learning based on Ho…

200 篇论文

Deep neural networks (DNNs) have demonstrated their great potential in recent years, exceeding the per-formance of human experts in a wide range of applications. Due to their large sizes, however, compressiontechniques such as weight…

计算机视觉与模式识别 · 计算机科学 2021-10-15 Wentao Chen , Hailong Qiu , Jian Zhuang , Chutong Zhang , Yu Hu , Qing Lu , Tianchen Wang , Yiyu Shi , Meiping Huang , Xiaowe Xu

The purpose of this article is to develop a machinery to study the capacity of deep neural networks (DNNs) to approximate high-dimensional functions. In particular, we show that DNNs have the expressive power to overcome the curse of…

Accurate approximation of scalar-valued functions from sample points is a key task in computational science. Recently, machine learning with Deep Neural Networks (DNNs) has emerged as a promising tool for scientific computing, with…

机器学习 · 计算机科学 2021-03-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

Building fair deep neural networks (DNNs) is a crucial step towards achieving trustworthy artificial intelligence. Delving into deeper factors that affect the fairness of DNNs is paramount and serves as the foundation for mitigating model…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Yanbiao Ma , Licheng Jiao , Fang Liu , Lingling Li , Wenping Ma , Shuyuan Yang , Xu Liu , Puhua Chen

Generalization is essential for deep learning. In contrast to previous works claiming that Deep Neural Networks (DNNs) have an implicit regularization implemented by the stochastic gradient descent, we demonstrate explicitly Bayesian…

机器学习 · 计算机科学 2019-10-23 Xinjie Lan , Kenneth E. Barner

In Statistical Learning, the Vapnik-Chervonenkis (VC) dimension is an important combinatorial property of classifiers. To our knowledge, no theoretical results yet exist for the VC dimension of edited nearest-neighbour (1NN) classifiers…

机器学习 · 计算机科学 2019-02-08 Iain A. D. Gunn , Ludmila I. Kuncheva

Complex-valued neural networks (CVNNs) have been widely applied to various fields, especially signal processing and image recognition. However, few works focus on the generalization of CVNNs, albeit it is vital to ensure the performance of…

机器学习 · 计算机科学 2021-12-08 Haowen Chen , Fengxiang He , Shiye Lei , Dacheng Tao

Recently, many works studied the expressive power of graph neural networks (GNNs) by linking it to the $1$-dimensional Weisfeiler--Leman algorithm ($1\text{-}\mathsf{WL}$). Here, the $1\text{-}\mathsf{WL}$ is a well-studied heuristic for…

机器学习 · 计算机科学 2023-05-31 Christopher Morris , Floris Geerts , Jan Tönshoff , Martin Grohe

Deep neural networks (DNN) with a huge number of adjustable parameters remain largely black boxes. To shed light on the hidden layers of DNN, we study supervised learning by a DNN of width $N$ and depth $L$ consisting of $NL$ perceptrons…

无序系统与神经网络 · 物理学 2023-08-01 Hajime Yoshino

The reliable measurement of confidence in classifiers' predictions is very important for many applications and is, therefore, an important part of classifier design. Yet, although deep learning has received tremendous attention in recent…

人工智能 · 计算机科学 2020-07-01 Amit Mandelbaum , Daphna Weinshall

In recent years, convolutional neural networks (CNNs) took over the field of document analysis and they became the predominant model for word spotting. Especially attribute CNNs, which learn the mapping between a word image and an attribute…

计算机视觉与模式识别 · 计算机科学 2019-03-27 Fabian Wolf , Philipp Oberdiek , Gernot A. Fink

A key challenge for deploying deep neural networks (DNNs) in safety critical settings is the need to provide rigorous ways to quantify their uncertainty. In this paper, we propose a novel algorithm for constructing predicted classification…

机器学习 · 计算机科学 2021-03-19 Sangdon Park , Shuo Li , Insup Lee , Osbert Bastani

Deep Neural Networks (DNNs) generalize well despite their massive size and capability of memorizing all examples. There is a hypothesis that DNNs start learning from simple patterns and the hypothesis is based on the existence of examples…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Ikki Kishida , Hideki Nakayama

Largest theoretical contribution to Neural Networks comes from VC Dimension which characterizes the sample complexity of classification model in a probabilistic view and are widely used to study the generalization error. So far in the…

机器学习 · 计算机科学 2024-09-05 Linu Pinto , Sasi Gopalan

Recent research has seen many behavioral comparisons between humans and deep neural networks (DNNs) in the domain of image classification. Often, comparison studies focus on the end-result of the learning process by measuring and comparing…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Lukas S. Huber , Fred W. Mast , Felix A. Wichmann

Deep neural networks (DNNs) achieve impressive results for complicated tasks like object detection on images and speech recognition. Motivated by this practical success, there is now a strong interest in showing good theoretical properties…

机器学习 · 统计学 2020-06-16 Michael Kohler , Adam Krzyzak , Sophie Langer

During the last decade, deep neural networks (DNN) have demonstrated impressive performances solving a wide range of problems in various domains such as medicine, finance, law, etc. Despite their great performances, they have long been…

机器学习 · 计算机科学 2020-10-13 Jiechieu Kameni Florentin Flambeau , Tsopze Norbert

Most of the Deep Neural Networks (DNNs) based CT image denoising literature shows that DNNs outperform traditional iterative methods in terms of metrics such as the RMSE, the PSNR and the SSIM. In many instances, using the same metrics, the…

计算机视觉与模式识别 · 计算机科学 2021-11-19 Prabhat KC , Rongping Zeng , M. Mehdi Farhangi , Kyle J. Myers

Deep neural networks (DNNs) are powerful learning models yet their results are not always reliable. This is due to the fact that modern DNNs are usually uncalibrated and we cannot characterize their epistemic uncertainty. In this work, we…

计算机视觉与模式识别 · 计算机科学 2020-06-03 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

Deep learning has become an essential part of computer vision, with deep neural networks (DNNs) excelling in predictive performance. However, they often fall short in other critical quality dimensions, such as robustness, calibration, or…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Robin Hesse , Doğukan Bağcı , Bernt Schiele , Simone Schaub-Meyer , Stefan Roth