English
Related papers

Related papers: Bounding generalization error with input compressi…

200 papers

The infrequent occurrence of overfit in deep neural networks is perplexing. On the one hand, theory predicts that as models get larger they should eventually become too specialized for a specific training set, with ensuing decrease in…

Machine Learning · Computer Science 2023-12-29 Uri Stern , Daphna Weinshall

Deep neural networks (DNNs) are poorly calibrated when trained in conventional ways. To improve confidence calibration of DNNs, we propose a novel training method, distance-based learning from errors (DBLE). DBLE bases its confidence…

Machine Learning · Computer Science 2020-02-19 Chen Xing , Sercan Arik , Zizhao Zhang , Tomas Pfister

Embeddings produced by pre-trained deep neural networks (DNNs) are widely used; however, their efficacy for downstream tasks can vary widely. We study the factors influencing transferability and out-of-distribution (OOD) generalization of…

Machine Learning · Computer Science 2024-10-28 Md Yousuf Harun , Kyungbok Lee , Jhair Gallardo , Giri Krishnan , Christopher Kanan

We study the notion of a generalization bound being uniformly tight, meaning that the difference between the bound and the population loss is small for all learning algorithms and all population distributions. Numerous generalization bounds…

Machine Learning · Computer Science 2023-11-29 Michael Gastpar , Ido Nachum , Jonathan Shafer , Thomas Weinberger

Deep neural networks (DNN) with a huge number of adjustable parameters remain largely black boxes. To shed light on the hidden layers of DNN, we study supervised learning by a DNN of width $N$ and depth $L$ consisting of $NL$ perceptrons…

Disordered Systems and Neural Networks · Physics 2023-08-01 Hajime Yoshino

Given two networks with the same training loss on a dataset, when would they have drastically different test losses and errors? Better understanding of this question of generalization may improve practical applications of deep networks. In…

Machine Learning · Computer Science 2018-07-26 Qianli Liao , Brando Miranda , Andrzej Banburski , Jack Hidary , Tomaso Poggio

The concepts of conditional mutual information (CMI) and normalized conditional mutual information (NCMI) are introduced to measure the concentration and separation performance of a classification deep neural network (DNN) in the output…

Machine Learning · Computer Science 2023-09-19 En-Hui Yang , Shayan Mohajer Hamidi , Linfeng Ye , Renhao Tan , Beverly Yang

Deep Neural Networks (DNN) represent the state of the art in many tasks. However, due to their overparameterization, their generalization capabilities are in doubt and still a field under study. Consequently, DNN can overfit and assign…

Machine Learning · Computer Science 2021-05-19 Juan Maroñas , Daniel Ramos , Roberto Paredes

Deep Neural Networks (DNNs) have achieved remarkable success in a variety of tasks, especially when it comes to prediction accuracy. However, in complex real-world scenarios, particularly in safety-critical applications, high accuracy alone…

Artificial Intelligence · Computer Science 2024-05-31 Han Liu , Peng Cui , Bingning Wang , Jun Zhu , Xiaolin Hu

Empirical interpolation method (EIM) is a well-known technique to efficiently approximate parameterized functions. This paper proposes to use EIM algorithm to efficiently reduce the dimension of the training data within supervised machine…

Machine Learning · Computer Science 2023-05-18 Harbir Antil , Madhu Gupta , Randy Price

We explore the link between deep ensembles and Gaussian processes (GPs) through the lens of the Neural Tangent Kernel (NTK): a recent development in understanding the training dynamics of wide neural networks (NNs). Previous work has shown…

Machine Learning · Statistics 2020-10-27 Bobby He , Balaji Lakshminarayanan , Yee Whye Teh

Trained with a sufficiently large training and testing dataset, Deep Neural Networks (DNNs) are expected to generalize. However, inputs may deviate from the training dataset distribution in real deployments. This is a fundamental issue with…

Machine Learning · Computer Science 2021-10-07 Yan Xiao , Yun Lin , Ivan Beschastnikh , Changsheng Sun , David S. Rosenblum , Jin Song Dong

It has been experimentally observed in recent years that multi-layer artificial neural networks have a surprising ability to generalize, even when trained with far more parameters than observations. Is there a theoretical basis for this?…

Machine Learning · Statistics 2018-09-19 Andrew R. Barron , Jason M. Klusowski

We examine the relationship between the mutual information between the output model and the empirical sample and the generalization of the algorithm in the context of stochastic convex optimization. Despite increasing interest in…

Machine Learning · Computer Science 2024-01-17 Roi Livni

Deep neural network pruning and quantization techniques have demonstrated it is possible to achieve high levels of compression with surprisingly little degradation to test set accuracy. However, this measure of performance conceals…

Machine Learning · Computer Science 2021-09-07 Sara Hooker , Aaron Courville , Gregory Clark , Yann Dauphin , Andrea Frome

The adversarial vulnerability of deep neural networks (DNNs) has been actively investigated in the past several years. This paper investigates the scale-variant property of cross-entropy loss, which is the most commonly used loss function…

Machine Learning · Computer Science 2022-10-12 Ziquan Liu , Antoni B. Chan

We optimize pipeline parallelism for deep neural network (DNN) inference by partitioning model graphs into $k$ stages and minimizing the running time of the bottleneck stage, including communication. We give practical and effective…

Machine Learning · Computer Science 2024-06-05 Aaron Archer , Matthew Fahrbach , Kuikui Liu , Prakash Prabhu

Calibration is a fundamental property of a good predictive model: it requires that the model predicts correctly in proportion to its confidence. Modern neural networks, however, provide no strong guarantees on their calibration -- and can…

Machine Learning · Computer Science 2022-10-07 A. Michael Carrell , Neil Mallinar , James Lucas , Preetum Nakkiran

Graph neural networks (GNNs) integrate deep architectures and topological structure modeling in an effective way. However, the performance of existing GNNs would decrease significantly when they stack many layers, because of the…

Machine Learning · Computer Science 2021-07-07 Kaixiong Zhou , Xiao Huang , Daochen Zha , Rui Chen , Li Li , Soo-Hyun Choi , Xia Hu

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

Machine Learning · Computer Science 2023-05-16 Huayi Tang , Yong Liu