English
Related papers

Related papers: Position: Many generalization measures for deep le…

200 papers

Current PAC-Bayes generalisation bounds are restricted to scalar metrics of performance, such as the loss or error rate. However, one ideally wants more information-rich certificates that control the entire distribution of possible…

Machine Learning · Statistics 2024-12-10 Reuben Adams , John Shawe-Taylor , Benjamin Guedj

Deep neural networks (DNNs) achieve remarkable performance but often suffer from overfitting due to their high capacity. We introduce Momentum-Adaptive Gradient Dropout (MAGDrop), a novel regularization method that dynamically adjusts…

Machine Learning · Computer Science 2025-11-04 Adeel Safder

Explaining how overparametrized neural networks simultaneously achieve low risk and zero empirical risk on benchmark datasets is an open problem. PAC-Bayes bounds optimized using variational inference (VI) have been recently proposed as a…

Machine Learning · Computer Science 2020-03-06 Konstantinos Pitas

Deep learning is usually described as an experiment-driven field under continuous criticizes of lacking theoretical foundations. This problem has been partially fixed by a large volume of literature which has so far not been well organized.…

Machine Learning · Computer Science 2021-03-12 Fengxiang He , Dacheng Tao

Algorithms often have tunable parameters that impact performance metrics such as runtime and solution quality. For many algorithms used in practice, no parameter settings admit meaningful worst-case bounds, so the parameters are made…

Machine Learning · Computer Science 2021-04-27 Maria-Florina Balcan , Dan DeBlasio , Travis Dick , Carl Kingsford , Tuomas Sandholm , Ellen Vitercik

Image reconstruction methods based on deep neural networks have shown outstanding performance, equalling or exceeding the state-of-the-art results of conventional approaches, but often do not provide uncertainty information about the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Riccardo Barbano , Željko Kereta , Chen Zhang , Andreas Hauptmann , Simon Arridge , Bangti Jin

Gaussian Processes (GPs) are a generic modelling tool for supervised learning. While they have been successfully applied on large datasets, their use in safety-critical applications is hindered by the lack of good performance guarantees. To…

Machine Learning · Statistics 2019-08-27 David Reeb , Andreas Doerr , Sebastian Gerwinn , Barbara Rakitsch

We study the stability of posterior predictive inferences to the specification of the likelihood model and perturbations of the data generating process. In modern big data analyses, useful broad structural judgements may be elicited from…

Methodology · Statistics 2024-04-30 Jack Jewson , Jim Q. Smith , Chris Holmes

Quantification of Uncertainty in predictions is a challenging problem. In the classification settings, although deep learning based models generalize well, class probabilities often lack reliability. Calibration errors are used to quantify…

Machine Learning · Computer Science 2024-05-07 Aditya Challa , Snehanshu Saha , Soma Dhavala

Deep neural networks are over-parameterized and easily overfit the datasets they train on. In the extreme case, it has been shown that these networks can memorize a training set with fully randomized labels. We propose using the curvature…

Machine Learning · Computer Science 2023-10-03 Isha Garg , Deepak Ravikumar , Kaushik Roy

The random dot product graph is a popular model for network data with extensions that accommodate dynamic (time-varying) networks. However, two significant deficiencies exist in the dynamic random dot product graph literature: (1) no…

Methodology · Statistics 2025-09-25 Joshua Daniel Loyal

It is well-known that modern neural networks are vulnerable to adversarial examples. To mitigate this problem, a series of robust learning algorithms have been proposed. However, although the robust training error can be near zero via some…

Machine Learning · Computer Science 2022-10-17 Binghui Li , Jikai Jin , Han Zhong , John E. Hopcroft , Liwei Wang

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

We study the learning performance of gradient descent when the empirical risk is weakly convex, namely, the smallest negative eigenvalue of the empirical risk's Hessian is bounded in magnitude. By showing that this eigenvalue can control…

Machine Learning · Statistics 2021-06-02 Dominic Richards , Mike Rabbat

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Recent advances in deep generative models have led to impressive results in a variety of application domains. Motivated by the possibility that deep learning models might memorize part of the input data, there have been increased efforts to…

Machine Learning · Computer Science 2021-12-30 Gerrit J. J. van den Burg , Christopher K. I. Williams

In the context of supervised learning, meta learning uses features, metadata and other information to learn about the difficulty, behavior, or composition of the problem. Using this knowledge can be useful to contextualize classifier…

Information Theory · Computer Science 2020-04-28 Salimeh Yasaei Sekeh , Brandon Oselio , Alfred O. Hero

Despite apparent human-level performances of deep neural networks (DNN), they behave fundamentally differently from humans. They easily change predictions when small corruptions such as blur and noise are applied on the input (lack of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Sanghyuk Chun , Seong Joon Oh , Sangdoo Yun , Dongyoon Han , Junsuk Choe , Youngjoon Yoo

We propose a systematic analysis of deep neural networks (DNNs) based on a signal processing technique for network parameter removal, in the form of synaptic filters that identifies the fragility, robustness and antifragility…

Machine Learning · Computer Science 2023-12-27 Chandresh Pravin , Ivan Martino , Giuseppe Nicosia , Varun Ojha

We present a family of novel block-sample MAC-Bayes bounds (mean approximately correct). While PAC-Bayes bounds (probably approximately correct) typically give bounds for the generalization error that hold with high probability, MAC-Bayes…

Machine Learning · Computer Science 2026-02-16 Matthias Frey , Jingge Zhu , Michael C. Gastpar