English
Related papers

Related papers: When Do Early-Exit Networks Generalize? A PAC-Baye…

200 papers

Deep neural networks have long training and processing times. Early exits added to neural networks allow the network to make early predictions using intermediate activations in the network in time-sensitive applications. However, early…

Machine Learning · Computer Science 2022-12-27 Devdhar Patel , Hava Siegelmann

Deep neural networks (DNNs) achieve remarkable performance but often suffer from overfitting due to their high capacity. We introduce Momentum-Adaptive Gradient Dropout (MAGDrop), a novel regularization method that dynamically adjusts…

Machine Learning · Computer Science 2025-11-04 Adeel Safder

By adding exiting layers to the deep learning networks, early exit can terminate the inference earlier with accurate results. The passive decision-making of whether to exit or continue the next layer has to go through every pre-placed…

Machine Learning · Computer Science 2022-12-29 Xiangjie Li , Chenfei Lou , Zhengping Zhu , Yuchi Chen , Yingtao Shen , Yehan Ma , An Zou

Modern neural networks are highly overparameterized, with capacity to substantially overfit to training data. Nevertheless, these networks often generalize well in practice. It has also been observed that trained networks can often be…

Machine Learning · Statistics 2019-02-26 Wenda Zhou , Victor Veitch , Morgane Austern , Ryan P. Adams , Peter Orbanz

Deep neural networks have significantly improved performance on a range of tasks with the increasing demand for computational resources, leaving deployment on low-resource devices (with limited memory and battery power) infeasible. Binary…

Machine Learning · Computer Science 2022-06-22 Aaqib Saeed

Along with the rapid development of deep learning in practice, the theoretical explanations for its success become urgent. Generalization and expressivity are two widely used measurements to quantify theoretical behaviors of deep learning.…

Machine Learning · Computer Science 2018-03-26 Shao-Bo Lin

Deep neural networks generalize well despite being heavily overparameterized, in apparent contradiction with classical learning theory based on uniform convergence over fixed hypothesis spaces. Uniform bounds over the entire parameter space…

Machine Learning · Statistics 2026-05-15 Hubert Leroux , Jean Marcus , Julien Roger

Both PAC-Bayesian and Sample Compress learning frameworks are instrumental for deriving tight (non-vacuous) generalization bounds for neural networks. We leverage these results in a meta-learning scheme, relying on a hypernetwork that…

Machine Learning · Computer Science 2025-06-06 Benjamin Leblanc , Mathieu Bazinet , Nathaniel D'Amours , Alexandre Drouin , Pascal Germain

Graph neural networks have demonstrated excellent applicability to a wide range of domains, including social networks, biological systems, recommendation systems, and wireless communications. Yet a principled theoretical understanding of…

Machine Learning · Computer Science 2026-04-14 Xinping Yi

Early Exit (EE) techniques have emerged as a means to reduce inference latency in Deep Neural Networks (DNNs). The latency improvement and accuracy in these techniques crucially depend on the criteria used to make exit decisions. We propose…

Machine Learning · Computer Science 2025-02-04 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

In this paper, we establish generalization bounds for transductive learning algorithms in the context of information theory and PAC-Bayes, covering both the random sampling and the random splitting setting. First, we show that the…

Machine Learning · Computer Science 2025-01-22 Huayi Tang , Yong Liu

Deep neural networks (DNNs) have been successfully applied in various fields. In DNNs, a large number of multiply-accumulate (MAC) operations are required to be performed, posing critical challenges in applying them in resource-constrained…

Machine Learning · Computer Science 2024-02-20 Jingcun Wang , Bing Li , Grace Li Zhang

Deep neural networks are generally designed as a stack of differentiable layers, in which a prediction is obtained only after running the full stack. Recently, some contributions have proposed techniques to endow the networks with early…

Neural and Evolutionary Computing · Computer Science 2020-06-24 Simone Scardapane , Michele Scarpiniti , Enzo Baccarelli , Aurelio Uncini

Deep Learning is becoming increasingly relevant in Embedded and Internet-of-things applications. However, deploying models on embedded devices poses a challenge due to their resource limitations. This can impact the model's inference…

Machine Learning · Computer Science 2024-03-14 Max Sponner , Lorenzo Servadei , Bernd Waschneck , Robert Wille , Akash Kumar

Large language models have achieved remarkable capabilities, but their practical deployment is hindered by significant computational costs. While adaptive computation methods like early-exiting promise to reduce these costs, they introduce…

Computation and Language · Computer Science 2025-12-16 Sangmin Bae

Machine learning models can solve complex tasks but often require significant computational resources during inference. This has led to the development of various post-training computation reduction methods that tackle this issue in…

Machine Learning · Computer Science 2024-06-21 Florence Regol , Joud Chataoui , Bertrand Charpentier , Mark Coates , Pablo Piantanida , Stephan Gunnemann

Deep nets generalize well despite having more parameters than the number of training samples. Recent works try to give an explanation using PAC-Bayes and Margin-based analyses, but do not as yet result in sample complexity bounds better…

Machine Learning · Computer Science 2018-11-28 Sanjeev Arora , Rong Ge , Behnam Neyshabur , Yi Zhang

It has been experimentally observed in recent years that multi-layer artificial neural networks have a surprising ability to generalize, even when trained with far more parameters than observations. Is there a theoretical basis for this?…

Machine Learning · Statistics 2018-09-19 Andrew R. Barron , Jason M. Klusowski

Generalization is a central concept in machine learning theory, yet for quantum models, it is predominantly analyzed through uniform bounds that depend on a model's overall capacity rather than the specific function learned. These…

Ensuring the safety and efficiency of AI systems is a central goal of modern research. Formal verification provides guarantees of neural network robustness, while early exits improve inference efficiency by enabling intermediate…

Machine Learning · Computer Science 2025-12-25 Yizhak Yisrael Elboher , Avraham Raviv , Amihay Elboher , Zhouxing Shi , Omri Azencot , Hillel Kugler , Guy Katz