English
Related papers

Related papers: Early-Exit Neural Networks with Nested Prediction …

200 papers

Thompson sampling (TS) is a popular heuristic for action selection, but it requires sampling from a posterior distribution. Unfortunately, this can become computationally intractable in complex environments, such as those modeled using…

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

Early Time-Series Classification (ETSC) is the task of predicting the class of incoming time-series by observing as few measurements as possible. Such methods can be employed to obtain classification forecasts in many time-critical…

Machine Learning · Computer Science 2022-03-04 Charilaos Akasiadis , Evgenios Kladis , Evangelos Michelioudakis , Elias Alevizos , Alexander Artikis

Early Exit Neural Networks (EENNs) present a solution to enhance the efficiency of neural network deployments. However, creating EENNs is challenging and requires specialized domain knowledge, due to the large amount of additional design…

Machine Learning · Computer Science 2024-03-14 Max Sponner , Lorenzo Servadei , Bernd Waschneck , Robert Wille , Akash Kumar

The inference of large language models imposes significant computational workloads, often requiring the processing of billions of parameters. Although early-exit strategies have proven effective in reducing computational demands by halting…

Computation and Language · Computer Science 2026-01-08 Sangmin Yoo , Srikanth Malla , Chiho Choi , Wei D. Lu , Joon Hee Choi

Semantic segmentation arises as the backbone of many vision systems, spanning from self-driving cars and robot navigation to augmented reality and teleconferencing. Frequently operating under stringent latency constraints within a limited…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Alexandros Kouris , Stylianos I. Venieris , Stefanos Laskaridis , Nicholas D. Lane

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Both performance and efficiency are crucial factors for sequence labeling tasks in many real-world scenarios. Although the pre-trained models (PTMs) have significantly improved the performance of various sequence labeling tasks, their…

Computation and Language · Computer Science 2021-06-15 Xiaonan Li , Yunfan Shao , Tianxiang Sun , Hang Yan , Xipeng Qiu , Xuanjing Huang

Early Exiting (EE) is a promising technique for speeding up inference by adaptively allocating compute resources to data points based on their difficulty. The approach enables predictions to exit at earlier layers for simpler samples while…

Machine Learning · Computer Science 2024-12-30 Mehrnaz Mofakhami , Reza Bayat , Ioannis Mitliagkas , Joao Monteiro , Valentina Zantedeschi

Bayesian neural network models (BNN) have re-surged in recent years due to the advancement of scalable computations and its utility in solving complex prediction problems in a wide variety of applications. Despite the popularity and…

Machine Learning · Statistics 2020-11-20 Shrijita Bhattacharya , Zihuan Liu , Tapabrata Maiti

Deployment of dynamic neural networks on edge accelerators requires careful consideration of hardware constraints beyond conventional complexity metrics such as Multiply-Accumulate operations. In Early-Exiting Neural Networks (EENN), exit…

Computational Complexity · Computer Science 2026-04-01 Alaa Zniber , Arne Symons , Ouassim Karrakchou , Marian Verhelst , Mounir Ghogho

When building either prediction intervals for regression (with real-valued response) or prediction sets for classification (with categorical responses), uncertainty quantification is essential to studying complex machine learning methods.…

Machine Learning · Statistics 2022-06-17 Chen Xu , Yao Xie

Artificial Neural Networks are connectionist systems that perform a given task by learning on examples without having prior knowledge about the task. This is done by finding an optimal point estimate for the weights in every node.…

Machine Learning · Computer Science 2019-01-10 Kumar Shridhar , Felix Laumann , Marcus Liwicki

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

Machine Learning · Computer Science 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

Traditional deep neural nets (NNs) have shown the state-of-the-art performance in the task of classification in various applications. However, NNs have not considered any types of uncertainty associated with the class probabilities to…

Machine Learning · Computer Science 2019-10-16 Xujiang Zhao , Yuzhe Ou , Lance Kaplan , Feng Chen , Jin-Hee Cho

Traditional deep neural networks (NNs) have significantly contributed to the state-of-the-art performance in the task of classification under various application domains. However, NNs have not considered inherent uncertainty in data…

Machine Learning · Computer Science 2021-05-05 Yibo Hu , Yuzhe Ou , Xujiang Zhao , Jin-Hee Cho , Feng Chen

Intelligibility and accurate uncertainty estimation are crucial for reliable decision-making. In this paper, we propose EviNAM, an extension of evidential learning that integrates the interpretability of Neural Additive Models (NAMs) with…

Machine Learning · Computer Science 2026-01-14 Sören Schleibaum , Anton Frederik Thielmann , Julian Teusch , Benjamin Säfken , Jörg P. Müller

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for post-hoc confidence…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Fabian Küppers , Jan Kronenberger , Jonas Schneider , Anselm Haselhoff

Autonomous Vehicle (AV) perception systems have advanced rapidly in recent years, providing vehicles with the ability to accurately interpret their environment. Perception systems remain susceptible to errors caused by overly-confident…

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis