中文
相关论文

相关论文: Early-Exit Neural Networks with Nested Prediction …

200 篇论文

Thompson sampling (TS) is a popular heuristic for action selection, but it requires sampling from a posterior distribution. Unfortunately, this can become computationally intractable in complex environments, such as those modeled using…

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

机器学习 · 计算机科学 2024-01-17 Soyed Tuhin Ahmed

Early Time-Series Classification (ETSC) is the task of predicting the class of incoming time-series by observing as few measurements as possible. Such methods can be employed to obtain classification forecasts in many time-critical…

Early Exit Neural Networks (EENNs) present a solution to enhance the efficiency of neural network deployments. However, creating EENNs is challenging and requires specialized domain knowledge, due to the large amount of additional design…

机器学习 · 计算机科学 2024-03-14 Max Sponner , Lorenzo Servadei , Bernd Waschneck , Robert Wille , Akash Kumar

The inference of large language models imposes significant computational workloads, often requiring the processing of billions of parameters. Although early-exit strategies have proven effective in reducing computational demands by halting…

计算与语言 · 计算机科学 2026-01-08 Sangmin Yoo , Srikanth Malla , Chiho Choi , Wei D. Lu , Joon Hee Choi

Semantic segmentation arises as the backbone of many vision systems, spanning from self-driving cars and robot navigation to augmented reality and teleconferencing. Frequently operating under stringent latency constraints within a limited…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Alexandros Kouris , Stylianos I. Venieris , Stefanos Laskaridis , Nicholas D. Lane

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

图像与视频处理 · 电气工程与系统科学 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Both performance and efficiency are crucial factors for sequence labeling tasks in many real-world scenarios. Although the pre-trained models (PTMs) have significantly improved the performance of various sequence labeling tasks, their…

计算与语言 · 计算机科学 2021-06-15 Xiaonan Li , Yunfan Shao , Tianxiang Sun , Hang Yan , Xipeng Qiu , Xuanjing Huang

Early Exiting (EE) is a promising technique for speeding up inference by adaptively allocating compute resources to data points based on their difficulty. The approach enables predictions to exit at earlier layers for simpler samples while…

机器学习 · 计算机科学 2024-12-30 Mehrnaz Mofakhami , Reza Bayat , Ioannis Mitliagkas , Joao Monteiro , Valentina Zantedeschi

Bayesian neural network models (BNN) have re-surged in recent years due to the advancement of scalable computations and its utility in solving complex prediction problems in a wide variety of applications. Despite the popularity and…

机器学习 · 统计学 2020-11-20 Shrijita Bhattacharya , Zihuan Liu , Tapabrata Maiti

Deployment of dynamic neural networks on edge accelerators requires careful consideration of hardware constraints beyond conventional complexity metrics such as Multiply-Accumulate operations. In Early-Exiting Neural Networks (EENN), exit…

计算复杂性 · 计算机科学 2026-04-01 Alaa Zniber , Arne Symons , Ouassim Karrakchou , Marian Verhelst , Mounir Ghogho

When building either prediction intervals for regression (with real-valued response) or prediction sets for classification (with categorical responses), uncertainty quantification is essential to studying complex machine learning methods.…

机器学习 · 统计学 2022-06-17 Chen Xu , Yao Xie

Artificial Neural Networks are connectionist systems that perform a given task by learning on examples without having prior knowledge about the task. This is done by finding an optimal point estimate for the weights in every node.…

机器学习 · 计算机科学 2019-01-10 Kumar Shridhar , Felix Laumann , Marcus Liwicki

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

机器学习 · 计算机科学 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

Traditional deep neural nets (NNs) have shown the state-of-the-art performance in the task of classification in various applications. However, NNs have not considered any types of uncertainty associated with the class probabilities to…

机器学习 · 计算机科学 2019-10-16 Xujiang Zhao , Yuzhe Ou , Lance Kaplan , Feng Chen , Jin-Hee Cho

Traditional deep neural networks (NNs) have significantly contributed to the state-of-the-art performance in the task of classification under various application domains. However, NNs have not considered inherent uncertainty in data…

机器学习 · 计算机科学 2021-05-05 Yibo Hu , Yuzhe Ou , Xujiang Zhao , Jin-Hee Cho , Feng Chen

Intelligibility and accurate uncertainty estimation are crucial for reliable decision-making. In this paper, we propose EviNAM, an extension of evidential learning that integrates the interpretability of Neural Additive Models (NAMs) with…

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for post-hoc confidence…

计算机视觉与模式识别 · 计算机科学 2021-09-22 Fabian Küppers , Jan Kronenberger , Jonas Schneider , Anselm Haselhoff

Autonomous Vehicle (AV) perception systems have advanced rapidly in recent years, providing vehicles with the ability to accurately interpret their environment. Perception systems remain susceptible to errors caused by overly-confident…

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

机器学习 · 计算机科学 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis