English
Related papers

Related papers: Adaptive Deep Neural Network Inference Optimizatio…

200 papers

Pretrained models have become standard in both vision and language, yet they typically do not provide reliable measures of confidence. Existing uncertainty estimation methods, such as deep ensembles and MC dropout, are often too…

Machine Learning · Computer Science 2026-04-13 Yongchan Chun , Chanhee Park , Jeongho Yoon , Jaehyung Seo , Heuiseok Lim

Automatic modulation classification (AMC) plays a critical role in wireless communications by autonomously classifying signals transmitted over the radio spectrum. Deep learning (DL) techniques are increasingly being used for AMC due to…

Networking and Internet Architecture · Computer Science 2023-11-10 Elsayed Mohammed , Omar Mashaal , Hatem Abou-Zeid

Dropout, a simple and effective way to train deep neural networks, has led to a number of impressive empirical successes and spawned many recent theoretical investigations. However, the gap between dropout's training and inference phases,…

Machine Learning · Computer Science 2017-02-17 Xuezhe Ma , Yingkai Gao , Zhiting Hu , Yaoliang Yu , Yuntian Deng , Eduard Hovy

Predictive models in acute care settings must be able to immediately recognize precipitous changes in a patient's status when presented with data reflecting such changes. Recurrent neural networks (RNNs) have become common for training and…

Machine Learning · Computer Science 2020-07-30 David Ledbetter , Eugene Laksana , Melissa Aczon , Randall Wetzel

Deep neural networks (DNNs) have become powerful tools for modeling complex data structures through sequentially integrating simple functions in each hidden layer. In survival analysis, recent advances of DNNs primarily focus on enhancing…

Machine Learning · Statistics 2025-03-26 Changhui Yuan , Shishun Zhao , Shuwei Li , Xinyuan Song , Zhao Chen

Artificial neural network pruning is a method in which artificial neural network sizes can be reduced while attempting to preserve the predicting capabilities of the network. This is done to make the model smaller or faster during inference…

Machine Learning · Computer Science 2025-05-21 Alexandre Broggi , Nathaniel Bastian , Lance Fiondella , Gokhan Kul

Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object…

Machine Learning · Computer Science 2025-12-23 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Guochu Xiong , Weichen Liu

Applying deep neural networks (DNNs) in mobile and safety-critical systems, such as autonomous vehicles, demands a reliable and efficient execution on hardware. Optimized dedicated hardware accelerators are being developed to achieve this.…

Machine Learning · Computer Science 2019-10-01 Christoph Schorn , Thomas Elsken , Sebastian Vogel , Armin Runge , Andre Guntoro , Gerd Ascheid

Deep neural networks (DNNs) are widely used in autonomous driving due to their high accuracy for perception, decision, and control. In safety-critical systems like autonomous driving, executing tasks like sensing and perception in real-time…

Machine Learning · Computer Science 2022-09-14 Liangkai Liu , Yanzhi Wang , Weisong Shi

Dynamic early exiting has been proven to improve the inference speed of the pre-trained language model like BERT. However, all samples must go through all consecutive layers before early exiting and more complex samples usually go through…

Computation and Language · Computer Science 2023-05-09 Boren Hu , Yun Zhu , Jiacheng Li , Siliang Tang

Modern predictive models are often deployed to environments in which computational budgets are dynamic. Anytime algorithms are well-suited to such environments as, at any point during computation, they can output a prediction whose quality…

Machine Learning · Computer Science 2023-10-31 Metod Jazbec , James Urquhart Allingham , Dan Zhang , Eric Nalisnick

This paper proposes a deep neural network (DNN)-driven framework to address the longstanding generalization challenge in adaptive filtering (AF). In contrast to traditional AF frameworks that emphasize explicit cost function design, the…

Machine Learning · Statistics 2025-08-07 Qizhen Wang , Gang Wang , Ying-Chang Liang

The expressiveness of neural networks highly depends on the nature of the activation function, although these are usually assumed predefined and fixed during the training stage. Under a signal processing perspective, in this paper we…

Signal Processing · Electrical Eng. & Systems 2024-05-28 Marc Martinez-Gost , Ana Pérez-Neira , Miguel Ángel Lagunas

Spiking neural networks (SNNs) offer inherent energy efficiency due to their event-driven computation model, making them promising for edge AI deployment. However, their practical adoption is limited by the computational overhead of deep…

Machine Learning · Computer Science 2026-03-17 Parth Patne , Mahdi Taheri , Ali Mahani , Maksim Jenihhin , Reza Mahani , Christian Herglotz

Recently, deploying deep neural network (DNN) models via collaborative inference, which splits a pre-trained model into two parts and executes them on user equipment (UE) and edge server respectively, becomes attractive. However, the large…

Machine Learning · Computer Science 2022-06-14 Zhiwei Hao , Guanyu Xu , Yong Luo , Han Hu , Jianping An , Shiwen Mao

Deploying deep neural networks on edge devices requires balancing accuracy, latency, and resource constraints under realistic execution conditions. To fit models within these constraints, two broad strategies have emerged: static…

Artificial Intelligence · Computer Science 2026-04-17 Nekane Fernandez , Ivan Valdes , Steven Van Vaerenbergh , Idoia de la Iglesia , Julen Arratibel

Early exiting has become a promising approach to improving the inference efficiency of deep networks. By structuring models with multiple classifiers (exits), predictions for ``easy'' samples can be generated at earlier exits, negating the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yizeng Han , Dongchen Han , Zeyu Liu , Yulin Wang , Xuran Pan , Yifan Pu , Chao Deng , Junlan Feng , Shiji Song , Gao Huang

The ubiquitous use of IoT and machine learning applications is creating large amounts of data that require accurate and real-time processing. Although edge-based smart data processing can be enabled by deploying pretrained models, the…

Machine Learning · Computer Science 2021-09-15 Yinghan Long , Indranil Chakraborty , Gopalakrishnan Srinivasan , Kaushik Roy

Convolutional neural networks (CNNs) have recently become the state-of-the-art in a diversity of AI tasks. Despite their popularity, CNN inference still comes at a high computational cost. A growing body of work aims to alleviate this by…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Stefanos Laskaridis , Stylianos I. Venieris , Hyeji Kim , Nicholas D. Lane

The problem of automatic and accurate forecasting of time-series data has always been an interesting challenge for the machine learning and forecasting community. A majority of the real-world time-series problems have non-stationary…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Rohit Kaushik , Shikhar Jain , Siddhant Jain , Tirtharaj Dash