English
Related papers

Related papers: Using Early Exits for Fast Inference in Automatic …

200 papers

Early-Exit (EE) is a Large Language Model (LLM) architecture that accelerates inference by allowing easier tokens to be generated using only a subset of the model's layers. However, traditional batching frameworks are ill-suited for EE…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-18 Xuting Liu , Daniel Alexander , Siva Kesava Reddy Kakarla , Behnaz Arzani , Vincent Liu

The ability to dynamically adjust the computational load of neural models during inference in a resource aware manner is crucial for on-device processing scenarios, characterised by limited and time-varying computational resources.…

Computation and Language · Computer Science 2025-06-24 Maxence Lasbordes , Daniele Falavigna , Alessio Brutti

In this work, we investigate the feasibility and effectiveness of employing deep learning algorithms for automatic recognition of the modulation type of received wireless communication signals from subsampled data. Recent work considered a…

Signal Processing · Electrical Eng. & Systems 2019-01-18 Sharan Ramjee , Shengtai Ju , Diyu Yang , Xiaoyu Liu , Aly El Gamal , Yonina C. Eldar

This paper compares machine learning approaches with different input data formats for the classification of acoustic emission (AE) signals. AE signals are a promising monitoring technique in many structural health monitoring applications.…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Uditha Muthumala , Yuxuan Zhang , Luciano Sebastian Martinez-Rau , Sebastian Bader

Deep learning-based automatic modulation classification (AMC) models are susceptible to adversarial attacks. Such attacks inject specifically crafted wireless interference into transmitted signals to induce erroneous classification…

Signal Processing · Electrical Eng. & Systems 2021-09-17 Rajeev Sahay , Christopher G. Brinton , David J. Love

Automatic modulation classification (AMC) is a key technique for designing non-cooperative communication systems, and deep learning (DL) is applied effectively to AMC for improving classification accuracy. However, most of the DL-based AMC…

Signal Processing · Electrical Eng. & Systems 2023-04-25 Lantu Guo , Yu Wang , Yun Lin , Haitao Zhao , Guan Gui

In the evolution of 6th Generation (6G) technology, the emergence of cell-free networking presents a paradigm shift, revolutionizing user experiences within densely deployed networks where distributed access points collaborate. However, the…

Signal Processing · Electrical Eng. & Systems 2024-08-15 Dieter Verbruggen , Hazem Sallouha , Sofie Pollin

Early Exiting is one of the most popular methods to achieve efficient inference. Current early exiting methods adopt the (weighted) sum of the cross entropy loss of all internal classifiers during training, imposing all these classifiers to…

Computation and Language · Computer Science 2024-04-09 Ziqian Zeng , Yihuai Hong , Hongliang Dai , Huiping Zhuang , Cen Chen

Automatic modulation classification (AMC) aims to improve the efficiency of crowded radio spectrums by automatically predicting the modulation constellation of wireless RF signals. Recent work has demonstrated the ability of deep learning…

Signal Processing · Electrical Eng. & Systems 2021-02-23 Rajeev Sahay , Christopher G. Brinton , David J. Love

Automatic Modulation Classification (AMC) is an essential technology that is widely applied into various communications scenarios. In recent years, many Machine Learning and Deep-Learning methods have been introduced into AMC, and a lot of…

Signal Processing · Electrical Eng. & Systems 2024-12-31 N. Ussipov , S. Akhtanov , Z. Zhanabaev , D. Turlykozhayeva , B. Karibayev , T. Namazbayev , D. Almen , A. Akhmetali , X. Tang

Deep learning (DL) models have emerged as a promising solution for the Internet of Things (IoT). However, due to their computational complexity, DL models consume significant amounts of energy, which can rapidly drain the battery and…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Marcello Bullo , Seifallah Jardak , Pietro Carnelli , Deniz Gündüz

Automatic modulation recognition (AMR) detects the modulation scheme of the received signals for further signal processing without needing prior information, and provides the essential function when such information is missing. Recent…

Signal Processing · Electrical Eng. & Systems 2022-07-21 Fuxin Zhang , Chunbo Luo , Jialang Xu , Yang Luo , FuChun Zheng

Deploying Machine learning (ML) on milliwatt-scale edge devices (tinyML) is gaining popularity due to recent breakthroughs in ML and Internet of Things (IoT). Most tinyML research focuses on model compression techniques that trade accuracy…

Machine Learning · Computer Science 2023-04-28 Nikhil P Ghanathe , Steve Wilton

This work addresses the need for a balanced approach between performance and efficiency in scalable production environments for visually-rich document understanding (VDU) tasks. Currently, there is a reliance on large document foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Omar Hamed , Souhail Bakkali , Marie-Francine Moens , Matthew Blaschko , Jordy Van Landeghem

Identifying wireless modulation schemes is essential for cognitive radio, but standard supervised models often degrade under distribution shift, and training domain-specific wireless foundation models from scratch is computationally…

Machine Learning · Computer Science 2026-03-30 Mohammad Rostami , Atik Faysal , Reihaneh Gh. Roshan , Huaxia Wang , Nikhil Muralidhar , Yu-Dong Yao

DNNs are becoming less and less over-parametrised due to recent advances in efficient model design, through careful hand-crafted or NAS-based methods. Relying on the fact that not all inputs require the same amount of computation to yield a…

Machine Learning · Computer Science 2021-06-10 Stefanos Laskaridis , Alexandros Kouris , Nicholas D. Lane

In hierarchical cognitive radio networks, edge or cloud servers utilize the data collected by edge devices for modulation classification, which, however, is faced with problems of the transmission overhead, data privacy, and computation…

Information Retrieval · Computer Science 2024-09-17 Chaowei He , Peihao Dong , Fuhui Zhou , Qihui Wu

Multi-Exit models (MEMs) use an early-exit strategy to improve the accuracy and efficiency of deep neural networks (DNNs) by allowing samples to exit the network before the last layer. However, the effectiveness of MEMs in the presence of…

Machine Learning · Computer Science 2022-12-06 Akshay Mehra , Skyler Seto , Navdeep Jaitly , Barry-John Theobald

Deep neural networks have significantly improved performance on a range of tasks with the increasing demand for computational resources, leaving deployment on low-resource devices (with limited memory and battery power) infeasible. Binary…

Machine Learning · Computer Science 2022-06-22 Aaqib Saeed

State-of-the-art neural networks with early exit mechanisms often need considerable amount of training and fine tuning to achieve good performance with low computational cost. We propose a novel early exit technique, Early Exit Class Means…

Machine Learning · Computer Science 2022-10-28 Alperen Görmez , Venkat R. Dasari , Erdem Koyuncu