English
Related papers

Related papers: Temporal Patience: Efficient Adaptive Deep Learnin…

200 papers

Deep learning is rapidly becoming a go-to tool for many artificial intelligence problems due to its ability to outperform other approaches and even humans at many problems. Despite its popularity we are still unable to accurately predict…

Machine Learning · Computer Science 2018-11-30 Daniel Justus , John Brennan , Stephen Bonner , Andrew Stephen McGough

Deploying large language model inference remains challenging due to their high computational overhead. Early exit optimizes model inference by adaptively reducing the number of inference layers. Current methods typically train internal…

Computation and Language · Computer Science 2026-03-05 Lianming Huang , Shangyu Wu , Yufei Cui , Ying Xiong , Haibo Hu , Xue Liu , Tei-Wei Kuo , Nan Guan , Chun Jason Xue

The recent ground-breaking advances in deep learning networks ( DNNs ) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-limited embedded devices. Offloading the…

Performance · Computer Science 2018-05-14 Ben Taylor , Vicent Sanz Marco , Willy Wolff , Yehia Elkhatib , Zheng Wang

Early Exit Neural Networks (EENNs) present a solution to enhance the efficiency of neural network deployments. However, creating EENNs is challenging and requires specialized domain knowledge, due to the large amount of additional design…

Machine Learning · Computer Science 2024-03-14 Max Sponner , Lorenzo Servadei , Bernd Waschneck , Robert Wille , Akash Kumar

Learning at the edge is a challenging task from several perspectives, since data must be collected by end devices (e.g. sensors), possibly pre-processed (e.g. data compression), and finally processed remotely to output the result of…

Signal Processing · Electrical Eng. & Systems 2022-04-26 Mattia Merluzzi , Claudio Battiloro , Paolo Di Lorenzo , Emilio Calvanese Strinati

Early exiting is an effective paradigm for improving the inference efficiency of deep networks. By constructing classifiers with varying resource demands (the exits), such networks allow easy samples to be output at early exits, removing…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yizeng Han , Yifan Pu , Zihang Lai , Chaofei Wang , Shiji Song , Junfen Cao , Wenhui Huang , Chao Deng , Gao Huang

Deep learning has been used to demonstrate end-to-end neural network learning for autonomous vehicle control from raw sensory input. While LiDAR sensors provide reliably accurate information, existing end-to-end driving solutions are mainly…

Robotics · Computer Science 2021-05-21 Zhijian Liu , Alexander Amini , Sibo Zhu , Sertac Karaman , Song Han , Daniela Rus

Deep neural networks have become larger over the years with increasing demand of computational resources for inference; incurring exacerbate costs and leaving little room for deployment on devices with limited battery and other resources…

Machine Learning · Computer Science 2021-09-28 Aaqib Saeed

The paper presents an efficient real-time scheduling algorithm for intelligent real-time edge services, defined as those that perform machine intelligence tasks, such as voice recognition, LIDAR processing, or machine vision, on behalf of…

Machine Learning · Computer Science 2020-11-03 Shuochao Yao , Yifan Hao , Yiran Zhao , Huajie Shao , Dongxin Liu , Shengzhong Liu , Tianshi Wang , Jinyang Li , Tarek Abdelzaher

Provenance embedding algorithms are well known for tracking the footprints of information flow in wireless networks. Recently, low-latency provenance embedding algorithms have received traction in vehicular networks owing to strict…

Information Theory · Computer Science 2022-04-04 Suraj Sajeev , Manish Bansal , Sriraam S , J. Harshan , Huzur Saran , Yih-Chun Hu

DNNs are becoming less and less over-parametrised due to recent advances in efficient model design, through careful hand-crafted or NAS-based methods. Relying on the fact that not all inputs require the same amount of computation to yield a…

Machine Learning · Computer Science 2021-06-10 Stefanos Laskaridis , Alexandros Kouris , Nicholas D. Lane

Early-exit deep neural networks enable adaptive inference by terminating computation when sufficient confidence is achieved, reducing cost for edge AI accelerators in resource-constrained settings. Existing methods, however, rely on…

Hardware Architecture · Computer Science 2026-03-16 Parth Patne , Mahdi Taheri , Christian Herglotz , Maksim Jenihhin , Milos Krstic , Michael Hübner

Present-day Deep Reinforcement Learning (RL) systems show great promise towards building intelligent agents surpassing human-level performance. However, the computational complexity associated with the underlying deep neural networks (DNNs)…

Machine Learning · Computer Science 2021-09-20 Adarsh Kumar Kosta , Malik Aqeel Anwar , Priyadarshini Panda , Arijit Raychowdhury , Kaushik Roy

Timely processing has been increasingly required on smart IoT devices, which leads to directly implementing information processing tasks on an IoT device for bandwidth savings and privacy assurance. Particularly, monitoring and tracking the…

Networking and Internet Architecture · Computer Science 2021-07-27 Muhammad Aftab , Sid Chi-Kin Chau , Prashant Shenoy

Radar is a key component of the suite of perception sensors used for safe and reliable navigation of autonomous vehicles. Its unique capabilities include high-resolution velocity imaging, detection of agents in occlusion and over long…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Arvind Srivastav , Soumyajit Mandal

Modern vehicles are increasingly connected, and in this context, automotive Ethernet is one of the technologies that promise to provide the necessary infrastructure for intra-vehicle communication. However, these systems are subject to…

Machine Learning · Computer Science 2025-07-03 Pedro R. X. Carmo , Igor de Moura , Assis T. de Oliveira Filho , Djamel Sadok , Cleber Zanchettin

Deep learning models deployed on edge devices frequently encounter resource variability, which arises from fluctuating energy levels, timing constraints, or prioritization of other critical tasks within the system. State-of-the-art machine…

Machine Learning · Computer Science 2025-07-29 Francesco Corti , Balz Maag , Joachim Schauer , Ulrich Pferschy , Olga Saukh

The Internet of Things is transforming various fields, with sensors increasingly embedded in wearables, smart buildings, and connected equipment. While deep learning enables valuable insights from IoT data, conventional models are too…

Machine Learning · Computer Science 2026-04-01 Alaa Zniber , Mounir Ghogho , Ouassim Karrakchou , Mehdi Zakroum

State-of-the-art deep learning models have achieved significant performance levels on various benchmarks. However, the excellent performance comes at a cost of inefficient computational cost. Light-weight architectures, on the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Mohammad Akbari , Amin Banitalebi-Dehkordi , Yong Zhang

The fast deployment of cognitive radar to counter jamming remains a critical challenge in modern warfare, where more efficient deployment leads to quicker detection of targets. Existing methods are primarily based on evolutionary…

Artificial Intelligence · Computer Science 2026-01-06 Wencheng Cai , Xuchao Gao , Congying Han , Mingqiang Li , Tiande Guo