English
Related papers

Related papers: Efficient Neural Networks for Tiny Machine Learnin…

200 papers

Designing deep learning models for highly-constrained hardware would allow imbuing many edge devices with intelligence. Microcontrollers (MCUs) are an attractive platform for building smart devices due to their low cost, wide availability,…

Machine Learning · Computer Science 2020-03-04 Edgar Liberis , Nicholas D. Lane

Time series classification underpins applications such as human activity recognition, healthcare monitoring, and gesture detection in the IoT domain. Tiny Machine Learning enables models to run directly on low-power microcontroller units,…

Performance · Computer Science 2026-03-06 Bidyut Saha , Riya Samanta

Recent advancements in ultra-low-power machine learning (TinyML) hardware promises to unlock an entirely new class of smart applications. However, continued progress is limited by the lack of a widely accepted benchmark for these systems.…

Deep learning has revolutionized medical image analysis, playing a vital role in modern clinical applications. However, the deployment of large-scale models in real-world clinical settings remains challenging due to high computational…

Machine Learning · Computer Science 2026-02-03 Cuong Manh Nguyen , Truong-Son Hy

Deep neural networks (DNNs) are currently widely used for many artificial intelligence (AI) applications including computer vision, speech recognition, and robotics. While DNNs deliver state-of-the-art accuracy on many AI tasks, it comes at…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Vivienne Sze , Yu-Hsin Chen , Tien-Ju Yang , Joel Emer

Tiny machine learning (tinyML) has emerged during the past few years aiming to deploy machine learning models to embedded AI processors with highly constrained memory and computation capacity. Low precision quantization is an important…

Frugal Machine Learning (FML) refers to the practice of designing Machine Learning (ML) models that are efficient, cost-effective, and mindful of resource constraints. This field aims to achieve acceptable performance while minimizing the…

Machine Learning · Computer Science 2025-06-03 John Violos , Konstantina-Christina Diamanti , Ioannis Kompatsiaris , Symeon Papadopoulos

Deep Learning has revolutionized the fields of computer vision, natural language understanding, speech recognition, information retrieval and more. However, with the progressive improvements in deep learning models, their number of…

Machine Learning · Computer Science 2024-04-17 Gaurav Menghani

Lightweight design, as a key approach to mitigate disparity between computational requirements of deep learning models and hardware performance, plays a pivotal role in advancing application of deep learning technologies on mobile and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Hanhua Long , Wenbin Bi , Jian Sun

Tiny deep learning on microcontroller units (MCUs) is challenging due to the limited memory size. We find that the memory bottleneck is due to the imbalanced memory distribution in convolutional neural network (CNN) designs: the first…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ji Lin , Wei-Ming Chen , Han Cai , Chuang Gan , Song Han

While significant advances in deep learning has resulted in state-of-the-art performance across a large number of complex visual perception tasks, the widespread deployment of deep neural networks for TinyML applications involving…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Alexander Wong , Mahmoud Famouri , Mohammad Javad Shafiee

While there exist many ways to deploy machine learning models on microcontrollers, it is non-trivial to choose the optimal combination of frameworks and targets for a given application. Thus, automating the end-to-end benchmarking flow is…

Machine Learning · Computer Science 2024-07-08 Philipp van Kempen , Rafael Stahl , Daniel Mueller-Gritschneder , Ulf Schlichtmann

Deep learning is pervasive in our daily life, including self-driving cars, virtual assistants, social network services, healthcare services, face recognition, etc. However, deep neural networks demand substantial compute resources during…

The deployment of neural networks on resource-constrained micro-controllers has gained momentum, driving many advancements in Tiny Neural Networks. This paper introduces a tiny feed-forward neural network, TinyFC, integrated into the…

Machine Learning · Computer Science 2025-02-04 Martin Joel Mouk Elele , Danilo Pau , Shixin Zhuang , Tullio Facchinetti

Micromobility systems, which include lightweight and low-speed vehicles such as bicycles, e-bikes, and e-scooters, have become an important part of urban transportation and are used to solve problems such as traffic congestion, air…

Machine Learning · Computer Science 2025-08-25 Sen Yan , Chinmaya Kaundanya , Noel E. O'Connor , Suzanne Little , Mingming Liu

In the context of industry 4.0, long-serving industrial machines can be retrofitted with process monitoring capabilities for future use in a smart factory. One possible approach is the deployment of wireless monitoring systems, which can…

Machine Learning · Computer Science 2025-08-25 Tim Langer , Matthias Widra , Volkhard Beyer

Extreme edge devices or Internet-of-thing nodes require both ultra-low power always-on processing as well as the ability to do on-demand sampling and processing. Moreover, support for IoT applications like voice recognition, machine…

Hardware Architecture · Computer Science 2023-01-24 Vikram Jain , Sebastian Giraldo , Jaro De Roose , Linyan Mei , Bert Boons , Marian Verhelst

Machine learning (ML) has seen tremendous advancements, but its environmental footprint remains a concern. Acknowledging the growing environmental impact of ML this paper investigates Green ML, examining various model architectures and…

Machine Learning · Computer Science 2024-06-21 Ioannis Mavromatis , Kostas Katsaros , Aftab Khan

In the last few years, research and development on Deep Learning models and techniques for ultra-low-power devices in a word, TinyML has mainly focused on a train-then-deploy assumption, with static models that cannot be adapted to newly…

Machine Learning · Computer Science 2022-09-07 Leonardo Ravaglia , Manuele Rusci , Davide Nadalini , Alessandro Capotondi , Francesco Conti , Luca Benini

Currently, Machine Learning (ML) is becoming ubiquitous in everyday life. Deep Learning (DL) is already present in many applications ranging from computer vision for medicine to autonomous driving of modern cars as well as other sectors in…

Hardware Architecture · Computer Science 2020-12-22 Maurizio Capra , Beatrice Bussolino , Alberto Marchisio , Guido Masera , Maurizio Martina , Muhammad Shafique