English
Related papers

Related papers: On-Sensor Convolutional Neural Networks with Early…

200 papers

Convolutional Neural Networks (CNNs) usually use the same activation function, such as RELU, for all convolutional layers. There are performance limitations of just using RELU. In order to achieve better classification performance, reduce…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Luna M. Zhang

Running deep neural networks (DNNs) on tiny Micro-controller Units (MCUs) is challenging due to their limitations in computing, memory, and storage capacity. Fortunately, recent advances in both MCU hardware and machine learning software…

Machine Learning · Computer Science 2022-08-25 Michael Bechtel , QiTao Weng , Heechul Yun

A new algorithm for incremental learning in the context of Tiny Machine learning (TinyML) is presented, which is optimized for low-performance and energy efficient embedded devices. TinyML is an emerging field that deploys machine learning…

Machine Learning · Computer Science 2024-09-12 Marcus Rüb , Philipp Tuchel , Axel Sikora , Daniel Mueller-Gritschneder

In the context of industry 4.0, long-serving industrial machines can be retrofitted with process monitoring capabilities for future use in a smart factory. One possible approach is the deployment of wireless monitoring systems, which can…

Machine Learning · Computer Science 2025-08-25 Tim Langer , Matthias Widra , Volkhard Beyer

In this current technological world, the application of machine learning is becoming ubiquitous. Incorporating machine learning algorithms on extremely low-power and inexpensive embedded devices at the edge level is now possible due to the…

Machine Learning · Computer Science 2022-11-09 Harsha Yelchuri , Rashmi R

Recent advancements in machine learning (ML) have enabled its deployment on resource-constrained edge devices, fostering innovative applications such as intelligent environmental sensing. However, these devices, particularly…

Machine Learning · Computer Science 2025-04-15 Yi Hu , Jinhang Zuo , Eddie Zhang , Bob Iannucci , Carlee Joe-Wong

Recent advances in state-of-the-art ultra-low power embedded devices for machine learning (ML) have permitted a new class of products whose key features enable ML capabilities on microcontrollers with less than 1 mW power consumption…

Machine Learning · Computer Science 2021-12-03 Anas Osman , Usman Abid , Luca Gemma , Matteo Perotto , Davide Brunelli

Tiny deep learning on microcontroller units (MCUs) is challenging due to the limited memory size. We find that the memory bottleneck is due to the imbalanced memory distribution in convolutional neural network (CNN) designs: the first…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ji Lin , Wei-Ming Chen , Han Cai , Chuang Gan , Song Han

Over the last years the rapid growth Machine Learning (ML) inference applications deployed on the Edge is rapidly increasing. Recent Internet of Things (IoT) devices and microcontrollers (MCUs), become more and more mainstream in everyday…

Hardware Architecture · Computer Science 2024-07-08 Elisavet Lydia Alvanaki , Manolis Katsaragakis , Dimosthenis Masouros , Sotirios Xydis , Dimitrios Soudris

Recent advances in Tiny Machine Learning (TinyML) empower low-footprint embedded devices for real-time on-device Machine Learning. While many acknowledge the potential benefits of TinyML, its practical implementation presents unique…

Machine Learning · Computer Science 2024-05-17 Haoyu Ren , Xue Li , Darko Anicic , Thomas A. Runkler

Nowadays, Neural Networks represent a major expectation for the realization of powerful Deep Learning algorithms, which can determine several physical systems' behaviors and operations. Computational resources required for model, training,…

Machine Learning · Computer Science 2021-03-02 Giulia Crocioni , Giambattista Gruosso , Danilo Pau , Davide Denaro , Luigi Zambrano , Giuseppe di Giore

IoT devices based on microcontroller units (MCU) provide ultra-low power consumption and ubiquitous computation for near-sensor deep learning models (DNN). However, the memory of MCU is usually 2-3 orders of magnitude smaller than mobile…

Hardware Architecture · Computer Science 2024-06-12 Size Zheng , Renze Chen , Meng Li , Zihao Ye , Luis Ceze , Yun Liang

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Tiny Machine Learning (TinyML) is an upsurging research field that proposes to democratize the use of Machine Learning and Deep Learning on highly energy-efficient frugal Microcontroller Units. Considering the general assumption that TinyML…

Machine Learning · Computer Science 2023-02-15 Visal Rajapakse , Ishan Karunanayake , Nadeem Ahmed

Super-TinyML aims to optimize machine learning models for deployment on ultra-low-power application domains such as wearable technologies and implants. Such domains also require conformality, flexibility, and non-toxicity which traditional…

Hardware Architecture · Computer Science 2024-12-10 Gurol Saglam , Florentia Afentaki , Georgios Zervakis , Mehdi B. Tahoori

Tiny Machine Learning (TinyML) applications impose uJ/Inference constraints, with a maximum power consumption of tens of mW. It is extremely challenging to meet these requirements at a reasonable accuracy level. This work addresses the…

Hardware Architecture · Computer Science 2022-12-02 Moritz Scherer , Alfio Di Mauro , Tim Fischer , Georg Rutishauser , Luca Benini

We train and deploy a quantized 1D convolutional neural network model to conduct speech recognition on a highly resource-constrained IoT edge device. This can be useful in various Internet of Things (IoT) applications, such as smart homes…

Sound · Computer Science 2025-12-03 Andrew Barovic , Armin Moin

Earth observation (EO) missions traditionally rely on transmitting raw or minimally processed imagery from satellites to ground stations for computationally intensive analysis. This paradigm is infeasible for CubeSat systems due to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Luigi Capogrosso , Michele Magno

Convolutional neural networks (CNNs) are used in many embedded applications, from industrial robotics and automation systems to biometric identification on mobile devices. State-of-the-art classification is typically achieved by large…

Machine Learning · Computer Science 2020-05-22 Yuan Wen , Andrew Anderson , Valentin Radu , Michael F. P. O'Boyle , David Gregg

Larger Spiking Neural Network (SNN) models are typically favorable as they can offer higher accuracy. However, employing such models on the resource- and energy-constrained embedded platforms is inefficient. Towards this, we present a…

Neural and Evolutionary Computing · Computer Science 2022-06-20 Rachmad Vidya Wicaksana Putra , Muhammad Shafique