English
Related papers

Related papers: Training on the Fly: On-device Self-supervised Lea…

200 papers

The rapid growth of microcontroller-based IoT devices has opened up numerous applications, from smart manufacturing to personalized healthcare. Despite the widespread adoption of energy-efficient microcontroller units (MCUs) in the Tiny…

Machine Learning · Computer Science 2024-09-26 Giorgos Armeniakos , Georgios Mentzos , Dimitrios Soudris

Nano-sized unmanned aerial vehicles (UAVs) are ideal candidates for flying Internet-of-Things smart sensors to collect information in narrow spaces. This requires ultra-fast navigation under very tight memory/computation constraints. The…

Image and Video Processing · Electrical Eng. & Systems 2024-07-18 Lorenzo Lamberti , Lorenzo Bellone , Luka Macan , Enrico Natalizio , Francesco Conti , Daniele Palossi , Luca Benini

Building intelligent autonomous systems at any scale is challenging. The sensing and computation constraints of a microrobot platform make the problems harder. We present improvements to learning-based methods for on-board learning of…

Robotics · Computer Science 2020-04-29 Nathan O. Lambert , Farhan Toddywala , Brian Liao , Eric Zhu , Lydia Lee , Kristofer S. J. Pister

Keyword spotting accuracy degrades when neural networks are exposed to noisy environments. On-site adaptation to previously unseen noise is crucial to recovering accuracy loss, and on-device learning is required to ensure that the…

Sound · Computer Science 2024-03-19 Cristian Cioflan , Lukas Cavigelli , Manuele Rusci , Miguel de Prado , Luca Benini

On-device learning enables edge devices to continually adapt the AI models to new data, which requires a small memory footprint to fit the tight memory constraint of edge devices. Existing work solves this problem by reducing the number of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Han Cai , Chuang Gan , Ligeng Zhu , Song Han

This research empirically examines embedded development tools viable for on-device TinyML implementation. The research evaluates various development tools with various abstraction levels on resource-constrained IoT devices, from basic…

Software Engineering · Computer Science 2024-04-12 Enzo Scaffi , Antoine Bonneau , Frédéric Le Mouël , Fabien Mieyeville

Miniaturized autonomous unmanned aerial vehicles (UAVs) are an emerging and trending topic. With their form factor as big as the palm of one hand, they can reach spots otherwise inaccessible to bigger robots and safely operate in human…

On-device learning remains a formidable challenge, especially when dealing with resource-constrained devices that have limited computational capabilities. This challenge is primarily rooted in two key issues: first, the memory available on…

Machine Learning · Computer Science 2024-01-19 Lorenzo Vorabbi , Davide Maltoni , Guido Borghi , Stefano Santi

The miniaturisation of sensors and processors, the advancements in connected edge intelligence, and the exponential interest in Artificial Intelligence are boosting the affirmation of autonomous nano-size drones in the Internet of Robotic…

Robotics · Computer Science 2025-05-09 Mattia Sartori , Chetna Singhal , Neelabhro Roy , Davide Brunelli , James Gross

Conventionally, DNN models are trained once in the cloud and deployed in edge devices such as cars, robots, or unmanned aerial vehicles (UAVs) for real-time inference. However, there are many cases that require the models to adapt to new…

Machine Learning · Computer Science 2022-02-23 Yue Tang , Xinyi Zhang , Peipei Zhou , Jingtong Hu

The recent breakthroughs in machine learning (ML) and deep learning (DL) have catalyzed the design and development of various intelligent systems over wide application domains. While most existing machine learning models require large…

Machine Learning · Computer Science 2024-09-24 Shuai Zhu , Thiemo Voigt , JeongGil Ko , Fatemeh Rahimian

This study introduces TinyPropv2, an innovative algorithm optimized for on-device learning in deep neural networks, specifically designed for low-power microcontroller units. TinyPropv2 refines sparse backpropagation by dynamically…

Machine Learning · Computer Science 2024-09-12 Marcus Rüb , Axel Sikora , Daniel Mueller-Gritschneder

Nano-sized drones, with palm-sized form factor, are gaining relevance in the Internet-of-Things ecosystem. Achieving a high degree of autonomy for complex multi-objective missions (e.g., safe flight, exploration, object detection) is…

The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering…

Machine Learning · Computer Science 2022-12-22 Swapnil Sayan Saha , Sandeep Singh Sandha , Mani Srivastava

The predominant paradigm for using machine learning models on a device is to train a model in the cloud and perform inference using the trained model on the device. However, with increasing number of smart devices and improved hardware,…

Machine Learning · Computer Science 2020-07-27 Sauptik Dhar , Junyao Guo , Jiayi Liu , Samarth Tripathi , Unmesh Kurup , Mohak Shah

The paradigm shift towards local and on-device inference under stringent resource constraints is represented by the tiny machine learning (TinyML) domain. The primary goal of TinyML is to integrate intelligence into tiny, low-cost devices…

Nano-size drones hold enormous potential to explore unknown and complex environments. Their small size makes them agile and safe for operation close to humans and allows them to navigate through narrow spaces. However, their tiny size and…

Robotics · Computer Science 2024-10-28 Hanna Müller , Vlad Niculescu , Tommaso Polonelli , Michele Magno , Luca Benini

Limited power and computational resources, absence of high-end sensor equipment and GPS-denied environments are challenges faced by autonomous micro areal vehicles (MAVs). We address these challenges in the context of autonomous navigation…

Robotics · Computer Science 2020-09-10 Max Christl

Biosignals exhibit substantial cross-subject and cross-session variability, inducing severe domain shifts that degrade post-deployment performance for small, edge-oriented AI models. On-device adaptation is therefore essential to both…

Machine Learning · Computer Science 2026-04-24 Run Wang , Victor J. B. Jung , Philip Wiese , Sebastian Frey , Giusy Spacone , Francesco Conti , Alessio Burrello , Luca Benini

On-device training has become an increasingly popular approach to machine learning, enabling models to be trained directly on mobile and edge devices. However, a major challenge in this area is the limited memory available on these devices,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-13 Shitian Li , Chunlin Tian , Kahou Tam , Rui Ma , Li Li