English
Related papers

Related papers: Training on the Fly: On-device Self-supervised Lea…

200 papers

This work aims to enable on-device training of convolutional neural networks (CNNs) by reducing the computation cost at training time. CNN models are usually trained on high-performance computers and only the trained models are deployed to…

Machine Learning · Computer Science 2020-07-08 Yawen Wu , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Keyword spotting systems for always-on TinyML-constrained applications require on-site tuning to boost the accuracy of offline trained classifiers when deployed in unseen inference conditions. Adapting to the speech peculiarities of target…

Sound · Computer Science 2024-03-13 Cristian Cioflan , Lukas Cavigelli , Luca Benini

Running deep neural networks (DNNs) on tiny Micro-controller Units (MCUs) is challenging due to their limitations in computing, memory, and storage capacity. Fortunately, recent advances in both MCU hardware and machine learning software…

Machine Learning · Computer Science 2022-08-25 Michael Bechtel , QiTao Weng , Heechul Yun

Event cameras provide low-latency perception for only milliwatts of power. This makes them highly suitable for resource-restricted, agile robots such as small flying drones. Self-supervised learning based on contrast maximization holds…

Robotics · Computer Science 2025-03-26 Jesse Hagenaars , Yilun Wu , Federico Paredes-Vallés , Stein Stroobants , Guido de Croon

In the last few years, research and development on Deep Learning models and techniques for ultra-low-power devices in a word, TinyML has mainly focused on a train-then-deploy assumption, with static models that cannot be adapted to newly…

Machine Learning · Computer Science 2022-09-07 Leonardo Ravaglia , Manuele Rusci , Davide Nadalini , Alessandro Capotondi , Francesco Conti , Luca Benini

Ego-motion estimation is vital for drones when flying in GPS-denied environments. Vision-based methods struggle when flight speed increases and close-by objects lead to difficult visual conditions with considerable motion blur and large…

Robotics · Computer Science 2025-05-01 Stavrow A. Bahnam , Christophe De Wagter , Guido C. H. E. de Croon

Artificial intelligence-powered pocket-sized air robots have the potential to revolutionize the Internet-of-Things ecosystem, acting as autonomous, unobtrusive, and ubiquitous smart sensors. With a few cm$^{2}$ form-factor, nano-sized…

Over the past decade, the dominance of deep learning has prevailed across various domains of artificial intelligence, including natural language processing, computer vision, and biomedical signal processing. While there have been remarkable…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Hou-I Liu , Marco Galindo , Hongxia Xie , Lai-Kuan Wong , Hong-Han Shuai , Yung-Hui Li , Wen-Huang Cheng

Palm-sized autonomous nano-drones, i.e., sub-50g in weight, recently entered the drone racing scenario, where they are tasked to avoid obstacles and navigate as fast as possible through gates. However, in contrast with their bigger…

Robotics · Computer Science 2025-03-10 Lorenzo Scarciglia , Antonio Paolillo , Daniele Palossi

Health monitoring applications increasingly rely on machine learning techniques to learn end-user physiological and behavioral patterns in everyday settings. Considering the significant role of wearable devices in monitoring human body…

Machine Learning · Computer Science 2022-08-03 Sina Shahhosseini , Yang Ni , Hamidreza Alikhani , Emad Kasaeyan Naeini , Mohsen Imani , Nikil Dutt , Amir M. Rahmani

Tiny Machine Learning (TinyML) is a new frontier of machine learning. By squeezing deep learning models into billions of IoT devices and microcontrollers (MCUs), we expand the scope of AI applications and enable ubiquitous intelligence.…

Machine Learning · Computer Science 2024-04-02 Ji Lin , Ligeng Zhu , Wei-Ming Chen , Wei-Chen Wang , Song Han

The field of Tiny Machine Learning (TinyML) has gained significant attention due to its potential to enable intelligent applications on resource-constrained devices. This review provides an in-depth analysis of the advancements in efficient…

Machine Learning · Statistics 2023-11-21 Minh Tri Lê , Pierre Wolinski , Julyan Arbel

Precise relative localization is a crucial functional block for swarm robotics. This work presents a novel autonomous end-to-end system that addresses the monocular relative localization, through deep neural networks (DNNs), of two peer…

Recent advancements in machine learning (ML) have enabled its deployment on resource-constrained edge devices, fostering innovative applications such as intelligent environmental sensing. However, these devices, particularly…

Machine Learning · Computer Science 2025-04-15 Yi Hu , Jinhang Zuo , Eddie Zhang , Bob Iannucci , Carlee Joe-Wong

Tiny Machine Learning (TinyML) is a novel research field aiming at integrating Machine Learning (ML) within embedded devices with limited memory, computation, and energy. Recently, a new branch of TinyML has emerged, focusing on integrating…

Self-supervised learning (SSL) has transformed representation learning for large models, yet remains unexplored for microcontroller (MCU)-class models with fewer than 500K parameters. We identify three obstacles at this scale -- projection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Bibin Wilson

On-device machine learning (ML) promises to improve the privacy, responsiveness, and proliferation of new, intelligent user experiences by moving ML computation onto everyday personal devices. However, today's large ML models must be…

Human-Computer Interaction · Computer Science 2024-04-05 Fred Hohman , Mary Beth Kery , Donghao Ren , Dominik Moritz

The accuracy of tinyML applications is often affected by various environmental factors, such as noises, location/calibration of sensors, and time-related changes. This article introduces a neural network based on-device learning (ODL)…

Machine Learning · Computer Science 2023-12-27 Kazuki Sunaga , Masaaki Kondo , Hiroki Matsutani

Standard-size autonomous navigation vehicles have rapidly improved thanks to the breakthroughs of deep learning. However, scaling autonomous driving to low-power systems deployed on dynamic environments poses several challenges that prevent…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Miguel de Prado , Manuele Rusci , Romain Donze , Alessandro Capotondi , Serge Monnerat , Luca Benini and , Nuria Pazos

RISC-V-based architectures are paving the way for efficient On-Device Learning (ODL) in smart edge devices. When applied across multiple nodes, ODL enables the creation of intelligent sensor networks that preserve data privacy. However,…

Machine Learning · Computer Science 2025-04-23 Lars Kröger , Cristian Cioflan , Victor Kartsch , Luca Benini