English
Related papers

Related papers: Training on the Fly: On-device Self-supervised Lea…

200 papers

Autonomous drone racing competitions are a proxy to improve unmanned aerial vehicles' perception, planning, and control skills. The recent emergence of autonomous nano-sized drone racing imposes new challenges, as their ~10cm form factor…

Modern consumer electronic devices have started executing deep learning-based intelligence services on devices, not cloud servers, to keep personal data on devices and to reduce network and cloud costs. We find such a trend as the…

Machine Learning · Computer Science 2024-01-08 Ji Joong Moon , Hyun Suk Lee , Jiho Chu , Donghak Park , Seungbaek Hong , Hyungjun Seo , Donghyeon Jeong , Sungsik Kong , MyungJoo Ham

Continuously adapting pre-trained models to local data on resource constrained edge devices is the $\emph{last mile}$ for model deployment. However, as models increase in size and depth, backpropagation requires a large amount of memory,…

Machine Learning · Computer Science 2024-11-07 Chen Feng , Shaojie Zhuo , Xiaopeng Zhang , Ramchalam Kinattinkara Ramakrishnan , Zhaocong Yuan , Andrew Zou Li

Miniaturized autonomous unmanned aerial vehicles (UAVs) are gaining popularity due to their small size, enabling new tasks such as indoor navigation or people monitoring. Nonetheless, their size and simple electronics pose severe challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Matteo Risso , Francesco Daghero , Beatrice Alessandra Motetti , Daniele Jahier Pagliari , Enrico Macii , Massimo Poncino , Alessio Burrello

Deep learning models have introduced various intelligent applications to edge devices, such as image classification, speech recognition, and augmented reality. There is an increasing need of training such models on the devices in order to…

Machine Learning · Computer Science 2022-01-27 Kaiqi Zhao , Yitao Chen , Ming Zhao

Computing at the edge offers intriguing possibilities for the development of autonomy and artificial intelligence. The advancements in autonomous technologies and the resurgence of computer vision have led to a rise in demand for fast and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Martina Lofqvist , José Cano

Existing Continual Learning (CL) solutions only partially address the constraints on power, memory and computation of the deep learning models when deployed on low-power embedded CPUs. In this paper, we propose a CL solution that embraces…

Machine Learning · Computer Science 2023-08-30 Lorenzo Vorabbi , Davide Maltoni , Stefano Santi

On-device training of DNNs allows models to adapt and fine-tune to newly collected data or changing domains while deployed on microcontroller units (MCUs). However, DNN training is a resource-intensive task, making the implementation and…

Machine Learning · Computer Science 2024-10-24 Mark Deutel , Frank Hannig , Christopher Mutschler , Jürgen Teich

Despite its importance for federated learning, continuous learning and many other applications, on-device training remains an open problem for EdgeAI. The problem stems from the large number of operations (e.g., floating point…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Yuedong Yang , Guihong Li , Radu Marculescu

Tiny machine learning (TinyML) is a rapidly growing field aiming to democratize machine learning (ML) for resource-constrained microcontrollers (MCUs). Given the pervasiveness of these tiny devices, it is inherent to ask whether TinyML…

Machine Learning · Computer Science 2023-04-12 Haoyu Ren , Darko Anicic , Thomas A. Runkler

Deep neural networks (DNNs) have achieved unprecedented success in the field of artificial intelligence (AI), including computer vision, natural language processing and speech recognition. However, their superior performance comes at the…

Machine Learning · Computer Science 2022-04-26 Han Cai , Ji Lin , Yujun Lin , Zhijian Liu , Haotian Tang , Hanrui Wang , Ligeng Zhu , Song Han

Spiking Neural Networks (SNNs) have recently gained popularity as machine learning models for on-device edge intelligence for applications such as mobile healthcare management and natural language processing due to their low power profile.…

Neural and Evolutionary Computing · Computer Science 2021-03-09 Bleema Rosenfeld , Bipin Rajendran , Osvaldo Simeone

Flapping-Wing Micro Aerial Vehicles (FWMAVs) provide exceptional maneuverability and aerodynamic efficiency but pose significant challenges for onboard control due to nonlinear dynamics and stringent Size, Weight, and Power (SWaP)…

Robotics · Computer Science 2026-05-26 Rim El Filali , Chenrui Feng , Chao Gao , Weibin Gu

Extreme edge devices or Internet-of-thing nodes require both ultra-low power always-on processing as well as the ability to do on-demand sampling and processing. Moreover, support for IoT applications like voice recognition, machine…

Hardware Architecture · Computer Science 2023-01-24 Vikram Jain , Sebastian Giraldo , Jaro De Roose , Linyan Mei , Bert Boons , Marian Verhelst

In this paper, we introduce a low-cost and low-power tiny supervised on-device learning (ODL) core that can address the distributional shift of input data for human activity recognition. Although ODL for resource-limited edge devices has…

Machine Learning · Computer Science 2024-09-30 Hiroki Matsutani , Radu Marculescu

On-device machine learning is becoming a reality thanks to the availability of powerful hardware and model compression techniques. Typically, these models are pretrained on large GPU clusters and have enough parameters to generalise across…

Machine Learning · Computer Science 2021-02-03 Ilias Leontiadis , Stefanos Laskaridis , Stylianos I. Venieris , Nicholas D. Lane

On-device learning allows AI models to adapt to user data, thereby enhancing service quality on edge platforms. However, training AI on resource-limited devices poses significant challenges due to the demanding computing workload and the…

Hardware Architecture · Computer Science 2023-12-27 Sai Qian Zhang , Thierry Tambe , Nestor Cuevas , Gu-Yeon Wei , David Brooks

Continual learning (CL) on edge devices requires not only high accuracy but also training-time efficiency to support on-device adaptation under strict memory and computational constraints. While prompt-based continual learning (PCL) is…

Machine Learning · Computer Science 2026-04-10 Wonseon Lim , Jaesung Lee , Dae-Won Kim

Nano quadcopters are small, agile, and cheap platforms that are well suited for deployment in narrow, cluttered environments. Due to their limited payload, these vehicles are highly constrained in processing power, rendering conventional…

Robotics · Computer Science 2022-09-16 Rik J. Bouwmeester , Federico Paredes-Vallés , Guido C. H. E. de Croon

The increasing interest in TinyML, i.e., near-sensor machine learning on power budgets of a few tens of mW, is currently pushing toward enabling TinyML-class training as opposed to inference only. Current training algorithms, based on…

Hardware Architecture · Computer Science 2023-05-09 Yvan Tortorella , Luca Bertaccini , Luca Benini , Davide Rossi , Francesco Conti