English
Related papers

Related papers: Fast Data Aware Neural Architecture Search via Sup…

200 papers

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

Machine Learning · Computer Science 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

The paradigm shift towards local and on-device inference under stringent resource constraints is represented by the tiny machine learning (TinyML) domain. The primary goal of TinyML is to integrate intelligence into tiny, low-cost devices…

Tiny Machine Learning (TinyML) is a branch of Machine Learning (ML) that constitutes a bridge between the ML world and the embedded system ecosystem (i.e., Internet of Things devices, embedded devices, and edge computing units), enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Hazem Hesham Yousef Shalby , Massimo Pavan , Manuel Roveri

Advances in Tiny Machine Learning (TinyML) have bolstered the creation of smart industry solutions, including smart agriculture, healthcare and smart cities. Whilst related research contributes to enabling TinyML solutions on constrained…

Machine Learning · Computer Science 2024-04-11 Jared M. Ping , Ken J. Nixon

Tiny Machine Learning (TinyML) enables efficient, lowcost, and privacy preserving machine learning inference directly on microcontroller units (MCUs) connected to sensors. Optimizing models for these constrained environments is crucial.…

Machine Learning · Computer Science 2024-09-18 Riya Samanta , Bidyut Saha , Soumya K. Ghosh , Ram Babu Roy

A new algorithm for incremental learning in the context of Tiny Machine learning (TinyML) is presented, which is optimized for low-performance and energy efficient embedded devices. TinyML is an emerging field that deploys machine learning…

Machine Learning · Computer Science 2024-09-12 Marcus Rüb , Philipp Tuchel , Axel Sikora , Daniel Mueller-Gritschneder

Tiny Machine Learning (TinyML) has become a growing field in on-device processing for Internet of Things (IoT) applications, capitalizing on AI algorithms that are optimized for their low complexity and energy efficiency. These algorithms…

Hardware Architecture · Computer Science 2024-11-05 Asmer Hamid Ali , Mozhgan Navardi , Tinoosh Mohsenin

Deploying deep neural networks (DNNs) on microcontrollers (TinyML) is a common trend to process the increasing amount of sensor data generated at the edge, but in practice, resource and latency constraints make it difficult to find optimal…

Machine Learning · Computer Science 2025-01-24 Mark Deutel , Georgios Kontes , Christopher Mutschler , Jürgen Teich

Traditional machine learning models often require powerful hardware, making them unsuitable for deployment on resource-limited devices. Tiny Machine Learning (tinyML) has emerged as a promising approach for running machine learning models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Hasib-Al Rashid , Argho Sarkar , Aryya Gangopadhyay , Maryam Rahnemoonfar , Tinoosh Mohsenin

Tiny Machine Learning (TinyML) is an upsurging research field that proposes to democratize the use of Machine Learning and Deep Learning on highly energy-efficient frugal Microcontroller Units. Considering the general assumption that TinyML…

Machine Learning · Computer Science 2023-02-15 Visal Rajapakse , Ishan Karunanayake , Nadeem Ahmed

Recent advancements in ultra-low-power machine learning (TinyML) hardware promises to unlock an entirely new class of smart applications. However, continued progress is limited by the lack of a widely accepted benchmark for these systems.…

Tiny machine learning (TinyML) co-locates models with sensors on microcontrollers, where small models (which are disproportionately sensitive to label noise) and bespoke binary tasks (which lack standard benchmarks) make general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Colby Banbury , Emil Njor , Andrea Mattia Garavagno , Mark Mazumder , Matthew Stewart , Pete Warden , Manjunath Kudlur , Nat Jeffries , Xenofon Fafoutis , Vijay Janapa Reddi

Recent advances in Tiny Machine Learning (TinyML) empower low-footprint embedded devices for real-time on-device Machine Learning. While many acknowledge the potential benefits of TinyML, its practical implementation presents unique…

Machine Learning · Computer Science 2024-05-17 Haoyu Ren , Xue Li , Darko Anicic , Thomas A. Runkler

With the surge of inexpensive computational and memory resources, neural networks (NNs) have experienced an unprecedented growth in architectural and computational complexity. Introducing NNs to resource-constrained devices enables…

Machine Learning · Computer Science 2021-04-22 Lennart Heim , Andreas Biri , Zhongnan Qu , Lothar Thiele

The rapid deployment of machine learning across platforms from milliwatt-class TinyML devices to large language models has made energy efficiency a primary constraint for sustainable AI. Across these scales, performance and energy are…

Hardware Architecture · Computer Science 2026-03-26 Mohammad Saleh Vahdatpour , Yanqing Zhang

Internet of Things (IoT) has catapulted human ability to control our environments through ubiquitous sensing, communication, computation, and actuation. Over the past few years, IoT has joined forces with Machine Learning (ML) to embed deep…

Software Engineering · Computer Science 2022-04-20 Shashank Bangalore Lakshman , Nasir U. Eisty

Machine learning on tiny IoT devices based on microcontroller units (MCU) is appealing but challenging: the memory of microcontrollers is 2-3 orders of magnitude smaller even than mobile phones. We propose MCUNet, a framework that jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Ji Lin , Wei-Ming Chen , Yujun Lin , John Cohn , Chuang Gan , Song Han

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

Machine Learning · Computer Science 2022-05-24 Daniel Cummings , Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Juan Pablo Munoz , Sairam Sundaresan

Due to limited computational cost and energy consumption, most neural network models deployed in mobile devices are tiny. However, tiny neural networks are commonly very vulnerable to attacks. Current research has proved that larger model…

Machine Learning · Computer Science 2022-01-11 Guoyang Xie , Jinbao Wang , Guo Yu , Feng Zheng , Yaochu Jin

Memory optimization for deep neural network (DNN) inference gains high relevance with the emergence of TinyML, which refers to the deployment of DNN inference tasks on tiny, low-power microcontrollers. Applications such as audio keyword…

Machine Learning · Computer Science 2023-04-03 Rafael Stahl , Daniel Mueller-Gritschneder , Ulf Schlichtmann