English
Related papers

Related papers: Low-Energy On-Device Personalization for MCUs

200 papers

In this work, we investigate the challenging problem of on-demand federated learning (FL) over heterogeneous edge devices with diverse resource constraints. We propose a cost-adjustable FL framework, named AnycostFL, that enables diverse…

Machine Learning · Computer Science 2023-10-31 Peichun Li , Guoliang Cheng , Xumin Huang , Jiawen Kang , Rong Yu , Yuan Wu , Miao Pan

Large Language Models (LLMs) demonstrate exceptional performance across diverse tasks but come with substantial energy and computational costs, particularly in request-heavy scenarios. In many real-world applications, the full scale and…

Computation and Language · Computer Science 2026-03-24 Patrick Wilhelm , Thorsten Wittkopp , Odej Kao

A growing trend has emerged in designing high-quality Small Language Models (SLMs) with a few million parameters. This trend is driven by the increasing concerns over cloud costs, privacy, and latency. Considering that full parameter…

Machine Learning · Computer Science 2025-07-03 Xuan Shen , Peiyan Dong , Zhenglun Kong , Yifan Gong , Changdi Yang , Zhaoyang Han , Yanyue Xie , Lei Lu , Cheng Lyu , Chao Wu , Yanzhi Wang , Pu Zhao

Energy-efficiency is a key concern for neural network applications. To alleviate this issue, hardware acceleration using FPGAs or GPUs can provide better energy-efficiency than general-purpose processors. However, further improvement of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-29 Seyed Morteza Nabavinejad , Behzad Salami

The Internet of Medical Things (IoMT) paradigm is becoming mainstream in multiple clinical trials and healthcare procedures. Cardiovascular diseases monitoring, usually involving electrocardiogram (ECG) traces analysis, is one of the most…

Machine Learning · Computer Science 2021-07-26 Matteo Antonio Scrugli , Daniela Loi , Luigi Raffo , Paolo Meloni

While there exist many ways to deploy machine learning models on microcontrollers, it is non-trivial to choose the optimal combination of frameworks and targets for a given application. Thus, automating the end-to-end benchmarking flow is…

Machine Learning · Computer Science 2024-07-08 Philipp van Kempen , Rafael Stahl , Daniel Mueller-Gritschneder , Ulf Schlichtmann

This paper presents a novel approach for performing computations using Look-Up Tables (LUTs) tailored specifically for Compute-in-Memory applications. The aim is to address the scalability challenges associated with LUT-based computation by…

Hardware Architecture · Computer Science 2023-11-20 Peyman Dehghanzadeh , Baibhab Chatterjee , Swarup Bhunia

Various hardware accelerators have been developed for energy-efficient and real-time inference of neural networks on edge devices. However, most training is done on high-performance GPUs or servers, and the huge memory and computing costs…

Hardware Architecture · Computer Science 2021-04-21 Kaiqi Zhang , Cole Hawkins , Xiyuan Zhang , Cong Hao , Zheng Zhang

The steeply growing performance demands for highly power- and energy-constrained processing systems such as end-nodes of the internet-of-things (IoT) have led to parallel near-threshold computing (NTC), joining the energy-efficiency…

Hardware Architecture · Computer Science 2020-04-15 Florian Glaser , Giuseppe Tagliavini , Davide Rossi , Germain Haugou , Qiuting Huang , Luca Benini

The large increase in the number of Internet of Things (IoT) devices have revolutionised the way data is processed, which added to the current trend from cloud to edge computing has resulted in the need for efficient and reliable data…

Networking and Internet Architecture · Computer Science 2024-03-15 Jose-Carlos Gamazo-Real , Raul Torres Fernandez , Adrian Murillo Armas

Mobile edge computing (MEC) is a promising technology that provides cloud and IT services within the proximity of the mobile user. With the increasing number of mobile applications, mobile devices (MD) encounter limitations of their…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-10 Mahla Rahati-Quchani , Saeid Abrishami , Mehdi Feizi

Application autotuning is a promising path investigated in literature to improve computation efficiency. In this context, the end-users define high-level requirements and an autonomic manager is able to identify and seize optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-21 Tomas Martinovic , Davide Gadioli , Gianluca Palermo , Cristina Silvano

Sensing systems powered by energy harvesting have traditionally been designed to tolerate long periods without energy. As the Internet of Things (IoT) evolves towards a more transient and opportunistic execution paradigm, reducing energy…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-05 Andres Gomez , Andreas Tretter , Pascal Alexander Hager , Praveenth Sanmugarajah , Luca Benini , Lothar Thiele

In this paper, we propose a data-model-hardware tri-design framework for high-throughput, low-cost, and high-accuracy multi-object tracking (MOT) on High-Definition (HD) video stream. First, to enable ultra-light video intelligence, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Yimeng Zhang , Akshay Karkal Kamath , Qiucheng Wu , Zhiwen Fan , Wuyang Chen , Zhangyang Wang , Shiyu Chang , Sijia Liu , Cong Hao

On-device training of DNNs allows models to adapt and fine-tune to newly collected data or changing domains while deployed on microcontroller units (MCUs). However, DNN training is a resource-intensive task, making the implementation and…

Machine Learning · Computer Science 2024-10-24 Mark Deutel , Frank Hannig , Christopher Mutschler , Jürgen Teich

Two-stage object detectors exhibit high accuracy and precise localization, especially for identifying small objects that are favorable for various edge applications. However, the high computation costs associated with two-stage detection…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yifan Gong , Yushu Wu , Zheng Zhan , Pu Zhao , Liangkai Liu , Chao Wu , Xulong Tang , Yanzhi Wang

Executing machine learning inference tasks on resource-constrained edge devices requires careful hardware-software co-design optimizations. Recent examples have shown how transformer-based deep neural network models such as ALBERT can be…

Machine Learning · Computer Science 2023-04-14 Zirui Fu , Aleksandre Avaliani , Marco Donato

Transformer-based models, such as BERT and ViT, have achieved state-of-the-art results across different natural language processing (NLP) and computer vision (CV) tasks. However, these models are extremely memory intensive during their…

Computation and Language · Computer Science 2023-05-31 Arash Ardakani , Altan Haan , Shangyin Tan , Doru Thom Popovici , Alvin Cheung , Costin Iancu , Koushik Sen

An effective way to improve energy efficiency is to throttle hardware resources to meet a certain performance target, specified as a QoS constraint, associated with all applications running on a multicore system. Prior art has proposed…

Hardware Architecture · Computer Science 2019-11-14 Mehrzad Nejat , Madhavan Manivannan , Miquel Pericas , Per Stenstrom

This work introduces TrimTuner, the first system for optimizing machine learning jobs in the cloud to exploit sub-sampling techniques to reduce the cost of the optimization process while keeping into account user-specified constraints.…

Machine Learning · Computer Science 2020-11-11 Pedro Mendes , Maria Casimiro , Paolo Romano , David Garlan