English
Related papers

Related papers: TinyD\'ej\`aVu: Smaller RAM and Faster Inference w…

200 papers

This paper presents a Gated Recurrent Unit (GRU) based recurrent neural network (RNN) accelerator called EdgeDRNN designed for portable edge computing. EdgeDRNN adopts the spiking neural network inspired delta network algorithm to exploit…

Signal Processing · Electrical Eng. & Systems 2020-07-30 Chang Gao , Antonio Rios-Navarro , Xi Chen , Tobi Delbruck , Shih-Chii Liu

The computational and memory challenges of large language models (LLMs) have sparked several optimization approaches towards their efficient implementation. While prior LLM-targeted quantization, and prior works on sparse acceleration have…

Hardware Architecture · Computer Science 2025-03-18 Abhishek Moitra , Arkapravo Ghosh , Shrey Agarwal , Aporva Amarnath , Karthik Swaminathan , Priyadarshini Panda

Non-Intrusive Load Monitoring (NILM) enables the disaggregation of the global power consumption of multiple loads, taken from a single smart electrical meter, into appliance-level details. State-of-the-Art approaches are based on Machine…

Machine Learning · Computer Science 2021-05-24 Enrico Tabanelli , Davide Brunelli , Andrea Acquaviva , Luca Benini

Temporal Neural Networks (TNNs), inspired from the mammalian neocortex, exhibit energy-efficient online sensory processing capabilities. Recent works have proposed a microarchitecture framework for implementing TNNs and demonstrated…

Hardware Architecture · Computer Science 2022-05-27 Harideep Nair , Prabhu Vellaisamy , Santha Bhasuthkar , John Paul Shen

Edge computing is a promising solution for handling high-dimensional, multispectral analog data from sensors and IoT devices for applications such as autonomous drones. However, edge devices' limited storage and computing resources make it…

Machine Learning · Computer Science 2023-09-21 Nastaran Darabi , Amit R. Trivedi

Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models…

Machine Learning · Computer Science 2020-02-21 Valentin Radu , Kuba Kaszyk , Yuan Wen , Jack Turner , Jose Cano , Elliot J. Crowley , Bjorn Franke , Amos Storkey , Michael O'Boyle

There is much interest in incorporating inference capabilities into sensor-rich embedded platforms such as autonomous vehicles, wearables, and others. A central problem in the design of such systems is the need to extract information…

Hardware Architecture · Computer Science 2016-07-05 Sai Zhang , Mingu Kang , Charbel Sakr , Naresh Shanbhag

Tiny machine learning (TinyML) aims to run ML models on small devices and is increasingly favored for its enhanced privacy, reduced latency, and low cost. Recently, the advent of tiny AI accelerators has revolutionized the TinyML field by…

Machine Learning · Computer Science 2024-12-10 Taesik Gong , Fahim Kawsar , Chulhong Min

Kernel approximation is widely used to scale up kernel SVM training and prediction. However, the memory and computation costs of kernel approximation models are still too high if we want to deploy them on memory-limited devices such as…

Machine Learning · Computer Science 2020-10-07 Zijian Lei , Liang Lan

Recent advances in state-of-the-art ultra-low power embedded devices for machine learning (ML) have permitted a new class of products whose key features enable ML capabilities on microcontrollers with less than 1 mW power consumption…

Machine Learning · Computer Science 2021-12-03 Anas Osman , Usman Abid , Luca Gemma , Matteo Perotto , Davide Brunelli

Always-on AI applications, from environmental sensors to biomedical implants, require ultra-low power consumption. Analog circuits offer a path to sub-microwatt inference, yet existing analog implementations are limited to feedforward…

Hardware Architecture · Computer Science 2026-05-27 Arthur Fyon , Julien Brandoit , Loris Mendolia , Damien Ernst , Jean-Michel Redouté , Guillaume Drion

Recurrent transducer models have emerged as a promising solution for speech recognition on the current and next generation smart devices. The transducer models provide competitive accuracy within a reasonable memory footprint alleviating…

With the wide adoption of AI applications, there is a pressing need of enabling real-time neural network (NN) inference on small embedded devices, but deploying NNs and achieving high performance of NN inference on these small devices is…

Machine Learning · Computer Science 2023-12-25 Kai Huang , Wei Gao

Convolutional neural networks (CNNs) are used in many embedded applications, from industrial robotics and automation systems to biometric identification on mobile devices. State-of-the-art classification is typically achieved by large…

Machine Learning · Computer Science 2020-05-22 Yuan Wen , Andrew Anderson , Valentin Radu , Michael F. P. O'Boyle , David Gregg

The increasing demand for continual learning in sequential data processing has led to progressively complex training methodologies and larger recurrent network architectures. Consequently, this has widened the knowledge gap between…

Machine Learning · Computer Science 2025-03-11 Abdullah M. Zyarah , Dhireesha Kudithipudi

To process sensor data in the Internet of Things(IoTs), embedded deep learning for 1-dimensional data is an important technique. In the past, CNNs were frequently used because they are simple to optimise for special embedded hardware such…

Hardware Architecture · Computer Science 2023-11-28 Chao Qian , Tianheng Ling , Gregor Schiele

We propose Zygarde -- which is an energy -- and accuracy-aware soft real-time task scheduling framework for batteryless systems that flexibly execute deep learning tasks1 that are suitable for running on microcontrollers. The sporadic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-08 Bashima Islam , Shahriar Nirjon

While significant advances in deep learning has resulted in state-of-the-art performance across a large number of complex visual perception tasks, the widespread deployment of deep neural networks for TinyML applications involving…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Alexander Wong , Mahmoud Famouri , Mohammad Javad Shafiee

Wireless Sensor Networks have risen as a highly promising technology suitable for precision agriculture implementations, enabling efficient monitoring and control of agricultural processes. In precision agriculture, accurate and…

Networking and Internet Architecture · Computer Science 2025-02-27 Kashif Sattar , Muhammad Arslan , Saqib Majeed , Salim Iqbal

We consider the problem of estimating the remaining useful life (RUL) of a system or a machine from sensor data. Many approaches for RUL estimation based on sensor data make assumptions about how machines degrade. Additionally, sensor data…

Machine Learning · Computer Science 2017-10-09 Narendhar Gugulothu , Vishnu TV , Pankaj Malhotra , Lovekesh Vig , Puneet Agarwal , Gautam Shroff