English
Related papers

Related papers: Low-Latency Asynchronous Logic Design for Inferenc…

200 papers

With the surging popularity of edge computing, the need to efficiently perform neural network inference on battery-constrained IoT devices has greatly increased. While algorithmic developments enable neural networks to solve increasingly…

Hardware Architecture · Computer Science 2022-06-27 Maarten Molendijk , Floran de Putter , Henk Corporaal

Energy-harvesting technology provides a promising platform for future IoT applications. However, since communication is very expensive in these devices, applications will require inference "beyond the edge" to avoid wasting precious energy…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Graham Gobieski , Nathan Beckmann , Brandon Lucia

Traditional ML inference is evolving toward modeless inference, which abstracts the complexity of model selection from users, allowing the system to automatically choose the most appropriate model for each request based on accuracy and…

Systems and Control · Electrical Eng. & Systems 2025-01-16 ChonLam Lao , Jiaqi Gao , Ganesh Ananthanarayanan , Aditya Akella , Minlan Yu

With the growing workload of inference tasks on mobile devices, state-of-the-art neural architectures (NAs) are typically designed through Neural Architecture Search (NAS) to identify NAs with good tradeoffs between accuracy and efficiency…

Performance · Computer Science 2022-10-07 Zhuojin Li , Marco Paolieri , Leana Golubchik

Resource-constrained IoT devices, such as sensors and actuators, have become ubiquitous in recent years. This has led to the generation of large quantities of data in real-time, which is an appealing target for AI systems. However,…

Machine Learning · Computer Science 2021-10-07 M. G. Sarwar Murshed , Christopher Murphy , Daqing Hou , Nazar Khan , Ganesh Ananthanarayanan , Faraz Hussain

The use of lightweight machine learning (ML) models in internet of things (IoT) networks enables resource constrained IoT devices to perform on-device inference for several critical applications. However, the inference accuracy deteriorates…

Machine Learning · Computer Science 2025-12-16 Henrik C. M. Frederiksen , Junya Shiraishi , Cedomir Stefanovic , Hei Victor Cheng , Shashi Raj Pandey

Radar sensors offer power-efficient solutions for always-on smart devices, but processing the data streams on resource-constrained embedded platforms remains challenging. This paper presents novel techniques that leverage the temporal…

Machine Learning · Computer Science 2023-09-13 Max Sponner , Julius Ott , Lorenzo Servadei , Bernd Waschneck , Robert Wille , Akash Kumar

There is a broad consensus that artificial intelligence (AI) will be a defining component of the sixth-generation (6G) networks. As a specific instance, AI-empowered sensing will gather and process environmental perception data at the…

Numerical Analysis · Mathematics 2025-07-29 Zhanwei Wang , Anders E. Kalør , You Zhou , Petar Popovski , Kaibin Huang

As we march towards the age of ubiquitous intelligence, we note that AI and intelligence are progressively moving from the cloud to the edge. The success of Edge-AI is pivoted on innovative circuits and hardware that can enable inference…

Hardware Architecture · Computer Science 2022-02-24 Zishen Wan , Ashwin Sanjay Lele , Arijit Raychowdhury

Contextual Artificial Intelligence (AI) based on emerging Transformer models is predicted to drive the next technology revolution in interactive wearable devices such as new-generation smart glasses. By coupling numerous sensors with small,…

Hardware Architecture · Computer Science 2025-03-27 Severin Bochem , Victor J. B. Jung , Arpan Prasad , Francesco Conti , Luca Benini

Number of IoT devices is constantly increasing which results in greater complexity of computations and high data velocity. One of the approach to process sensor data is dataflow programming. It enables the development of reactive software…

Networking and Internet Architecture · Computer Science 2020-05-25 Tomasz Szydlo , Joanna Sendorek , Robert Brzoza-Woch , Mateusz Windak

The inference of Neural Networks is usually restricted by the resources (e.g., computing power, memory, bandwidth) on edge devices. In addition to improving the hardware design and deploying efficient models, it is possible to aggregate the…

Machine Learning · Computer Science 2021-11-05 Jun-Liang Lin , Sheng-De Wang

Modern manufacturers are currently undertaking the integration of novel digital technologies - such as 5G-based wireless networks, the Internet of Things (IoT), and cloud computing - to elevate their production process to a brand new level,…

Networking and Internet Architecture · Computer Science 2021-12-08 Huanzhuo Wu , Jia He , Máté Tömösközi , Zuo Xiang , Frank H. P. Fitzek

We consider a mobile edge computing scenario where users want to perform a linear inference operation $\boldsymbol{W} \boldsymbol{x}$ on local data $\boldsymbol{x}$ for some network-side matrix $\boldsymbol{W}$. The inference is performed…

Information Theory · Computer Science 2021-08-18 Anton Frigård , Siddhartha Kumar , Eirik Rosnes , Alexandre Graell i Amat

With the rapid upsurge of deep learning tasks at the network edge, effective edge artificial intelligence (AI) inference becomes critical to provide low-latency intelligent services for mobile users via leveraging the edge computing…

Information Theory · Computer Science 2024-10-30 Xiangyu Yang , Sheng Hua , Yuanming Shi , Hao Wang , Jun Zhang , Khaled B. Letaief

Two-stage object detectors exhibit high accuracy and precise localization, especially for identifying small objects that are favorable for various edge applications. However, the high computation costs associated with two-stage detection…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yifan Gong , Yushu Wu , Zheng Zhan , Pu Zhao , Liangkai Liu , Chao Wu , Xulong Tang , Yanzhi Wang

Implementing machine learning algorithms on Internet of things (IoT) devices has become essential for emerging applications, such as autonomous driving, environment monitoring. But the limitations of computation capability and energy…

Information Theory · Computer Science 2020-05-26 Xiufeng Huang , Sheng Zhou

Large language models (LLMs) have emerged as a powerful foundation for intelligent reasoning and decision-making, demonstrating substantial impact across a wide range of domains and applications. However, their massive parameter scales and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-29 Mingyu Sun , Xiao Zhang , Shen Qu , Yan Li , Mengbai Xiao , Yuan Yuan , Dongxiao Yu

The spread of a resource-constrained Internet of Things (IoT) environment and embedded devices has put pressure on the real-time detection of anomalies occurring at the edge. This survey presents an overview of machine-learning methods…

Machine Learning · Computer Science 2025-12-23 Abdelmadjid Benmachiche , Khadija Rais , Hamda Slimi

Smart sensors are an emerging technology that allows combining the data acquisition with the elaboration directly on the Edge device, very close to the sensors. To push this concept to the extreme, technology companies are proposing a new…

Signal Processing · Electrical Eng. & Systems 2024-08-01 Andrea Ronco , Lukas Schulthess , David Zehnder , Michele Magno