English
Related papers

Related papers: Recommending Pre-Trained Models for IoT Devices

200 papers

Energy-efficient machine learning models that can run directly on edge devices are of great interest in IoT applications, as they can reduce network pressure and response latency, and improve privacy. An effective way to obtain…

Machine Learning · Computer Science 2022-04-08 Francesco Daghero , Alessio Burrello , Daniele Jahier Pagliari , Luca Benini , Enrico Macii , Massimo Poncino

Pre-trained models have become indispensable for efficiently building models across a broad spectrum of downstream tasks. The advantages of pre-trained models have been highlighted by empirical studies on scaling laws, which demonstrate…

Machine Learning · Statistics 2026-02-05 Kazuto Fukuchi , Ryuichiro Hataya , Kota Matsui

Large language models (LLMs) have demonstrated remarkable capacities on various tasks, and integrating the capacities of LLMs into the Internet of Things (IoT) applications has drawn much research attention recently. Due to security…

Artificial Intelligence · Computer Science 2024-10-08 Bin Xiao , Burak Kantarci , Jiawen Kang , Dusit Niyato , Mohsen Guizani

From computer vision and speech recognition to forecasting trajectories in autonomous vehicles, deep learning approaches are at the forefront of so many domains. Deep learning models are developed using plethora of high-level, generic…

Machine Learning · Computer Science 2021-05-07 Hamid Tabani , Ajay Balasubramaniam , Elahe Arani , Bahram Zonooz

This paper critically examines the device identification process using machine learning, addressing common pitfalls in existing literature. We analyze the trade-offs between identification methods (unique vs. class based), data…

Cryptography and Security · Computer Science 2026-01-29 Kahraman Kostas , Rabia Yasa Kostas

The use of deep learning (DL) on Internet of Things (IoT) and mobile devices offers numerous advantages over cloud-based processing. However, such devices face substantial energy constraints to prolong battery-life, or may even operate…

Machine Learning · Computer Science 2025-05-20 Josh Millar , Hamed Haddadi , Anil Madhavapeddy

Many pre-trained models (PTMs) are available in modern applications. Because different PTMs are often trained on different datasets, their performances can vary substantially for different new tasks, and the ranking of the candidates may…

Methodology · Statistics 2026-05-14 Ziwen Gao , Baihua He , Yuhong Yang

A salient characteristic of pre-trained language models (PTLMs) is a remarkable improvement in their generalization capability and emergence of new capabilities with increasing model capacity and pre-training dataset size. Consequently, we…

The factories of the future require efficient interconnection of their physical machines into the cyber space to cope with the emerging need of an increased uptime of machines, higher performance rates, an improved level of productivity and…

Cryptography and Security · Computer Science 2019-06-26 Ralph Ankele , Stefan Marksteiner , Kai Nahrgang , Heribert Vallant

The devices forming the Internet-of-Things (IoT) networks need to be re-programmed over-the-air, so that new features are added, software bugs or security vulnerabilities are resolved and their applications can be re-purposed. The…

Networking and Internet Architecture · Computer Science 2020-09-18 Konstantinos Arakadakis , Pavlos Charalampidis , Antonis Makrogiannakis , Alexandros Fragkiadakis

Pre-trained models (PTMs) have achieved great success in various Software Engineering (SE) downstream tasks following the ``pre-train then fine-tune'' paradigm. As fully fine-tuning all parameters of PTMs can be computationally expensive, a…

Software Engineering · Computer Science 2023-12-27 Wentao Zou , Qi Li , Jidong Ge , Chuanyi Li , Xiaoyu Shen , Liguo Huang , Bin Luo

Pre-training and fine-tuning have achieved significant advances in the information retrieval (IR). A typical approach is to fine-tune all the parameters of large-scale pre-trained models (PTMs) on downstream tasks. As the model size and the…

Information Retrieval · Computer Science 2022-08-23 Xinyu Ma , Jiafeng Guo , Ruqing Zhang , Yixing Fan , Xueqi Cheng

Most recently, with the proliferation of IoT devices, computational nodes in manufacturing systems IIoT(Industrial-Internet-of-things) and the lunch of 5G networks, there will be millions of connected devices generating a massive amount of…

Machine Learning · Computer Science 2021-01-22 Besher Alhalabi , Mohamed Gaber , Shadi Basurra

Internet of Things (IoT) systems continuously collect a large amount of data from heterogeneous "smart objects" through standardised service interfaces. A key challenge is how to use these data and relevant event logs to construct…

Software Engineering · Computer Science 2018-12-17 Ahmed Abdullah , Heinz W. Schmidt , Maria Spichkova , Huai Liu

Multi-task learning has garnered widespread attention in the industry due to its efficient data utilization and strong generalization capabilities, making it particularly suitable for providing high-quality intelligent services to users.…

Machine Learning · Computer Science 2026-01-06 Jingxuan Zhou , Weidong Bao , Ji Wang , Zhengyi Zhong

The Internet of Things (IoT) is being widely adopted in today's society, interconnecting smart embedded devices that are being deployed for indoor and outdoor environments, such as homes, factories and hospitals. Along with the growth in…

Networking and Internet Architecture · Computer Science 2020-09-23 Ivan Boškov , Halil Yetgin , Matevž Vučnik , Carolina Fortuna , Mihael Mohorčič

Internet of Things (IoT) is an ever-evolving technological paradigm that is reshaping industries and societies globally. Real-time data collection, analysis, and decision-making facilitated by localization solutions form the foundation for…

Signal Processing · Electrical Eng. & Systems 2025-02-11 Abdullahi Isa Ahmed , Yaya Etiabi , Ali Waqar Azim , El Mehdi Amhoud

The widespread integration of IoT devices has greatly improved connectivity and computational capabilities, facilitating seamless communication across networks. Despite their global deployment, IoT devices are frequently targeted for…

Cryptography and Security · Computer Science 2024-04-16 Sreenitha Kasarapu , Sanket Shukla , Sai Manoj Pudukotai Dinakarrao

With the proliferation of devices on the Internet of Things (IoT), ensuring their security has become paramount. Device identification (DI), which distinguishes IoT devices based on their traffic patterns, plays a crucial role in both…

Cryptography and Security · Computer Science 2025-11-12 Kahraman Kostas , Rabia Yasa Kostas , Mike Just , Michael A. Lones

Unsupervised pre-training approaches have achieved great success in many fields such as Computer Vision (CV), Natural Language Processing (NLP) and so on. However, compared to typical deep learning models, pre-training or even fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Penghao Jiang , Xuanchen Hou , Yinsi Zhou