English
Related papers

Related papers: Towards a Transformer-Based Pre-trained Model for …

200 papers

In recent years the number of IoT devices in home networks has increased dramatically. Whenever a new device connects to the network, it must be quickly managed and secured using the relevant security mechanism or QoS policy. Thus a key…

Networking and Internet Architecture · Computer Science 2019-10-15 Anat Bremler-Barr , Haim Levy , Zohar Yakhini

With sequentially stacked self-attention, (optional) encoder-decoder attention, and feed-forward layers, Transformer achieves big success in natural language processing (NLP), and many variants have been proposed. Currently, almost all…

Computation and Language · Computer Science 2021-03-08 Jinhua Zhu , Lijun Wu , Yingce Xia , Shufang Xie , Tao Qin , Wengang Zhou , Houqiang Li , Tie-Yan Liu

The proliferation of Internet-of-things (IoT) infrastructures and the widespread adoption of traffic encryption present significant challenges, particularly in environments characterized by dynamic traffic patterns, constrained…

Networking and Internet Architecture · Computer Science 2025-12-25 Hongjuan Li , Hui Kang , Chenbang Liu , Ruolin Wang , Jiahui Li , Geng Sun , Jiacheng Wang , Shuang Liang , Shiwen Mao

The real-time crash likelihood prediction model is an essential component of the proactive traffic safety management system. Over the years, numerous studies have attempted to construct a crash likelihood prediction model in order to…

Machine Learning · Computer Science 2023-08-30 B M Tazbiul Hassan Anik , Zubayer Islam , Mohamed Abdel-Aty

In this paper, the authors introduce a lightweight dataset to interpret IoT (Internet of Things) activity in preparation to create decoys by replicating known data traffic patterns. The dataset comprises different scenarios in a real…

Cryptography and Security · Computer Science 2024-07-30 David Weissman , Anura P. Jayasumana

With the proliferation of IoT devices, researchers have developed a variety of IoT device identification methods with the assistance of machine learning. Nevertheless, the security of these identification methods mostly depends on collected…

Cryptography and Security · Computer Science 2023-12-19 Tao Hou , Tao Wang , Zhuo Lu , Yao Liu , Yalin Sagduyu

This paper presents a comprehensive investigation into developing a fault detection and classification system for real-world IIoT applications. The study addresses challenges in data collection, annotation, algorithm development, and…

Machine Learning · Computer Science 2023-07-06 Mohammad Arif Ul Alam

Token-based transformer world models have shown strong performance in visual reinforcement learning, but often suffer from temporal inconsistency in long-horizon rollouts, including object duplication, disappearance, and transmutation. A…

Machine Learning · Computer Science 2026-05-27 Youngin Kim , Ray Sun , Inho Kim , Bumsoo Park , Hyun Oh Song

The task-conditional model is a distinctive stream for efficient multi-task learning. Existing works encounter a critical limitation in learning task-agnostic and task-specific representations, primarily due to shortcomings in global…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Yuxiang Lu , Shalayiding Sirejiding , Bayram Bayramli , Suizhi Huang , Yue Ding , Hongtao Lu

All data on the Internet are transferred by network traffic, thus accurately modeling network traffic can help improve network services quality and protect data privacy. Pretrained models for network traffic can utilize large-scale raw data…

Networking and Internet Architecture · Computer Science 2025-08-29 Xuying Meng , Chungang Lin , Yequan Wang , Yujun Zhang

Traffic predictions play a crucial role in intelligent transportation systems. The rapid development of IoT devices allows us to collect different kinds of data with high correlations to traffic predictions, fostering the development of…

Machine Learning · Computer Science 2024-05-09 Huy Quang Ung , Hao Niu , Minh-Son Dao , Shinya Wada , Atsunori Minamikawa

Internet of Things (IoT) is one of the technological advancements of the twenty-first century which can improve living standards. However, it also imposes new types of security challenges, including device authentication, traffic types…

Networking and Internet Architecture · Computer Science 2024-02-27 Rajarshi Roy Chowdhury , Debashish Roy , Pg Emeroylariffion Abas

A transformer-based deep learning approach is presented that enables the diagnosis of fault cases in optical fiber amplifiers using condition-based monitoring time series data. The model, Inverse Triple-Aspect Self-Attention Transformer…

Signal Processing · Electrical Eng. & Systems 2025-09-05 Dominic Schneider , Lutz Rapp , Christoph Ament

Understanding trajectory diversity is a fundamental aspect of addressing practical traffic tasks. However, capturing the diversity of trajectories presents challenges, particularly with traditional machine learning and recurrent neural…

Artificial Intelligence · Computer Science 2023-12-04 Ruyi Feng , Zhibin Li , Bowen Liu , Yan Ding

With the widespread adoption of Internet of Things (IoT), billions of everyday objects are being connected to the Internet. Effective management of these devices to support reliable, secure and high quality applications becomes challenging…

Networking and Internet Architecture · Computer Science 2018-12-27 Lei Bai , Lina Yao , Salil S. Kanhere , Xianzhi Wang , Zheng Yang

Several Machine Learning (ML) methodologies have been proposed to improve security in Internet Of Things (IoT) networks and reduce the damage caused by the action of malicious agents. However, detecting and classifying attacks with high…

Networking and Internet Architecture · Computer Science 2023-02-28 Diego Abreu , Antônio Abelém

We have described a novel approach for training tabular data using the TabTransformer model with self-supervised learning. Traditional machine learning models for tabular data, such as GBDT are being widely used though our paper examines…

Machine Learning · Computer Science 2024-01-30 Tirth Kiranbhai Vyas

Internet of Things (IoT) is an ever-evolving technological paradigm that is reshaping industries and societies globally. Real-time data collection, analysis, and decision-making facilitated by localization solutions form the foundation for…

Signal Processing · Electrical Eng. & Systems 2025-02-11 Abdullahi Isa Ahmed , Yaya Etiabi , Ali Waqar Azim , El Mehdi Amhoud

Intrusion detection in IoT and industrial networks requires models that can detect rare attacks at low false-positive rates while remaining reliable under evolving traffic and limited labels. Existing IDS solutions often report strong…

Cryptography and Security · Computer Science 2026-03-03 Srikumar Nayak

The large number of sensors and actuators that make up the Internet of Things obliges these systems to use diverse technologies and protocols. This means that IoT networks are more heterogeneous than traditional networks. This gives rise to…