English
Related papers

Related papers: Towards a Transformer-Based Pre-trained Model for …

200 papers

Adept traffic models are critical to both planning and closed-loop simulation for autonomous vehicles (AV), and key design objectives include accuracy, diverse multimodal behaviors, interpretability, and downstream compatibility. Recently,…

Machine Learning · Computer Science 2023-12-01 Yuxiao Chen , Sander Tonkens , Marco Pavone

Detecting anomalies in Internet of Things (IoT) networks is a critical security challenge, often hampered by highly imbalanced and diverse network traffic datasets. Standard classifiers struggle to perform well across all traffic types.…

Networking and Internet Architecture · Computer Science 2026-05-20 Hossein Shaemi Barzoki , Amir Hossein Fathi Hafshejani , Ahmadreza Montazerolghaem

The growing use of IoT devices in organizations has increased the number of attack vectors available to attackers due to the less secure nature of the devices. The widely adopted bring your own device (BYOD) policy which allows an employee…

Cryptography and Security · Computer Science 2020-09-25 Jaidip Kotak , Yuval Elovici

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

The preponderance of connected devices provides unprecedented opportunities for fine-grained monitoring of the public infrastructure. However while classical models expect high quality application-specific data streams, the promise of the…

Machine Learning · Computer Science 2019-03-06 Baoyang Song , Hasan Poonawala , Laura Wynter , Sebastien Blandin

Transformers have revolutionized performance in Natural Language Processing and Vision, paving the way for their integration with Graph Neural Networks (GNNs). One key challenge in enhancing graph transformers is strengthening the…

Machine Learning · Computer Science 2026-01-09 Yun Young Choi , Sun Woo Park , Minho Lee , Youngho Woo

In this paper, we aim to improve the performance of a deep learning model towards image classification tasks, proposing a novel anchor-based training methodology, named \textit{Online Anchor-based Training} (OAT). The OAT method, guided by…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Maria Tzelepi , Vasileios Mezaris

Internet-of-Things (IoT) devices are known to be the source of many security problems, and as such, they would greatly benefit from automated management. This requires robustly identifying devices so that appropriate network security…

Cryptography and Security · Computer Science 2021-07-19 Roman Kolcun , Diana Andreea Popescu , Vadim Safronov , Poonam Yadav , Anna Maria Mandalari , Richard Mortier , Hamed Haddadi

Network traffic classification using pre-training models has shown promising results, but existing methods struggle to capture packet structural characteristics, flow-level behaviors, hierarchical protocol semantics, and inter-packet…

Machine Learning · Computer Science 2025-08-28 Liming Liu , Ruoyu Li , Qing Li , Meijia Hou , Yong Jiang , Mingwei Xu

Many IoT devices are vulnerable to attacks due to flawed security designs and lacking mechanisms for firmware updates or patches to eliminate the security vulnerabilities. Device-type identification combined with data from vulnerability…

Networking and Internet Architecture · Computer Science 2021-02-17 Jakob Greis , Artem Yushchenko , Daniel Vogel , Michael Meier , Volker Steinhage

The growing popularity of Internet-of-Things (IoT) has created the need for network-based traffic anomaly detection systems that could identify misbehaving devices. In this work, we propose a lightweight technique, IoT-guard, for…

Cryptography and Security · Computer Science 2018-10-17 Ibbad Hafeez , Aaron Yi Ding , Markku Antikainen , Sasu Tarkoma

In the era of the Internet of Things (IoT), where smartphones, built-in systems, wireless sensors, and nearly every smart device connect through local networks or the internet, billions of smart things communicate with each other and…

Machine Learning · Computer Science 2024-10-28 Duygu Altunkaya , Feyza Yildirim Okay , Suat Ozdemir

One-stream Transformer trackers have shown outstanding performance in challenging benchmark datasets over the last three years, as they enable interaction between the target template and search region tokens to extract target-oriented…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Janani Kugarajeevan , Thanikasalam Kokul , Amirthalingam Ramanan , Subha Fernando

The Internet of Things (IoT) technology has rapidly gained popularity with applications widespread across a variety of industries. However, IoT devices have been recently serving as a porous layer for many malicious attacks to both personal…

Machine Learning · Computer Science 2025-05-06 Hassan Wasswa , Timothy Lynar , Hussein Abbass

In recent years, rapid technological advancements and expanded Internet access have led to a significant rise in anomalies within network traffic and time-series data. Prompt detection of these irregularities is crucial for ensuring service…

Machine Learning · Computer Science 2025-11-10 Mahshid Rezakhani , Tolunay Seyfi , Fatemeh Afghah

The combination of Artificial Intelligence (AI) and Internet-of-Things (IoT), which is denoted as AI-powered Internet-of-Things (AIoT), is capable of processing huge amount of data generated from a large number of devices and handling…

Systems and Control · Computer Science 2017-11-30 Ying Liu , Lei Liu , Wei-Peng Chen

Transformer models are rapidly becoming a cornerstone of modern Internet of Things (IoT) applications, yet their computational and memory demands far exceed the capabilities of a single typical ultra-low-power IoT device. We present CATS, a…

Machine Learning · Computer Science 2026-05-19 Alexander Gräfe , Ding Huo , Vincent de Bakker , Johannes Berger , Marco Zimmerling , Sebastian Trimpe

Activity classification has observed great success recently. The performance on small dataset is almost saturated and people are moving towards larger datasets. What leads to the performance gain on the model and what the model has learnt?…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Jialing Lyu , Weichao Qiu , Xinyue Wei , Yi Zhang , Alan Yuille , Zheng-Jun Zha

The Internet of Things (IoT) is an emerging concept that directly links to the billions of physical items, or "things", that are connected to the Internet and are all gathering and exchanging information between devices and systems.…

Cryptography and Security · Computer Science 2023-04-28 Nibir Chandra Mandal , G. M. Shahariar , Md. Tanvir Rouf Shawon

The plethora of Internet of Things (IoT) devices leads to explosive network traffic. The network traffic classification (NTC) is an essential tool to explore behaviours of network flows, and NTC is required for Internet service providers…

Networking and Internet Architecture · Computer Science 2021-10-01 Yoga Suhas Kuruba Manjunath , Sihao Zhao , Xiao-Ping Zhang