English
Related papers

Related papers: Towards a Transformer-Based Pre-trained Model for …

200 papers

Transformers have been widely used in numerous vision problems especially for visual recognition and detection. Detection transformers are the first fully end-to-end learning systems for object detection, while vision transformers are the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Hwanjun Song , Deqing Sun , Sanghyuk Chun , Varun Jampani , Dongyoon Han , Byeongho Heo , Wonjae Kim , Ming-Hsuan Yang

In recent years, the growth of Internet of Things (IoT) as an emerging technology has been unbelievable. The number of networkenabled devices in IoT domains is increasing dramatically, leading to the massive production of electronic data.…

Machine Learning · Computer Science 2020-01-29 Meysam Vakili , Mohammad Ghamsari , Masoumeh Rezaei

Modern networks carry increasingly diverse and encrypted traffic types that demand classification techniques beyond traditional port-based and payload-based methods. This tutorial provides a practical, end-to-end guide to building…

Networking and Internet Architecture · Computer Science 2026-01-08 Adrian Pekar , Richard Plny , Karel Hynek

Security monitoring systems typically treat anomaly detection as identifying statistical deviations from observed data distributions. In cryptographic traffic analysis, however, violations are defined not by rarity but by explicit policy…

Cryptography and Security · Computer Science 2026-02-26 Rahul D Ray

The challenging task of multi-object tracking (MOT) requires simultaneous reasoning about track initialization, identity, and spatio-temporal trajectories. We formulate this task as a frame-to-frame set prediction problem and introduce…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Tim Meinhardt , Alexander Kirillov , Laura Leal-Taixe , Christoph Feichtenhofer

We introduce Vision Bridge Transformer (ViBT), a large-scale instantiation of Brownian Bridge Models designed for conditional generation. Unlike traditional diffusion models that transform noise into data, Bridge Models directly model the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenxiong Tan , Zeqing Wang , Xingyi Yang , Songhua Liu , Xinchao Wang

A disruptive technology that is influencing not only computing paradigm but every other business is the rise of big data. Internet of Things (IoT) applications are considered to be a major source of big data. Such IoT applications are in…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-23 Xuezhi Zeng , Saurabh Kumar Garg , Peter Strazdins , Prem Jayaraman , Dimitrios Georgakopoulos , Rajiv Ranjan

The rapid expansion of the Internet of Things (IoT) in domains such as smart cities, transportation, and industrial systems has heightened the urgency of addressing their security vulnerabilities. IoT devices often operate under limited…

Machine Learning · Computer Science 2026-01-27 Jake Lyon , Ehsan Saeedizade , Shamik Sengupta

Discovering inter-point connection for efficient high-dimensional feature extraction from point coordinate is a key challenge in processing point cloud. Most existing methods focus on designing efficient local feature extractors while…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Zihao Li , Pan Gao , Hui Yuan , Ran Wei , Manoranjan Paul

In Intelligent Transportation Systems (ITS), multi-object tracking is primarily based on frame-based cameras. However, these cameras tend to perform poorly under dim lighting and high-speed motion conditions. Event cameras, characterized by…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Mengyu Li , Xingcheng Zhou , Guang Chen , Alois Knoll , Hu Cao

Intelligent Internet-of-Things (IoT) will be transformative with the advancement of artificial intelligence and high-dimensional data analysis, shifting from "connected things" to "connected intelligence". This shall unleash the full…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Kai Yang , Yuanming Shi , Yong Zhou , Zhanpeng Yang , Liqun Fu , Wei Chen

Conventional wisdom suggests that pre-training Vision Transformers (ViT) improves downstream performance by learning useful representations. Is this actually true? We investigate this question and find that the features and representations…

Machine Learning · Computer Science 2024-11-15 Alexander C. Li , Yuandong Tian , Beidi Chen , Deepak Pathak , Xinlei Chen

We propose iMoT, an innovative Transformer-based inertial odometry method that retrieves cross-modal information from motion and rotation modalities for accurate positional estimation. Unlike prior work, during the encoding of the motion…

Machine Learning · Computer Science 2025-01-14 Son Minh Nguyen , Linh Duy Tran , Duc Viet Le , Paul J. M Havinga

The rapid expansion of internet of things (IoT) devices has created a pervasive ecosystem where encrypted wireless communications serve as the primary privacy and security protection mechanism. While encryption effectively protects message…

Cryptography and Security · Computer Science 2026-04-17 Nazmul Islam , Mohammad Zulkernine

Encrypted traffic classification (TC) methods must adapt to new protocols and extensions as well as to advancements in other machine learning fields. In this paper, we adopt a transfer learning setup best known from computer vision. We…

Machine Learning · Computer Science 2026-01-21 Jan Luxemburk , Karel Hynek , Richard Plný , Tomáš Čejka

Self-supervised learning methods are gaining increasing traction in computer vision due to their recent success in reducing the gap with supervised learning. In natural language processing (NLP) self-supervised learning and transformers are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Sara Atito , Muhammad Awais , Josef Kittler

Recent advances in Multi-Object Tracking (MOT) have demonstrated significant success in short-term association within the separated tracking-by-detection online paradigm. However, long-term tracking remains challenging. While graph-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chongwei Liu , Haojie Li , Zhihui Wang , Rui Xu

Intelligent transport systems (ITS) are pivotal in the development of sustainable and green urban living. ITS is data-driven and enabled by the profusion of sensors ranging from pneumatic tubes to smart cameras. This work explores a novel…

Machine Learning · Computer Science 2022-09-14 Chia-Yen Chiang , Mona Jaber , Peter Hayward

Today's Internet is heavily used for multimedia streaming from cloud backends, while the Internet of Things (IoT) reverses the traditional data flow, with high data volumes produced at the network edge. Information Centric Networking (ICN)…

Networking and Internet Architecture · Computer Science 2021-08-17 Christopher Scherb , Dennis Grewe , Christian Tschudin

The significance of distributed learning and inference algorithms in Internet of Things (IoT) network is growing since they flexibly distribute computation load between IoT devices and the infrastructure, enhance data privacy, and minimize…

Networking and Internet Architecture · Computer Science 2024-10-28 Vukan Ninkovic , Dejan Vukobratovic , Dragisa Miskovic , Marco Zennaro