English
Related papers

Related papers: A Data Streaming Process Framework for Autonomous …

200 papers

Network traffic analysis increasingly uses complex machine learning models as the internet consolidates and traffic gets more encrypted. However, over high-bandwidth networks, flows can easily arrive faster than model inference rates. The…

Networking and Internet Architecture · Computer Science 2024-10-25 Shinan Liu , Ted Shaowang , Gerry Wan , Jeewon Chae , Jonatas Marques , Sanjay Krishnan , Nick Feamster

The Internet of Moving Things (IoMT) requires support for a data life cycle process ranging from sorting, cleaning and monitoring data streams to more complex tasks such as querying, aggregation, and analytics. Current solutions for stream…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-28 Lilian Hernandez , Hung Cao , Monica Wachowicz

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-28 Suraj P. Kesavan , Takanori Fujiwara , Jianping Kelvin Li , Caitlin Ross , Misbah Mubarak , Christopher D. Carothers , Robert B. Ross , Kwan-Liu Ma

Existing tracking algorithms typically rely on low-frame-rate RGB cameras coupled with computationally intensive deep neural network architectures to achieve effective tracking. However, such frame-based methods inherently face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiao Wang , Xiao Wang , Liye Jin , Bo Jiang , Lin Zhu , Lan Chen , Yonghong Tian , Bin Luo

Real-time city-scale traffic analytics requires processing 100s-1000s of CCTV streams under strict latency, bandwidth, and compute limits. We present a scalable AI-driven Intelligent Transportation System (AIITS) designed to address…

Autonomous driving services rely heavily on sensors such as cameras, LiDAR, radar, and communication modules. A common practice of processing the sensed data is using a high-performance computing unit placed inside the vehicle, which…

Robotics · Computer Science 2025-05-22 Dewant Katare , Diego Perino , Jari Nurmi , Martijn Warnier , Marijn Janssen , Aaron Yi Ding

Real-world data from diverse domains require real-time scalable analysis. Large-scale data processing frameworks or engines such as Hadoop fall short when results are needed on-the-fly. Apache Spark's streaming library is increasingly…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-02 Janak Dahal , Elias Ioup , Shaikh Arifuzzaman , Mahdi Abdelguerfi

Real-time video surveillance has become a crucial technology for smart cities, made possible through the large-scale deployment of mobile and fixed video cameras. In this paper, we propose situation-aware streaming, for real-time…

Networking and Internet Architecture · Computer Science 2022-04-06 Suvadip Batabyal , Ozgur Ercetin

We present a Python-based framework for event-log prediction in streaming mode, enabling predictions while data is being generated by a business process. The framework allows for easy integration of streaming algorithms, including language…

Artificial Intelligence · Computer Science 2024-12-23 Benedikt Bollig , Matthias Függer , Thomas Nowak

Processing sensory data close to the data source, often involving Edge devices, promises low latency for pervasive applications, like smart cities. This commonly involves a multitude of processing services, executed with limited resources;…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-20 Boris Sedlak , Víctor Casamayor Pujol , Schahram Dustdar

Several alternatives for more efficient spectrum management have been proposed over the last decade, resulting in new techniques for automatic wideband spectrum sensing. However, while spectrum sensing technology is important,…

Networking and Internet Architecture · Computer Science 2018-04-16 Carolina Fortuna , Timotej Gale , Tomaz Solc , Mihael Mohorcic

We consider a network of smart sensors for an edge computing application that sample a time-varying signal and send updates to a base station for remote global monitoring. Sensors are equipped with sensing and compute, and can either send…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-11 Luca Ballotta , Giovanni Peserico , Francesco Zanini , Paolo Dini

Cloud computing has been a main-stream computing service for years. Recently, with the rapid development in urbanization, massive video surveillance data are produced at an unprecedented speed. A traditional solution to deal with the big…

Signal Processing · Electrical Eng. & Systems 2020-05-18 Ruimin Ke , Yifan Zhuang , Ziyuan Pu , Yinhai Wang

High-Definition (HD) maps are essential for the safety of autonomous driving systems. While existing techniques employ camera images and onboard sensors to generate vectorized high-precision maps, they are constrained by their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Tianyuan Yuan , Yicheng Liu , Yue Wang , Yilun Wang , Hang Zhao

Distributed stream processing frameworks help building scalable and reliable applications that perform transformations and aggregations on continuous data streams. This paper introduces ShuffleBench, a novel benchmark to evaluate the…

Software Engineering · Computer Science 2024-03-08 Sören Henning , Adriano Vogel , Michael Leichtfried , Otmar Ertl , Rick Rabiser

Industry 5.0 aims at maximizing the collaboration between humans and machines. Machines are capable of automating repetitive jobs, while humans handle creative tasks. As a critical component of Industrial Internet of Things (IIoT) systems…

Machine Learning · Computer Science 2025-11-10 Li Yang , Abdallah Shami

This paper proposes nowcasting of high-frequency financial datasets in real-time with a 5-minute interval using the streaming analytics feature of Apache Spark. The proposed 2 stage method consists of modelling chaos in the first stage and…

Machine Learning · Computer Science 2022-02-25 Mohammad Arafat Ali Khan , Chandra Bhushan , Vadlamani Ravi , Vangala Sarveswara Rao , Shiva Shankar Orsu

Detecting concept drift is a well known problem that affects production systems. However, two important issues that are frequently not addressed in the literature are 1) the detection of drift when the labels are not immediately available;…

Machine Learning · Computer Science 2019-08-13 Fábio Pinto , Marco O. P. Sampaio , Pedro Bizarro

Embodied perception refers to the ability of an autonomous agent to perceive its environment so that it can (re)act. The responsiveness of the agent is largely governed by latency of its processing pipeline. While past work has studied the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Mengtian Li , Yu-Xiong Wang , Deva Ramanan

With the rapid growth in the number of devices of the Internet of Things (IoT), the volume and types of stream data are rapidly increasing in the real world. Unfortunately, the stream data has the characteristics of infinite and periodic…

Performance · Computer Science 2022-12-13 Weirong Xiu , Baozhu Li , Xusheng Du , Zheng Chu