English
Related papers

Related papers: The design of a streaming analytical workflow for …

200 papers

Data stream processing is an increasingly important topic due to the prevalence of smart devices and the demand for real-time analytics. Geo-distributed streaming systems, where cloud-based queries utilize data streams from multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-22 Joel Wolfrath , Abhishek Chandra

Traffic flow prediction is an important part of smart transportation. The goal is to predict future traffic conditions based on historical data recorded by sensors and the traffic network. As the city continues to build, parts of the…

Machine Learning · Statistics 2022-12-27 Yanan Xiao , Minyu Liu , Zichen Zhang , Lu Jiang , Minghao Yin , Jianan Wang

Apart from forming the backbone of compiler optimization, static dataflow analysis has been widely applied in a vast variety of applications, such as bug detection, privacy analysis, program comprehension, etc. Despite its importance,…

Programming Languages · Computer Science 2024-12-18 Zewen Sun , Yujin Zhang , Duanchen Xu , Yiyu Zhang , Yun Qi , Yueyang Wang , Yi Li , Zhaokang Wang , Yue Li , Xuandong Li , Zhiqiang Zuo , Qingda Lu , Wenwen Peng , Shengjian Guo

The expansion of urban centers necessitates enhanced efficiency and sustainability in their transportation infrastructure and mobility systems. The big data obtainable from various transportation modes potentially offers critical insights…

Physics and Society · Physics 2026-04-17 Oluwaleke Yusuf , Adil Rasheed , Frank Lindseth

An increasing number of scientific applications rely on stream processing for generating timely insights from data feeds of scientific instruments, simulations, and Internet-of-Thing (IoT) sensors. The development of streaming applications…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-13 Andre Luckow , George Chantzialexiou , Shantenu Jha

Data stream algorithms tackle operations on high-volume sequences of read-once data items. Data stream scenarios include inherently real-time systems like sensor networks and financial markets. They also arise in purely-computational…

Data Structures and Algorithms · Computer Science 2024-03-04 Matthew Andres Moreno , Santiago Rodriguez Papa , Emily Dolson

Understanding continuous video streams plays a fundamental role in real-time applications including embodied AI and autonomous driving. Unlike offline video understanding, streaming video understanding requires the ability to process video…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Yibin Yan , Jilan Xu , Shangzhe Di , Yikun Liu , Yudi Shi , Qirui Chen , Zeqian Li , Yifei Huang , Weidi Xie

Ever-increasing amounts of data and requirements to process them in real time lead to more and more analytics platforms and software systems being designed according to the concept of stream processing. A common area of application is the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-05 Sören Henning , Wilhelm Hasselbring

Understanding the dynamics of traffic clusters is crucial for enhancing urban transportation systems, particularly in managing congestion and free-flow states. This study applies computational percolation theory to analyze the formation and…

Physics and Society · Physics 2025-07-30 Yongsung Kwon , Minjin Lee , Mi Jin Lee , Seung-Woo Son

Large language models for vertical domains are bottlenecked by the scarcity of complex, domain-specific task-oriented dialogues. Existing data acquisition pipelines face a persistent trilemma: expert annotation is expensive, real-world…

Computation and Language · Computer Science 2026-05-26 Liang Xue , Haoyu Liu , Cheng Wang , Pengyu Chen , Haozhuo Zheng , Yang Liu

This is the preprint version of our paper on The 23rd International Conference on Geoinformatics (Geoinformatics2015). City traffic data has several characteristics, such as large scale, diverse predictable and real-time, which falls in the…

Other Computer Science · Computer Science 2015-07-30 Xiaoming Li , Zhihan Lv , Weixi Wang , Chen Wu , Jinxing Hu

The exponential growth of data storage demands has necessitated the evolution of hierarchical storage management strategies [1]. This study explores the application of streaming machine learning [3] to revolutionize data prefetching within…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Chiyu Cheng , Chang Zhou , Yang Zhao , Jin Cao

A computational workflow, also known as workflow, consists of tasks that must be executed in a specific order to attain a specific goal. Often, in fields such as biology, chemistry, physics, and data science, among others, these workflows…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-14 George Papadimitriou , Hongwei Jin , Cong Wang , Rajiv Mayani , Krishnan Raghavan , Anirban Mandal , Prasanna Balaprakash , Ewa Deelman

Assigning passenger trips to specific network paths using automatic fare collection (AFC) data is a fundamental application in urban transit analysis. The task is a difficult inverse problem: the only available information consists of each…

Applications · Statistics 2025-07-31 Xiaoxu Chen , Alexandra M. Schmidt , Zhenliang Ma , Lijun Sun

There has been a significant effort by the research community to address the problem of providing methods to organize documentation with the help of information Retrieval methods. In this report paper, we present several experiments with…

Information Retrieval · Computer Science 2022-06-07 Rui Portocarrero Sarmento , Douglas O. Cardoso , João Gama , Pavel Brazdil

Several high-throughput distributed data-processing applications require multi-hop processing of streams of data. These applications include continual processing on data streams originating from a network of sensors, composing a multimedia…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-03-26 Shah Asaduzzaman , Muthucumaru Maheswaran

Autonomous driving requires the model to perceive the environment and (re)act within a low latency for safety. While past works ignore the inevitable changes in the environment after processing, streaming perception is proposed to jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Jinrong Yang , Songtao Liu , Zeming Li , Xiaoping Li , Jian Sun

Hadoop is an open source implementation of the MapReduce Framework in the realm of distributed processing. A Hadoop cluster is a unique type of computational cluster designed for storing and analyzing large data sets across cluster of…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-11-10 Muralikrishnan Ramane , Sharmila Krishnamoorthy , Sasikala Gowtham

Predicting air traffic congestion and flow management is essential for airlines and Air Navigation Service Providers (ANSP) to enhance operational efficiency. Accurate estimates of future airport capacity and airspace density are vital for…

Motivated by the trend to outsource work to commercial cloud computing services, we consider a variation of the streaming paradigm where a streaming algorithm can be assisted by a powerful helper that can provide annotations to the data…

Data Structures and Algorithms · Computer Science 2015-03-14 Graham Cormode , Michael Mitzenmacher , Justin Thaler