English
Related papers

Related papers: Efficient data streaming multiway aggregation thro…

200 papers

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

Distributed stream processing systems rely on the dataflow model to define and execute streaming jobs, organizing computations as Directed Acyclic Graphs (DAGs) of operators. Adjusting the parallelism of these operators is crucial to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-08 Yuxing Han , Lixiang Chen , Haoyu Wang , Zhanghao Chen , Yifan Zhang , Chengcheng Yang , Kongzhang Hao , Zhengyi Yang

Collaboration between small-scale wireless devices hinges on their ability to infer properties shared across multiple nearby nodes. Wireless-enabled mobile devices in particular create a highly dynamic environment not conducive to…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-10-20 Oliver Kennedy , Christoph Koch , Al Demers

Mining data streams poses a number of challenges, including the continuous and non-stationary nature of data, the massive volume of information to be processed and constraints put on the computational resources. While there is a number of…

Machine Learning · Computer Science 2021-12-22 Łukasz Korycki , Bartosz Krawczyk

Modern machine learning workloads use large models, with complex structures, that are very expensive to execute. The devices that execute complex models are becoming increasingly heterogeneous as we see a flourishing of domain-specific…

Machine Learning · Computer Science 2020-11-02 Jakub Tarnawski , Amar Phanishayee , Nikhil R. Devanur , Divya Mahajan , Fanny Nina Paravecino

Next-generation real-time compute-intensive applications, such as extended reality, multi-user gaming, and autonomous transportation, are increasingly composed of heterogeneous AI-intensive functions with diverse resource requirements and…

Networking and Internet Architecture · Computer Science 2025-09-25 Pietro Spadaccino , Paolo Di Lorenzo , Sergio Barbarossa , Antonia M. Tulino , Jaime Llorca

This paper studies data aggregation in large-scale regularly deployed Internet of Things (IoT) networks, where devices generate synchronized time-triggered traffic (e.g., measurements or updates). The data granularity, in terms of…

Information Theory · Computer Science 2021-09-09 Yasser Nabil , Hesham ElSawy , Suhail Al-Dharrab , Hassan Mostafa , Hussein Attia

[Background] Nowadays, there is a massive growth of data volume and speed in many types of systems. It introduces new needs for infrastructure and applications that have to handle streams of data with low latency and high throughput.…

Software Engineering · Computer Science 2019-09-25 Alexandre Vianna , Waldemar Ferreira , Kiev Gama

Graph clustering becomes an important problem due to emerging applications involving the web, social networks and bio-informatics. Recently, many such applications generate data in the form of streams. Clustering massive, dynamic graph…

Databases · Computer Science 2013-01-30 Yuchen Zhao , Philip S. Yu

Priority queues are abstract data structures which store a set of key/value pairs and allow efficient access to the item with the minimal (maximal) key. Such queues are an important element in various areas of computer science such as…

Data Structures and Algorithms · Computer Science 2015-09-24 Jakob Gruber

The amount of collected information on data repositories has vastly increased with the advent of the internet. It has become increasingly complex to deal with these massive data streams due to their sheer volume and the throughput of…

Information Retrieval · Computer Science 2021-05-13 Oshan Mudannayake , Nalin Ranasinghe

Retrieving and analyzing transit feeds relies on working with analytical workflows that can handle the massive volume of data streams that are relevant to understand the dynamics of transit networks which are entirely deterministic in the…

Computers and Society · Computer Science 2018-06-11 Hung Cao , Monica Wachowicz

Context retrieval systems for LLM inference face a critical challenge: high retrieval latency creates a fundamental tension between waiting for complete context (poor time-to-first-token) and proceeding without it (reduced quality).…

Databases · Computer Science 2026-05-19 Rajveer Bachkaniwala , Chengqi Luo , Richard So , Divya Mahajan , Kexin Rong

The ability to timely process significant amounts of continuously updated spatial data is mandatory for an increasing number of applications. Parallelism enables such applications to face this data-intensive challenge and allows the devised…

Databases · Computer Science 2014-11-13 Francesco Lettich , Salvatore Orlando , Claudio Silvestri , Christian S. Jensen

Very large databases are required to store massive amounts of data that are continuously inserted and queried. Analyzing huge data sets and extracting valuable pattern in many applications are interesting for researchers. We can identify…

Databases · Computer Science 2010-06-29 Madjid Khalilian , Norwati Mustapha

Large-batch Contrastive Learning (CL), the foundation of modern representation learning, is fundamentally incompatible with the volatile resource constraints of edge devices. This conflict creates a dilemma: small on-device batches degrade…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-27 Minh K. Quan , Pubudu N. Pathirana

Many organizations routinely analyze large datasets using systems for distributed data-parallel processing and clusters of commodity resources. Yet, users need to configure adequate resources for their data processing jobs. This requires…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-02 Lauritz Thamsen , Dominik Scheinert , Jonathan Will , Jonathan Bader , Odej Kao

Streaming data can arise from a variety of contexts. Important use cases are continuous sensor measurements such as temperature, light or radiation values. In the process, streaming data may also contain data errors that should be cleaned…

Databases · Computer Science 2025-07-29 Valerie Restat , Niklas Rodenhausen , Carina Antonin , Uta Störl

Recent neural networks (NNs) with self-attention exhibit competitiveness across different AI domains, but the essential attention mechanism brings massive computation and memory demands. To this end, various sparsity patterns are introduced…

Hardware Architecture · Computer Science 2024-11-26 Haibin Wu , Wenming Li , Kai Yan , Zhihua Fan , Peiyang Wu , Yuqun Liu , Yanhuan Liu , Ziqing Qiang , Meng Wu , Kunming Liu , Xiaochun Ye , Dongrui Fan

We study persistent query evaluation over streaming graphs, which is becoming increasingly important. We focus on navigational queries that determine if there exists a path between two entities that satisfies a user-specified constraint. We…

Databases · Computer Science 2020-04-07 Anil Pacaci , Angela Bonifati , M. Tamer Özsu