中文
相关论文

相关论文: Building Analytics Pipelines for Querying Big Stre…

200 篇论文

Pulsar data analysis pipelines have historically been comprised of bespoke software systems, supporting the off-line analysis of data. However modern data acquisition systems are making off-line analyses impractical. They often output…

天体物理仪器与方法 · 物理学 2018-10-16 R. J. Lyon , B. W. Stappers , L. Levin , M. B. Mickaliger , A. Scaife

This paper proposes a hierarchical solution to scale streaming services across quality and resource dimensions. Modern scenarios, like smart cities, heavily rely on the continuous processing of IoT data to provide real-time services and…

In this paper, a data stream architecture is presented for electrical power quality (PQ) which is called PQStream. PQStream is developed to process and manage time-evolving data coming from the country-wide mobile measurements of electrical…

Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey…

分布式、并行与集群计算 · 计算机科学 2023-01-18 Marios Fragkoulis , Paris Carbone , Vasiliki Kalavri , Asterios Katsifodimos

Modern scientific instruments generate data at rates that increasingly exceed local compute capabilities and, when paired with the staging and I/O overheads of file-based transfers, also render file-based use of remote HPC resources…

分布式、并行与集群计算 · 计算机科学 2025-10-01 Flavio Castro , Weijian Zheng , Joaquin Chung , Ian Foster , Rajkumar Kettimuthu

Data stream processing frameworks provide reliable and efficient mechanisms for executing complex workflows over large datasets. A common challenge for the majority of currently available streaming frameworks is efficient utilization of…

分布式、并行与集群计算 · 计算机科学 2020-01-30 Oliver Stein , Ben Blamey , Johan Karlsson , Alan Sabirsh , Ola Spjuth , Andreas Hellander , Salman Toor

Controlling and analyzing cyberphysical and robotics systems is increasingly becoming a Big Data challenge. Pushing this data to, and processing in the cloud is more efficient than on-board processing. However, current cloud-based solutions…

机器人学 · 计算机科学 2012-12-17 Timothy Hunter , Tathagata Das , Matei Zaharia , Pieter Abbeel , Alexandre M. Bayen

Internet of Things (IoT) will comprise billions of devices that can sense, communicate, compute and potentially actuate. Data streams coming from these devices will challenge the traditional approaches to data management and contribute to…

计算机与社会 · 计算机科学 2013-01-29 Arkady Zaslavsky , Charith Perera , Dimitrios Georgakopoulos

Many of the existing sentiment analysis techniques are based on supervised learning, and they demand the availability of valuable training datasets to train their models. When dataset freshness is critical, the annotating of high speed…

数据库 · 计算机科学 2022-03-24 Huilin Wu , Mian Lu , Zhao Zheng , Shuhao Zhang

Data quality is fundamental to modern data science workflows, where data continuously flows as unbounded streams feeding critical downstream tasks, from elementary analytics to advanced artificial intelligence models. Existing data quality…

数据库 · 计算机科学 2025-06-09 Vasileios Papastergios , Anastasios Gounaris

In highly distributed environments such as cloud, edge and fog computing, the application of machine learning for automating and optimizing processes is on the rise. Machine learning jobs are frequently applied in streaming conditions,…

分布式、并行与集群计算 · 计算机科学 2022-03-11 Soeren Becker , Dominik Scheinert , Florian Schmidt , Odej Kao

The paper introduces PDSP-Bench, a novel benchmarking system designed for a systematic understanding of performance of parallel stream processing in a distributed environment. Such an understanding is essential for determining how Stream…

分布式、并行与集群计算 · 计算机科学 2025-04-16 Pratyush Agnihotri , Boris Koldehofe , Roman Heinrich , Carsten Binnig , Manisha Luthra

Motivated by cloud computing, a number of recent works have studied annotated data streams and variants thereof. In this setting, a computationally weak verifier (cloud user), lacking the resources to store and manipulate his massive input…

计算复杂性 · 计算机科学 2013-04-16 Amit Chakrabarti , Graham Cormode , Navin Goyal , Justin Thaler

As an application usage grows, its owner scales up vertically by replacing old machines with more powerful ones. This methodology is expensive and leads to resource waste. In response to the business needs, internet giants have developed…

分布式、并行与集群计算 · 计算机科学 2019-11-07 Yujing Wang , Darrel Ma

With the enhancements in the field of software-defined networking and virtualization technologies, novel networking paradigms such as network function virtualization (NFV) and the Internet of things (IoT) are rapidly gaining ground.…

网络与互联网体系结构 · 计算机科学 2019-04-01 Deval Bhamare , Mohammed Samaka , Aiman Erbad , Raj Jain , Lav Gupta

Cloud computing provides ubiquitous and on-demand access to vast reconfigurable resources that can meet any computational need. Many service models are available, but the Infrastructure as a Service (IaaS) model is particularly suited to…

分布式、并行与集群计算 · 计算机科学 2020-09-29 Gianluca Longoni , Ryan LaMothe , Jeremy Teuton , Mark Greaves , Nicole Nichols , William Smith

IoT applications usually rely on cloud computing services to perform data analysis such as filtering, aggregation, classification, pattern detection, and prediction. When applied to specific domains, the IoT needs to deal with unique…

信号处理 · 电气工程与系统科学 2022-05-09 Márcio Miguel Gomes , Rodrigo da Rosa Righi , Cristiano André da Costa , Dalvan Griebler

Speech Enhancement techniques have become core technologies in mobile devices and voice software. Still, modern deep learning solutions often require high amount of computational resources what makes their usage on low-resource devices…

声音 · 计算机科学 2025-07-24 Ekaterina Dmitrieva , Maksim Kaledin

Many of the services a smart city can provide to its citizens rely on the ability of its infrastructure to collect and process in real time vast amounts of continuous data that sensors deployed through the city produce. In this paper we…

Many applications from various disciplines are now required to analyze fast evolving big data in real time. Various approaches for incremental processing of queries have been proposed over the years. Traditional approaches rely on updating…

数据库 · 计算机科学 2019-02-05 Iman Elghandour , Ahmet Kara , Dan Olteanu , Stijn Vansummeren