English
Related papers

Related papers: Subscribing to Big Data at Scale

200 papers

Aggregation has been an important operation since the early days of relational databases. Today's Big Data applications bring further challenges when processing aggregation queries, demanding adaptive aggregation algorithms that can process…

Databases · Computer Science 2013-11-04 Jian Wen , Vinayak R. Borkar , Michael J. Carey , Vassilis J. Tsotras

Emerging smart grid applications analyze large amounts of data collected from millions of meters and systems to facilitate distributed monitoring and real-time control tasks. However, current parallel data processing systems are designed…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-03 Binquan Guo , Hongyan Li , Ye Yan , Zhou Zhang , Peng Wang

Big data is gaining overwhelming attention since the last decade. Almost all the fields of science and technology have experienced a considerable impact from it. The cloud computing paradigm has been targeted for big data processing and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-27 Hrishav Bakul Barua , Kartick Chandra Mondal

Cloud computing is recognized as one of the most promising solutions to information technology, e.g., for storing and sharing data in the web service which is sustained by a company or third party instead of storing data in a hard drive or…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-14 A. Roy , A. P. Misra , S. Banerjee

A growing trend in modern data analysis is the integration of data management with learning, guided by accuracy, latency, and cost requirements. In practice, applications draw data of different formats from many sources. In the meanwhile,…

Databases · Computer Science 2025-10-15 Meihui Zhang , Liming Wang , Chi Zhang , Zhaojing Luo

In a data warehousing process, the phase of data integration is crucial. Many methods for data integration have been published in the literature. However, with the development of the Internet, the availability of various types of data…

Databases · Computer Science 2008-09-17 Omar Boussaïd , Fadila Bentayeb , Jérôme Darmont

Big data are data on a massive scale in terms of volume, intensity, and complexity that exceed the capacity of standard software tools. They present opportunities as well as challenges to statisticians. The role of computational…

Computation · Statistics 2018-06-13 Chun Wang , Ming-Hui Chen , Elizabeth Schifano , Jing Wu , Jun Yan

The rise of worldwide Internet-scale services demands large distributed systems. Indeed, when handling several millions of users, it is common to operate thousands of servers spread across the globe. Here, replication plays a central role,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-11 Samuel Benz , Parisa Jalili Marandi , Fernando Pedone , Benoît Garbinato

DIAL will enable users to analyze very large, event-based datasets using an application that is natural to the data format. Both the dataset and the processing may be distributed over a farm, a site (collection of farms) or a grid…

High Energy Physics - Phenomenology · Physics 2007-05-23 D. L. Adams

End-to-end differentiable learning for autonomous driving (AD) has recently become a prominent paradigm. One main bottleneck lies in its voracious appetite for high-quality labeled data e.g. 3D bounding boxes and semantic segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Han Lu , Xiaosong Jia , Yichen Xie , Wenlong Liao , Xiaokang Yang , Junchi Yan

Cloud computing provides scientists a platform that can deploy computation and data intensive applications without infrastructure investment. With excessive cloud resources and a decision support system, large generated data sets can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-27 Dong Yuan , Lizhen Cui , Xiao Liu , Erjiang Fu , Yun Yang

Industry 4.0 factories are complex and data-driven. Data is yielded from many sources, including sensors, PLCs, and other devices, but also from IT, like ERP or CRM systems. We ask how to collect and process this data in a way, such that it…

Information Retrieval · Computer Science 2026-03-24 Eduard Hirsch , Simon Hoher , Stefan Huber

Data-intensive systems handle variable, high volume, and high-velocity data generated by human and digital devices. Like traditional software, data-intensive systems are prone to technical debts introduced to cope-up with the pressure of…

Software Engineering · Computer Science 2022-08-19 Biruk Asmare Muse , Kawser Wazed Nafi , Foutse Khomh , Giuliano Antoniol

Fog computing extends the cloud computing paradigm by allocating substantial portions of computations and services towards the edge of a network, and is, therefore, particularly suitable for large-scale, geo-distributed, and data-intensive…

Signal Processing · Electrical Eng. & Systems 2019-12-03 Guangxia Li , Peilin Zhao , Xiao Lu , Jia Liu , Yulong Shen

In the era of big data, the issue of data quality has become increasingly prominent. One of the main challenges is the problem of duplicate data, which can arise from repeated entry or the merging of multiple data sources. These "dirty…

Machine Learning · Computer Science 2025-01-13 Haochen Shi , Xinyao Liu , Fengmao Lv , Hongtao Xue , Jie Hu , Shengdong Du , Tianrui Li

The evolution of the utilization of technologies in nearly all aspects of life has produced an enormous amount of data essential in a smart city. Therefore, maximizing the benefits of technologies such as cloud computing, fog computing, and…

Cryptography and Security · Computer Science 2020-01-20 Abdulwahab Alazeb , Brajendra Panda

Generative artificial intelligence (GenAI) offers various services to users through content creation, which is believed to be one of the most important components in future networks. However, training and deploying big artificial…

Networking and Internet Architecture · Computer Science 2024-01-04 Yuqing Tian , Zhaoyang Zhang , Yuzhi Yang , Zirui Chen , Zhaohui Yang , Richeng Jin , Tony Q. S. Quek , Kai-Kit Wong

Multi-behavior sequential recommendation aims to capture users' dynamic interests by modeling diverse types of user interactions over time. Although several studies have explored this setting, the recommendation performance remains…

Information Retrieval · Computer Science 2025-12-16 Yupeng Li , Mingyue Cheng , Yucong Luo , Yitong Zhou , Qingyang Mao , Shijin Wang

Multidimensional databases are a great asset for decision making. Their users express complex OLAP (On-Line Analytical Processing) queries, often returning huge volumes of facts, sometimes providing little or no information. Furthermore,…

Databases · Computer Science 2012-08-02 Saida Aissi , Mohamed Salah Gouider

With the advent of Internet of Things (IoT) and Web 2.0 technologies, there has been a tremendous growth in the amount of data generated. This chapter emphasizes on the need for big data, technological advancements, tools and techniques…

Databases · Computer Science 2017-05-16 Abhay Bhadani , Dhanya Jothimani