English
Related papers

Related papers: A Big Data Lake for Multilevel Streaming Analytics

200 papers

In this paper we propose an approach for executing data transformations near- or in-storage on intelligent storage systems. The currently prevailing approach of extracting the data and then transforming it to a target format suffers…

Databases · Computer Science 2026-01-27 Arthur Bernhardt , David Volz , Sajjad Tamimi , Andreas Koch , Ilia Petrov

A large number of cloud middleware platforms and tools are deployed to support a variety of Internet of Things (IoT) data analytics tasks. It is a common practice that such cloud platforms are only used by its owners to achieve their…

Networking and Internet Architecture · Computer Science 2016-06-28 Prem Prakash Jayaraman , Charith Perera , Dimitrios Georgakopoulos , Schahram Dustdar , Dhavalkumar Thakker , Rajiv Ranjan

Hadoop is a distributed batch processing infrastructure which is currently being used for big data management. The foundation of Hadoop consists of Hadoop Distributed File System or HDFS. HDFS presents a client server architecture comprised…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-11-26 Debajyoti Mukhopadhyay , Chetan Agrawal , Devesh Maru , Pooja Yedale , Pranav Gadekar

With the explosive growth of big data, workloads tend to get more complex and computationally demanding. Such applications are processed on distributed interconnected resources that are becoming larger in scale and computational capacity.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-30 Georgios L. Stavrinides , Helen D. Karatza

The growing emphasis on energy efficiency and environmental sustainability in global supply chains introduces new challenges in the deployment of hyperconnected logistic hub networks. In current volatile, uncertain, complex, and ambiguous…

Computation and Language · Computer Science 2025-03-28 Yinzhu Quan , Yujia Xu , Guanlin Chen , Frederick Benaben , Benoit Montreuil

With weather becoming more extreme both in terms of longer dry periods and more severe rain events, municipal water networks are increasingly under pressure. The effects include damages to the pipes, flash floods on the streets and combined…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-18 Felix Lorenz , Morgan Geldenhuys , Harald Sommer , Frauke Jakobs , Carsten Lüring , Volker Skwarek , Ilja Behnke , Lauritz Thamsen

The exponential increase of availability of digital data and the necessity to process it in business and scientific fields has literally forced upon us the need to analyze and mine useful knowledge from it. Traditionally data mining has…

Databases · Computer Science 2012-05-16 Rekha Sunny T , Sabu M. Thampi

Context - The exponential growth of data is becoming a significant concern. Managing this data has become incredibly challenging, especially when dealing with various sources in different formats and speeds. Moreover, Ensuring data quality…

Software Engineering · Computer Science 2024-03-12 Moamin Abughazala

Machine learning (ML) is revolutionizing the world, affecting almost every field of science and industry. Recent algorithms (in particular, deep networks) are increasingly data-hungry, requiring large datasets for training. Thus, the…

Machine Learning · Computer Science 2022-11-16 Chen Shani , Jonathan Zarecki , Dafna Shahaf

Marine in-situ data is collected by sensors mounted on fixed or mobile systems deployed into the ocean. This type of data is crucial both for the ocean industries and public authorities, e.g., for monitoring and forecasting the state of…

Data exploration and visualization systems are of great importance in the Big Data era, in which the volume and heterogeneity of available information make it difficult for humans to manually explore and analyse data. Most traditional…

Human-Computer Interaction · Computer Science 2016-02-22 Nikos Bikakis , George Papastefanatos , Melina Skourla , Timos Sellis

Data warehouse store and provide access to large volume of historical data supporting the strategic decisions of organisations. Data warehouse is based on a multidimensional model which allow to express user's needs for supporting the…

Databases · Computer Science 2012-08-02 Saida Aissi , Mohamed Salah Gouider

As new technologies move to the fore, our understanding of the world may seem to have shrunk in comparison, for despite new developments in research, much of it is reduced or rather, abstracted for marketability. Thus, the purpose of this…

Computers and Society · Computer Science 2017-01-24 Katherine Hughes

Different sectors have sought to take advantage of opportunities to invest in big data analytics and Natural language processing, in order to improve their productivity and competitiveness. Current challenges facing the higher education…

Computers and Society · Computer Science 2018-01-19 Amal S. Alblawi

With the shifting focus of organizations and governments towards digitization of academic and technical documents, there has been an increasing need to use this reserve of scholarly documents for developing applications that can facilitate…

Digital Libraries · Computer Science 2016-06-07 Samiya Khan , Kashish A. Shakil , Mansaf Alam

Today's most prominent IT companies are built on the extraction of insight from data, and data processing has become crucial in data-intensive businesses. Nevertheless, the size of data which should be processed is growing significantly…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Seyed Esmaeil Mirvakili , MohammadAmin Fazli , Jafar Habibi

Data-intensive computing has become one of the major workloads on traditional high-performance computing (HPC) clusters. Currently, deploying data-intensive computing software framework on HPC clusters still faces performance and…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-13 Pengfei Xuan , Jeffrey Denton , Rong Ge , Pradip K. Srimani , Feng Luo

Data Warehouse provides storage for huge amounts of historical data from heterogeneous operational sources in the form of multidimensional views, thus supplying sensitive and useful information which help decision-makers to improve the…

Cryptography and Security · Computer Science 2015-07-22 Saiqa Aleem , Luiz Fernando Capretz , Faheem Ahmed

We are living in the era of Big Data and witnessing the explosion of data. Given that the limitation of CPU and I/O in a single computer, the mainstream approach to scalability is to distribute computations among a large number of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Bingbing Rao , Liqiang Wang

Many applications from various disciplines are now required to analyze fast evolving big data in real time. Various approaches for incremental processing of queries have been proposed over the years. Traditional approaches rely on updating…

Databases · Computer Science 2019-02-05 Iman Elghandour , Ahmet Kara , Dan Olteanu , Stijn Vansummeren