English
Related papers

Related papers: A Big Data Lake for Multilevel Streaming Analytics

200 papers

Enterprises operate large data lakes using Hadoop and Spark frameworks that (1) run a plethora of tools to automate powerful data preparation/transformation pipelines, (2) run on shared, large clusters to (3) perform many different…

Machine Learning · Computer Science 2018-02-14 Niketan Pansare , Michael Dusenberry , Nakul Jindal , Matthias Boehm , Berthold Reinwald , Prithviraj Sen

The exponential growth of data-driven systems and AI technologies has intensified the demand for high-quality web-sourced datasets. While existing datasets have proven valuable, conventional web data collection approaches face significant…

The advent of the digital age has led to a rise in different types of data with every passing day. In fact, it is expected that half of the total data will be on the cloud by 2016. This data is complex and needs to be stored, processed and…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-20 Samiya Khan , Kashish Ara Shakil , Mansaf Alam

Data is a precious resource in today's society, and is generated at an unprecedented and constantly growing pace. The need to store, analyze, and make data promptly available to a multitude of users introduces formidable challenges in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Alessandro Margara , Gianpaolo Cugola , Nicolò Felicioni , Stefano Cilloni

Advances in information technology and its widespread growth in several areas of business, engineering, medical and scientific studies are resulting in information/data explosion. Knowledge discovery and decision making from such rapidly…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-09-07 Raghavendra Kune , Pramodkumar Konugurthi , Arun Agarwal , Raghavendra Rao Chillarige , Rajkumar Buyya

Velocity is one of the 4 Vs commonly used to characterize Big Data. In this regard, Forrester remarked the following in Q3 2014: "The high velocity, white-water flow of data from innumerable real-time data sources such as market data,…

Databases · Computer Science 2017-08-10 Arun Kejariwal , Sanjeev Kulkarni , Karthik Ramasamy

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa

Contemporary approaches to data management are increasingly relying on unified analytics and AI platforms to foster collaboration, interoperability, seamless access to reliable data, and high performance. Data Lakes featuring open standard…

Recently, we have been witnessing huge advancements in the scale of data we routinely generate and collect in pretty much everything we do, as well as our ability to exploit modern technologies to process, analyze and understand this data.…

Databases · Computer Science 2017-09-25 Radwa Elshawi , Sherif Sakr

Current generation of Internet-based services are typically hosted on large data centers that take the form of warehouse-size structures housing tens of thousands of servers. Continued availability of a modern data center is the result of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-10 Alkida Balliu , Dennis Olivetti , Ozalp Babaoglu , Moreno Marzolla , Alina Sîrbu

In last few years, the volume of the data has grown manyfold. The data storages have been inundated by various disparate potential data outlets, leading by social media such as Facebook, Twitter, etc. The existing data models are largely…

Databases · Computer Science 2015-10-08 Sugam Sharma

Apache HBase, a mainstay of the emerging Hadoop ecosystem, is a NoSQL key-value and column family hybrid database which, unlike a traditional RDBMS, is intentionally designed to scalably host large, semistructured, and heterogeneous data.…

Databases · Computer Science 2017-02-23 Georgios Drakopoulos , Andreas Kanavos , Christos Makris , Vasileios Megalooikonomou

Nowadays most of the cloud applications process large amount of data to provide the desired results. Data volumes to be processed by cloud applications are growing much faster than computing power. This growth demands new strategies for…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-05 B. Thirumala Rao , N. V. Sridevi , V. Krishna Reddy , L. S. S. Reddy

Classification in the context of multi-label data streams represents a challenge that has attracted significant attention due to its high real-world applicability. However, this task faces problems inherent to dynamic environments, such as…

Machine Learning · Computer Science 2025-08-26 H. Freire-Oliveira , E. R. F. Paiva , J. Gama , L. Khan , R. Cerri

On the rise of distributed computing technologies, video big data analytics in the cloud have attracted researchers and practitioners' attention. The current technology and market trends demand an efficient framework for video big data…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-06 Aftab Alam , Shah Khalid , Muhammad Numan Khan , Tariq Habib Afridi , Irfan Ullah , Young-Koo Lee

Shark is a new data analysis system that marries query processing with complex analytics on large clusters. It leverages a novel distributed memory abstraction to provide a unified engine that can run SQL queries and sophisticated analytics…

Databases · Computer Science 2012-11-28 Reynold Xin , Josh Rosen , Matei Zaharia , Michael J. Franklin , Scott Shenker , Ion Stoica

Data streaming relies on continuous queries to process unbounded streams of data in a real-time fashion. It is commonly demanding in computation capacity, given that the relevant applications involve very large volumes of data. Data…

Data Structures and Algorithms · Computer Science 2016-06-16 Vincenzo Gulisano , Yiannis Nikolakopoulos , Daniel Cederman , Marina Papatriantafilou , Philippas Tsigas

The exponential growth of data in current times and the demand to gain information and knowledge from the data present new challenges for database researchers. Known database systems and algorithms are no longer capable of effectively…

Databases · Computer Science 2017-12-06 Yaron Gonen

Over the last several years, the computation landscape for conducting data analytics has completely changed. While in the past, a lot of the activities have been undertaken in isolation by companies, and research institutions, today's…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-27 Gregor von Laszewski , Wo Chang , Russell Reinsch , Olivera Kotevska , Ali Karimi , Abdul Rahman Sattar , Garry Mazzaferro , Geoffrey C. Fox

The rate at which data is generated has been increasing rapidly, raising challenges related to its management. Traditional database management systems suffer from scalability and are usually inefficient when dealing with large-scale and…

Databases · Computer Science 2025-07-22 Massimo Cafaro , Italo Epicoco , Marco Pulimeno , Lunodzo J. Mwinuka , Lucas Pereira , Hugo Morais