English
Related papers

Related papers: An Experimental Survey on Big Data Frameworks

200 papers

Big data has now become a strong focus of global interest that is increasingly attracting the attention of academia, industry, government and other organizations. Big data can be situated in the disciplinary area of traditional geospatial…

Physics and Society · Physics 2020-09-04 S. Li , S. Dragicevic , F. Anton , M. Sester , S. Winter , A. Coltekin , C. Pettit , B. Jiang , J. Haworth , A. Stein , T. Cheng

This paper argues that there are three fundamental challenges that need to be overcome in order to foster the adoption of big data technologies in non-computer science related disciplines: addressing issues of accessibility of such…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Muhammed Asif Saleem , Blesson Varghese , Adam Barker

This article dwells on the basic characteristic features of the Big Data technologies. It is analyzed the existing definition of the "big data" term. The article proposes and describes the elements of the generalized formal model of big…

Databases · Computer Science 2019-05-09 Shakhovska Nataliya , Veres Oleh , Hirnyak Mariia

The term big data has become ubiquitous. Owing to a shared origin between academia, industry and the media there is no single unified definition, and various stakeholders provide diverse and often contradictory definitions. The lack of a…

Databases · Computer Science 2013-09-24 Jonathan Stuart Ward , Adam Barker

Big Data are huge amounts of digital information that are automatically accrued or merged from several sources and rarely result from properly planned surveys. A Big Dataset is herein conceived of as a collection of information concerning a…

Computation · Statistics 2020-02-12 Deldossi Laura , Tommasi Chiara

This survey paper conducts a comprehensive analysis of the evolution and contemporary landscape of recommendation systems, which have been extensively incorporated across a myriad of web applications. It delves into the progression of…

Information Retrieval · Computer Science 2024-12-17 Ziyuan Xia , Anchen Sun , Jingyi Xu , Yuanzhe Peng , Rui Ma , Minghui Cheng

Data originating from the Web, sensor readings and social media result in increasingly huge datasets. The so called Big Data comes with new scientific and technological challenges while creating new opportunities, hence the increasing…

Artificial Intelligence · Computer Science 2020-02-19 Ilias Tachmazidis , Grigoris Antoniou , Wolfgang Faber

Big data has been used widely in many areas including the transportation industry. Using various data sources, traffic states can be well estimated and further predicted for improving the overall operation efficiency. Combined with this…

Machine Learning · Computer Science 2022-02-21 Weiwei Jiang , Jiayun Luo

This study reviews the topic of big data management in the 21st-century. There are various developments that have facilitated the extensive use of that form of data in different organizations. The most prominent beneficiaries are internet…

Computers and Society · Computer Science 2015-09-08 Okal Christopher Otieno

Background: Big Data is a relatively new field of research and technology, and literature reports a wide variety of concepts labeled with Big Data. The maturity of a research field can be measured in the number of publications containing…

Digital Libraries · Computer Science 2016-10-13 Bjørn Magnus Mathisen , Leendert Wienhofen , Dumitru Roman

The Internet of Things, crowdsourcing, social media, public authorities, and other sources generate bigger and bigger data sets. Big and open data offers many benefits for emergency management, but also pose new challenges. This chapter…

Computers and Society · Computer Science 2020-12-17 Andreas L Opdahl , Vimala Nunavath

Big data systems development is full of challenges in view of the variety of application areas and domains that this technology promises to serve. Typically, fundamental design decisions involved in big data systems design include choosing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-29 Samiya Khan , Xiufeng Liu , Syed Arshad Ali , Mansaf Alam

Driven by the recent advances in smart, miniaturized, and mass produced sensors, networked systems, and high-speed data communication and computing, the ability to collect and process larger volumes of higher veracity real-time data from a…

Other Computer Science · Computer Science 2018-09-03 Chun-An Chou , Xiaoning Jin , Amy Mueller , Sarah Ostadabbas

The ability to collect and analyze large amounts of data is a growing problem within the scientific community. The growing gap between data and users calls for innovative tools that address the challenges faced by big data volume, velocity…

Databases · Computer Science 2016-08-01 Vijay Gadepally , Jeremy Kepner

The exponential growth of big data has transformed how large organisations leverage information to drive innovation, optimise processes, and maintain competitive advantages. However, managing and extracting insights from vast, heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-09 Fathima Nuzla Ismail , Abira Sengupta , Shanika Amarasoma

Hadoop and Spark are widely used distributed processing frameworks for large-scale data processing in an efficient and fault-tolerant manner on private or public clouds. These big-data processing systems are extensively used by many…

Databases · Computer Science 2017-07-07 Shlomi Dolev , Patricia Florissi , Ehud Gudes , Shantanu Sharma , Ido Singer

The modern era is characterised as an era of information or Big Data. This has motivated a huge literature on new methods for extracting information and insights from these data. A natural question is how these approaches differ from those…

Computation · Statistics 2020-06-09 Farzana Jahan , Insha Ullah , Kerrie L Mengersen

Big Data is considered proprietary asset of companies, organizations, and even nations. Turning big data into real treasure requires the support of big data systems. A variety of commercial and open source products have been unleashed for…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-29 Yuqing Zhu , Jianfeng Zhan , Chuliang Weng , Raghunath Nambiar , Jinchao Zhang , Xingzhen Chen , Lei Wang

HEP data-processing software must support the disparate physics needs of many experiments. For both collider and neutrino environments, HEP experiments typically use data-processing frameworks to manage the computational complexities of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-29 Christopher D. Jones , Kyle Knoepfel , Paolo Calafiura , Charles Leggett , Vakhtang Tsulaia

Assessing and improving the quality of data are fundamental challenges for data-intensive systems that have given rise to applications targeting transformation and cleaning of data. However, while schema design, data cleaning, and data…

Databases · Computer Science 2017-03-28 Rada Chirkova , Jon Doyle , Juan L. Reutter