English
Related papers

Related papers: Challenges of Big Data Analysis

200 papers

Perhaps one of the mostly hotly debated topics in recent years has been the question of "GIS and Big Data". Much of the discussion has been about the data: huge volumes of 2D and 3D spatial data and spatio-temporal data are now being…

Computers and Society · Computer Science 2019-02-19 Guy Lansley , Michael de Smith , Michael Goodchild , Paul Longley

The vast amount of data produced everyday (so-called 'digital traces') and available nowadays represent a gold mine for the social sciences, especially in a computational context, that allows to fully extract their informational and…

Methodology · Statistics 2024-01-05 Serena Signorelli , Matteo Fontana , Lorenzo Gabrielli , Michele Vespe

The explosion of data on the internet is a direct corollary of the social media platform. With petabytes of data being generated by end users, the researchers have access to unprecedented amount of data (Big Data). Such data provides an…

Computers and Society · Computer Science 2019-02-06 Adil E. Rajput , Samara M. Ahmed

The relevance and importance of contextualizing data analytics is described. Qualitative characteristics might form the context of quantitative analysis. Topics that are at issue include: contrast, baselining, secondary data sources,…

Artificial Intelligence · Computer Science 2023-06-22 Fionn Murtagh , Mohsen Farid

As artificial intelligence and machine learning tools become more accessible, and scientists face new obstacles to data collection (e.g., rising costs, declining survey response rates), researchers increasingly use predictions from…

Machine Learning · Statistics 2025-12-08 Stephen Salerno , Kentaro Hoffman , Awan Afiaz , Anna Neufeld , Tyler H. McCormick , Jeffrey T. Leek

If a person looks at WHITE paper through BLUE glasses, the paper will become BLUE in the eye of the person. Likewise, in the current study of big data which play the same role as the white paper being looked at, various statistical methods…

Data Analysis, Statistics and Probability · Physics 2014-12-23 J. P. Huang

Building on a strong foundation of philosophy, theory, methods and computation over the past three decades, Bayesian approaches are now an integral part of the toolkit for most statisticians and data scientists. Whether they are dedicated…

The exponential growth of big data has transformed how large organisations leverage information to drive innovation, optimise processes, and maintain competitive advantages. However, managing and extracting insights from vast, heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-09 Fathima Nuzla Ismail , Abira Sengupta , Shanika Amarasoma

Current metagenomic analysis algorithms require significant computing resources, can report excessive false positives (type I errors), may miss organisms (type II errors / false negatives), or scale poorly on large datasets. This paper…

Databases · Computer Science 2015-01-23 Ashley Mae Conard , Stephanie Dodson , Jeremy Kepner , Darrell Ricke

The need for new methods to deal with big data is a common theme in most scientific fields, although its definition tends to vary with the context. Statistical ideas are an essential part of this, and as a partial response, a thematic…

The great prosperity of big data systems such as Hadoop in recent years makes the benchmarking of these systems become crucial for both research and industry communities. The complexity, diversity, and rapid evolution of big data systems…

Performance · Computer Science 2015-06-05 Rui Han , Zhen Jia , Wanling Gao , Xinhui Tian , Lei Wang

While the disruptive potential of artificial intelligence (AI) and Big Data has been receiving growing attention and concern in a variety of research and application fields over the last few years, it has not received much scrutiny in…

General Economics · Economics 2019-06-04 Martin Obschonka , David B. Audretsch

This paper reviews recent advances in big data optimization, providing the state-of-art of this emerging field. The main focus in this review are optimization techniques being applied in big data analysis environments. Integer linear…

Neural and Evolutionary Computing · Computer Science 2021-02-04 Ricardo Di Pasquale , Javier Marenco

We have witnessed an exponential growth in commercial data services, which has lead to the 'big data era'. Machine learning, as one of the most promising artificial intelligence tools of analyzing the deluge of data, has been invoked in…

Networking and Internet Architecture · Computer Science 2019-12-16 Yuanwei Liu , Suzhi Bi , Zhiyuan Shi , Lajos Hanzo

Large amount of multidimensional data represented by multiway arrays or tensors are prevalent in modern applications across various fields such as chemometrics, genomics, physics, psychology, and signal processing. The structural complexity…

Statistics Theory · Mathematics 2024-05-29 Arnab Auddy , Dong Xia , Ming Yuan

Big data analytics has opened new avenues in economic research, but the challenge of analyzing datasets with tens of millions of observations is substantial. Conventional econometric methods based on extreme estimators require large amounts…

Econometrics · Economics 2023-11-02 Sokbae Lee , Yuan Liao , Myung Hwan Seo , Youngki Shin

Digital world is growing very fast and become more complex in the volume (terabyte to petabyte), variety (structured and un-structured and hybrid), velocity (high speed in growth) in nature. This refers to as Big Data that is a global…

Databases · Computer Science 2013-07-02 A B M Moniruzzaman , Syed Akhter Hossain

To succeed in a Big Data strategy, you have to arm yourself with a wide range of data skills and best practices. This strategy can result in an impressive asset that can streamline operational costs, reduce time to market, and enable the…

Databases · Computer Science 2023-09-18 Rania Mkhinini Gahar , Olfa Arfaoui , Minyar Sassi Hidri

For a developing nation, deploying big data (BD) technology and introducing data science in higher education is a challenge. A pessimistic scenario is: Mis-use of data in many possible ways, waste of trained manpower, poor BD certifications…

Computers and Society · Computer Science 2018-03-19 K. Viswanathan Iyer

Humans are expert in the amount of sensory data they deal with each moment. Human brain not only analyses these data but also starts synthesizing new information from the existing data. The current age Big-data systems are needed not just…

Artificial Intelligence · Computer Science 2022-08-26 Amit Kumar Mishra