English
Related papers

Related papers: Challenges of Big Data Analysis

200 papers

The term big data has become ubiquitous. Owing to a shared origin between academia, industry and the media there is no single unified definition, and various stakeholders provide diverse and often contradictory definitions. The lack of a…

Databases · Computer Science 2013-09-24 Jonathan Stuart Ward , Adam Barker

This study analyzes the impact of heterogeneity ("Variety") in Big Data by comparing classification strategies across structured (Epsilon) and unstructured (Rest-Mex, IMDB) domains. A dual methodology was implemented: evolutionary and…

Data visualization and analytics are nowadays one of the corner-stones of Data Science, turning the abundance of Big Data being produced through modern systems into actionable knowledge. Indeed, the Big Data era has realized the…

Databases · Computer Science 2023-11-21 Nikos Bikakis

The massive data sets from today's particle physics experiments present a variety of challenges amenable to the tools developed by the statistics community. From the real-time decision of what subset of data to record on permanent storage,…

High Energy Physics - Experiment · Physics 2007-05-23 Bruce Knuteson , Paul Padley

Big data is no more "all just hype" but widely applied in nearly all aspects of our business, governments, and organizations with the technology stack of AI. Its influences are far beyond a simple technique innovation but involves all rears…

Other Computer Science · Computer Science 2021-04-19 Bilal Abu-Salih , Pornpit Wongthongtham , Dengya Zhu , Kit Yan Chan , Amit Rudra

While data science has emerged as a contentious new scientific field, enormous debates and discussions have been made on it why we need data science and what makes it as a science. In reviewing hundreds of pieces of literature which include…

Computers and Society · Computer Science 2020-07-01 Longbing Cao

Energy systems generate vast amounts of data in extremely short time intervals, creating challenges for efficient data management. Traditional data management methods often struggle with scalability and accessibility, limiting their…

Databases · Computer Science 2025-07-28 Lunodzo J. Mwinuka , Massimo Cafaro , Lucas Pereira , Hugo Morais

Novel technologies in genomics allow creating data in exascale dimension with relatively minor effort of human and laboratory and thus monetary resources compared to capabilities only a decade ago. While the availability of this data…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-10 Sandra Gesing , Thomas Richard Connor , Ian Taylor

Over the past two decades, the field of high-dimensional statistics has experienced substantial progress, driven largely by technological advances that have dramatically reduced the cost and effort for data collection and storage across a…

The emergence of "Big Data" as a dominant technology meme challenges Geography's technical underpinnings, found in GIS, while engaging the discipline in a conversation about the meme's impact on society. This allows scholars to engage…

Computation · Statistics 2013-10-17 Sean P. Gorman

Data is a precious resource in today's society, and is generated at an unprecedented and constantly growing pace. The need to store, analyze, and make data promptly available to a multitude of users introduces formidable challenges in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Alessandro Margara , Gianpaolo Cugola , Nicolò Felicioni , Stefano Cilloni

Large-scale data are often characterized by some degree of inhomogeneity as data are either recorded in different time regimes or taken from multiple sources. We look at regression models and the effect of randomly changing coefficients,…

Methodology · Statistics 2016-08-11 Nicolai Meinshausen , Peter Bühlmann

Data mining environment produces a large amount of data, that need to be analyzed, patterns have to be extracted from that to gain knowledge. In this new era with boom of data both structured and unstructured, in the field of genomics,…

Databases · Computer Science 2013-07-23 Chanchal Yadav , Shuliang Wang , Manoj Kumar

This article dwells on the basic characteristic features of the Big Data technologies. It is analyzed the existing definition of the "big data" term. The article proposes and describes the elements of the generalized formal model of big…

Databases · Computer Science 2019-05-09 Shakhovska Nataliya , Veres Oleh , Hirnyak Mariia

The advent of the big data paradigm has transformed how industries manage and analyze information, ushering in an era of unprecedented data volume, velocity, and variety. Within this landscape, mixed-data clustering has become a critical…

Machine Learning · Computer Science 2025-12-04 Guillaume Guerard , Sonia Djebali

Recently, we have been witnessing huge advancements in the scale of data we routinely generate and collect in pretty much everything we do, as well as our ability to exploit modern technologies to process, analyze and understand this data.…

Databases · Computer Science 2017-09-25 Radwa Elshawi , Sherif Sakr

Detecting quality in large unstructured datasets requires capacities far beyond the limits of human perception and communicability and, as a result, there is an emerging trend towards increasingly complex analytic solutions in data science…

The advent of the digital age has led to a rise in different types of data with every passing day. In fact, it is expected that half of the total data will be on the cloud by 2016. This data is complex and needs to be stored, processed and…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-20 Samiya Khan , Kashish Ara Shakil , Mansaf Alam

Big data systems development is full of challenges in view of the variety of application areas and domains that this technology promises to serve. Typically, fundamental design decisions involved in big data systems design include choosing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-29 Samiya Khan , Xiufeng Liu , Syed Arshad Ali , Mansaf Alam

Big data is a term used for a very large data sets that have many difficulties in storing and processing the data. Analysis this much amount of data will lead to information loss. The main goal of this paper is to share data in a way that…

Cryptography and Security · Computer Science 2018-08-14 Jalpesh Vasa , Panthini Modi