English
Related papers

Related papers: Big Issues for Big Data: challenges for critical s…

200 papers

Large-scale empirical data, the sample size and the dimension are high, often exhibit various characteristics. For example, the noise term follows unknown distributions or the model is very sparse that the number of critical variables is…

Statistics Theory · Mathematics 2018-06-18 Yuehan Yang , Hu Yang

New technologies have led to vast troves of large and complex datasets across many scientific domains and industries. People routinely use machine learning techniques to not only process, visualize, and make predictions from this big data,…

Machine Learning · Statistics 2023-08-04 Genevera I. Allen , Luqin Gan , Lili Zheng

AI-based systems are widely employed nowadays to make decisions that have far-reaching impacts on individuals and society. Their decisions might affect everyone, everywhere and anytime, entailing concerns about potential human rights…

Clinicians decisions are becoming more and more evidence-based meaning in no other field the big data analytics so promising as in healthcare. Due to the sheer size and availability of healthcare data, big data analytics has revolutionized…

Other Statistics · Statistics 2020-04-21 Arshia Rehman , Saeeda Naz , Imran Razzak

As we are fast approaching the beginning of a paradigm shift in the field of science, Data driven science (the so called fourth science paradigm) is going to be the driving force in research and innovation. From medicine to biodiversity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Hrishav Bakul Barua

Big data analysis poses the dual problem of privacy preservation and utility, i.e., how accurate data analyses remain after transforming original data in order to protect the privacy of the individuals that the data is about - and whether…

Machine Learning · Computer Science 2022-11-29 Md Sakib Nizam Khan , Niklas Reje , Sonja Buchegger

In the last few decades, the size of spatial and spatio-temporal datasets in many research areas has rapidly increased with the development of data collection technologies. As a result, classical statistical methods in spatial statistics…

Other Statistics · Statistics 2022-11-08 Sameh Abdulah , Faten Alamri , Pratik Nag , Ying Sun , Hatem Ltaief , David E. Keyes , Marc G. Genton

Astronomy has a long history of acquiring, systematizing, and interpreting large quantities of data. Starting from the earliest sky atlases through the first major photographic sky surveys of the 20th century, this tradition is continuing…

Astrophysics · Physics 2007-05-23 Robert J. Brunner , S. George Djorgovski , Thomas A. Prince , Alex S. Szalay

Databases covering all individuals of a population are increasingly used for research and decision-making. The massive size of such databases is often mistaken as a guarantee for valid inferences. However, population data have…

Databases · Computer Science 2022-09-05 Peter Christen , Rainer Schnell

This paper argues that there are three fundamental challenges that need to be overcome in order to foster the adoption of big data technologies in non-computer science related disciplines: addressing issues of accessibility of such…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Muhammed Asif Saleem , Blesson Varghese , Adam Barker

Astrophysics has become a domain extremely rich of scientific data. Data mining tools are needed for information extraction from such large datasets. This asks for an approach to data management emphasizing the efficiency and simplicity of…

Databases · Computer Science 2009-11-10 M. Frailis , A. De Angelis , V. Roberto

Spatial confounding is a persistent challenge in spatial statistics, influencing the validity of statistical inference in models that analyze spatially-structured data. The concept has been interpreted in various ways but is broadly defined…

The wide proliferation of various wireless communication systems and wireless devices has led to the arrival of big data era in large scale wireless networks. Big data of large scale wireless networks has the key features of wide variety,…

Networking and Internet Architecture · Computer Science 2019-09-30 Hong-Ning Dai , Raymond Chi-Wing Wong , Hao Wang , Zibin Zheng , Athanasios V. Vasilakos

As observational datasets become larger and more complex, so too are the questions being asked of these data. Data simulations, i.e., synthetic data with properties (pixelization, noise, PSF, artifacts, etc.) akin to real data, are…

Instrumentation and Methods for Astrophysics · Physics 2019-10-25 Molly S. Peeples , Bjorn Emonts , Mark Kyprianou , Matthew T. Penny , Gregory F. Snyder , Christopher C. Stark , Michael Troxel , Neil T. Zimmerman , John ZuHone

A growing number of applications that generate massive streams of data need intelligent data processing and online analysis. Real-time surveillance systems, telecommunication systems, sensor networks and other dynamic environments are such…

Databases · Computer Science 2011-05-11 Mahnoosh Kholghi , Mohammadreza Keyvanpour

We analyse the issues involved in the management and mining of astrophysical data. The traditional approach to data management in the astrophysical field is not able to keep up with the increasing size of the data gathered by modern…

Databases · Computer Science 2007-05-23 M. Frailis , A. De Angelis , V. Roberto

The predicted increase in demand for data-intensive solution development is driving the need for software, data, and domain experts to effectively collaborate in multi-disciplinary data-intensive software teams (MDSTs). We conducted a…

Software Engineering · Computer Science 2023-03-28 Ulrike M. Graetsch , Hourieh Khalajzadeh , Mojtaba Shahin , Rashina Hoda , John Grundy

The vast amount of data produced everyday (so-called 'digital traces') and available nowadays represent a gold mine for the social sciences, especially in a computational context, that allows to fully extract their informational and…

Methodology · Statistics 2024-01-05 Serena Signorelli , Matteo Fontana , Lorenzo Gabrielli , Michele Vespe

With the rise of electronic data, particularly Earth observation data, data-based geospatial modelling using machine learning (ML) has gained popularity in environmental research. Accurate geospatial predictions are vital for domain…

Machine Learning · Computer Science 2023-11-21 Diana Koldasbayeva , Polina Tregubova , Mikhail Gasanov , Alexey Zaytsev , Anna Petrovskaia , Evgeny Burnaev

This report focuses on spatial data intelligent large models, delving into the principles, methods, and cutting-edge applications of these models. It provides an in-depth discussion on the definition, development history, current status,…