English
Related papers

Related papers: Big Issues for Big Data: challenges for critical s…

200 papers

How should statistical procedures be designed so as to be scalable computationally to the massive datasets that are increasingly the norm? When coupled with the requirement that an answer to an inferential question be delivered within a…

Machine Learning · Statistics 2013-10-01 Michael I. Jordan

The advent of the digital age has led to a rise in different types of data with every passing day. In fact, it is expected that half of the total data will be on the cloud by 2016. This data is complex and needs to be stored, processed and…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-20 Samiya Khan , Kashish Ara Shakil , Mansaf Alam

Astronomy is increasingly encountering two fundamental truths: (1) The field is faced with the task of extracting useful information from extremely large, complex, and high dimensional datasets; (2) The techniques of astroinformatics and…

Instrumentation and Methods for Astrophysics · Physics 2011-10-28 Nicholas M. Ball

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

The rapid growth and diversity in service offerings and the ensuing complexity of information technology ecosystems present numerous management challenges (both operational and strategic). Instrumentation and measurement technology is, by…

Software Engineering · Computer Science 2012-06-26 Moises Goldszmidt

Spatial documentation is exponentially increasing given the availability of Big IoT Data, enabled by the devices miniaturization and data storage capacity. Bayesian spatial statistics is a useful statistical tool to determine the dependence…

Methodology · Statistics 2020-10-01 Francisco Louzada , Diego C. Nascimento , Osafu Augustine Egbon

In the big data era researchers face a series of problems. Even standard approaches/methodologies, like linear regression, can be difficult or problematic with huge volumes of data. Traditional approaches for regression in big datasets may…

Methodology · Statistics 2024-11-13 Vasilis Chasiotis , Dimitris Karlis

In recent past, big data opportunities have gained much momentum to enhance knowledge management in organizations. However, big data due to its various properties like high volume, variety, and velocity can no longer be effectively stored…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-16 Mohammad Shorfuzzaman

With the explosive growth of big data, workloads tend to get more complex and computationally demanding. Such applications are processed on distributed interconnected resources that are becoming larger in scale and computational capacity.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-30 Georgios L. Stavrinides , Helen D. Karatza

Algorithms and technologies are essential tools that pervade all aspects of our daily lives. In the last decades, health care research benefited from new computer-based recruiting methods, the use of federated architectures for data…

Computers and Society · Computer Science 2023-01-26 Chiara Criscuolo , Tommaso Dolci , Mattia Salnitri

This paper presents the risks and opportunities of big data and the potential social benefits it can bring. The research is based on an analysis of the societal impacts observed in a set of six case studies across different European…

Computers and Society · Computer Science 2017-04-12 Martí Cuquet , Guillermo Vega-Gorgojo , Hans Lammerant , Rachel Finn , Umair ul Hassan

Humans are expert in the amount of sensory data they deal with each moment. Human brain not only analyses these data but also starts synthesizing new information from the existing data. The current age Big-data systems are needed not just…

Artificial Intelligence · Computer Science 2022-08-26 Amit Kumar Mishra

This work considers the question of how convenient access to copious data impacts our ability to learn causal effects and relations. In what ways is learning causality in the era of big data different from -- or the same as -- the…

Artificial Intelligence · Computer Science 2020-05-06 Ruocheng Guo , Lu Cheng , Jundong Li , P. Richard Hahn , Huan Liu

Big Data can mean different things to different people. The scale and challenges of Big Data are often described using three attributes, namely Volume, Velocity and Variety (3Vs), which only reflect some of the aspects of data. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-14 Caesar Wu , Rajkumar Buyya , Kotagiri Ramamohanarao

- Current infrastructures for developing big-data applications are able to process --via big-data analytics-huge amounts of data, using clusters of machines that collaborate to perform parallel computations. However, current infrastructures…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-04 Pablo Basanta-Val , Neil Audsley , Andy Wellings , Ian Gray , Norberto Fernandez

For a developing nation, deploying big data (BD) technology and introducing data science in higher education is a challenge. A pessimistic scenario is: Mis-use of data in many possible ways, waste of trained manpower, poor BD certifications…

Computers and Society · Computer Science 2018-03-19 K. Viswanathan Iyer

With the explosion of social media sites and proliferation of digital computing devices and Internet access, massive amounts of public data is being generated on a daily basis. Efficient techniques/ algorithms to analyze this massive amount…

Computers and Society · Computer Science 2016-02-26 Anwaar Ali , Junaid Qadir , Raihan ur Rasool , Arjuna Sathiaseelan , Andrej Zwitter

Datasets have played a foundational role in the advancement of machine learning research. They form the basis for the models we design and deploy, as well as our primary medium for benchmarking and evaluation. Furthermore, the ways in which…

Machine Learning · Computer Science 2021-11-16 Amandalynne Paullada , Inioluwa Deborah Raji , Emily M. Bender , Emily Denton , Alex Hanna

Big Data involves both a large number of events but also many variables. This paper will concentrate on the challenge presented by the large number of variables in a Big Dataset. It will start with a brief review of exploratory data…

Applications · Statistics 2019-07-24 S. J. Watts , L. Crow

Information Theory provides a fundamental basis for analysis, and for a variety of subsequent methodological approaches, in relation to uncertainty quantification. The transversal character of concepts and derived results justifies its…

Statistics Theory · Mathematics 2024-11-27 Jose M. Angulo , Francisco J. Esquivel , Ana E. Madrid , Francisco J. Alonso