English
Related papers

Related papers: Big Data: the End of the Scientific Method?

200 papers

The importance of big data is a contested topic among social scientists. Proponents claim it will fuel a research revolution, but skeptics challenge it as unreliably measured and decontextualized, with limited utility for accurately…

Computers and Society · Computer Science 2020-06-12 Nathaniel D. Porter , Ashton M. Verdery , S. Michael Gaddis

Exabytes of data are generated daily by humans, leading to the growing need for new efforts in dealing with the grand challenges for multi-label learning brought by big data. For example, extreme multi-label classification is an active and…

Machine Learning · Computer Science 2021-11-18 Weiwei Liu , Haobo Wang , Xiaobo Shen , Ivor W. Tsang

Big data features not only large volumes of data but also data with complicated structures. Complexity imposes unique challenges in big data analytics. Meeker and Hong (2014, Quality Engineering, pp. 102-116) provided an extensive…

Applications · Statistics 2018-03-19 Yili Hong , Man Zhang , William Q. Meeker

Nowadays, science has been coming into a new paradigm, called data-intensive science. While current studies of the new phenomenon focused on building up infrastructure for this new paradigm, yet a few studies concern users of scientific…

Instrumentation and Methods for Astrophysics · Physics 2011-02-08 Jian Zhang , Chaomei Chen , Michael S. Vogeley

This paper reviews recent advances in big data optimization, providing the state-of-art of this emerging field. The main focus in this review are optimization techniques being applied in big data analysis environments. Integer linear…

Neural and Evolutionary Computing · Computer Science 2021-02-04 Ricardo Di Pasquale , Javier Marenco

The eruption of big data with the increasing collection and processing of vast volumes and variety of data have led to breakthrough discoveries and innovation in science, engineering, medicine, commerce, criminal justice, and national…

Cryptography and Security · Computer Science 2020-07-03 Fang Liu

In the era of big data, analysts usually explore various statistical models or machine learning methods for observed data in order to facilitate scientific discoveries or gain predictive power. Whatever data and fitting procedures are…

Machine Learning · Statistics 2018-10-24 Jie Ding , Vahid Tarokh , Yuhong Yang

While the disruptive potential of artificial intelligence (AI) and Big Data has been receiving growing attention and concern in a variety of research and application fields over the last few years, it has not received much scrutiny in…

General Economics · Economics 2019-06-04 Martin Obschonka , David B. Audretsch

For decades, the growth and volume of digital data collection has made it challenging to digest large volumes of information and extract underlying structure. Coined 'Big Data', massive amounts of information has quite often been gathered…

Human-Computer Interaction · Computer Science 2016-11-17 Andrew Moran , Vijay Gadepally , Matthew Hubbell , Jeremy Kepner

We briefly review some of the scientific challenges and epistemological issues related to climate science. We discuss the formulation and testing of theories and numerical models, which, given the presence of unavoidable uncertainties in…

History and Philosophy of Physics · Physics 2022-03-31 Valerio Lucarini

Many scholars have called for raising statistical hurdles to guard against false discoveries in academic publications. I show these calls may be difficult to justify empirically. Published data exhibit bias: results that fail to meet…

General Finance · Quantitative Finance 2024-04-09 Andrew Y. Chen

Big medical data poses great challenges to life scientists, clinicians, computer scientists, and engineers. In this paper, a group of life scientists, clinicians, computer scientists and engineers sit together to discuss several fundamental…

We describe how cosmology has converged towards a beautiful model of the Universe: the Big Bang Universe. We praise this model, but show there is a dark side to it. This dark side is usually called ``the cosmological problems'': a set of…

Astrophysics · Physics 2015-06-24 Joao Magueijo , Kim Baskerville

In the past years we have witnessed the rise of new data sources for the potential production of official statistics, which, by and large, can be classified as survey, administrative, and digital data. Apart from the differences in their…

Other Statistics · Statistics 2020-03-17 David Salgado , Bogdan Oancea

Big Data often presents as massive non-probability samples. Not only is the selection mechanism often unknown, but larger data volume amplifies the relative contribution of selection bias to total error. Existing bias adjustment approaches…

Methodology · Statistics 2022-03-29 Ali Rafei , Carol A. C. Flannagan , Brady T. West , Michael R. Elliott

It appears paradoxical that science is producing outstanding new results and theories at a rapid rate at the same time that researchers are identifying serious problems in the practice of science that cause many reports to be irreproducible…

Other Statistics · Statistics 2022-10-12 Richard M. Shiffrin , Katy Borner , Stephen M. Stigler

Data mining environment produces a large amount of data, that need to be analyzed, patterns have to be extracted from that to gain knowledge. In this new era with boom of data both structured and unstructured, in the field of genomics,…

Databases · Computer Science 2013-07-23 Chanchal Yadav , Shuliang Wang , Manoj Kumar

We review recent literature that proposes to adapt ideas from classical model based optimal design of experiments to problems of data selection of large datasets. Special attention is given to bias reduction and to protection against…

Methodology · Statistics 2018-12-03 Elena Pesce , Eva Riccomagno

Modern tools for biological research, especially microscopy, have rapidly advanced in recent years, which has led to the generation of increasingly large amounts of data on a regular basis. The result is that scientists desperately need…

Other Quantitative Biology · Quantitative Biology 2021-08-18 Andrey Andreev , Tom Morrell , Kristin Briney , Sandra Gesing , Uri Manor

Large models, encompassing large language and diffusion models, have shown exceptional promise in approximating human-level intelligence, garnering significant interest from both academic and industrial spheres. However, the training of…

Machine Learning · Computer Science 2024-03-05 Yue Zhou , Chenlu Guo , Xu Wang , Yi Chang , Yuan Wu