English
Related papers

Related papers: Big Data: the End of the Scientific Method?

200 papers

This paper reviews some of the challenges posed by the huge growth of experimental data generated by the new generation of large-scale experiments at UK national facilities at the Rutherford Appleton Laboratory site at Harwell near Oxford.…

Computational Physics · Physics 2021-03-17 Tony Hey , Keith Butler , Sam Jackson , Jeyarajan Thiyagalingam

Astrophysics and cosmology are rich with data. The advent of wide-area digital cameras on large aperture telescopes has led to ever more ambitious surveys of the sky. Data volumes of entire surveys a decade ago can now be acquired in a…

Instrumentation and Methods for Astrophysics · Physics 2017-04-18 Jan Kremer , Kristoffer Stensbo-Smidt , Fabian Gieseke , Kim Steenstrup Pedersen , Christian Igel

This paper introduces and defends an account of model-based science that I dub model pluralism. I argue that despite a growing awareness in the philosophy of science literature of the multiplicity, diversity, and richness of models and…

History and Philosophy of Physics · Physics 2019-10-01 Walter Veit

Bigdata is a dataset of which size is beyond the ability of handling a valuable raw material that can be refined and distilled into valuable specific insights. Compact data is a method that optimizes the big dataset that gives best assets…

Databases · Computer Science 2020-12-29 Song-Kyoo , Kim

As artificial intelligence and machine learning tools become more accessible, and scientists face new obstacles to data collection (e.g., rising costs, declining survey response rates), researchers increasingly use predictions from…

Machine Learning · Statistics 2025-12-08 Stephen Salerno , Kentaro Hoffman , Awan Afiaz , Anna Neufeld , Tyler H. McCormick , Jeffrey T. Leek

Artificial intelligence (AI) is transforming the practice of science. Machine learning and large language models (LLMs) can generate hypotheses at a scale and speed far exceeding traditional methods, offering the potential to accelerate…

Artificial Intelligence · Computer Science 2025-12-18 Cristina Cornelio , Takuya Ito , Ryan Cory-Wright , Sanjeeb Dash , Lior Horesh

This work considers the question of how convenient access to copious data impacts our ability to learn causal effects and relations. In what ways is learning causality in the era of big data different from -- or the same as -- the…

Artificial Intelligence · Computer Science 2020-05-06 Ruocheng Guo , Lu Cheng , Jundong Li , P. Richard Hahn , Huan Liu

With the accumulation of data at an unprecedented rate, its potential to fuel scientific discovery is growing exponentially. This position paper urges the Machine Learning (ML) community to exploit the capabilities of large generative…

Computation and Language · Computer Science 2024-02-22 Bodhisattwa Prasad Majumder , Harshit Surana , Dhruv Agarwal , Sanchaita Hazra , Ashish Sabharwal , Peter Clark

Data is evolving with the rapid progress of population and communication for various types of devices such as networks, cloud computing, Internet of Things (IoT), actuators, and sensors. The increment of data and communication content goes…

Machine Learning · Computer Science 2021-02-05 Swarajya Lakshmi V Papineni , Snigdha Yarlagadda , Harita Akkineni , A. Mallikarjuna Reddy

Large language models (LLMs) are being increasingly incorporated into scientific workflows. However, we have yet to fully grasp the implications of this integration. How should the advent of large language models affect the practice of…

This paper explores the potential of AI-powered tools to reshape data analysis, focusing on design considerations and challenges. We explore how the emergence of large language and multimodal models offers new opportunities to enhance…

Artificial Intelligence · Computer Science 2024-09-30 Jeevana Priya Inala , Chenglong Wang , Steven Drucker , Gonzalo Ramos , Victor Dibia , Nathalie Riche , Dave Brown , Dan Marshall , Jianfeng Gao

Progress in many domains increasingly benefits from our ability to view the systems through a computational lens, i.e., using computational abstractions of the domains; and our ability to acquire, share, integrate, and analyze disparate…

The term big data has become ubiquitous. Owing to a shared origin between academia, industry and the media there is no single unified definition, and various stakeholders provide diverse and often contradictory definitions. The lack of a…

Databases · Computer Science 2013-09-24 Jonathan Stuart Ward , Adam Barker

The term, Big Data, has been authored to refer to the extensive heave of data that can't be managed by traditional data handling methods or techniques. The field of Big Data plays an indispensable role in various fields, such as…

Computers and Society · Computer Science 2017-10-12 Mashooque Ahmed Memon , Safeeullah Soomro , Awais Khan Jumani , Muneer Ahmed Kartio

The great prosperity of big data systems such as Hadoop in recent years makes the benchmarking of these systems become crucial for both research and industry communities. The complexity, diversity, and rapid evolution of big data systems…

Performance · Computer Science 2015-06-05 Rui Han , Zhen Jia , Wanling Gao , Xinhui Tian , Lei Wang

Development of several alternative mathematical models for the biological system in question and discrimination between such models using experimental data is the best way to robust conclusions. Models which challenge existing theories are…

Quantitative Methods · Quantitative Biology 2016-02-01 Vitaly V. Ganusov

Recent breakthroughs in large language modeling have facilitated rigorous exploration of their application in diverse tasks related to tabular data modeling, such as prediction, tabular data synthesis, question answering, and table…

The constantly growing body of scholarly knowledge of science, technology, and humanities is an asset of the mankind. While new discoveries expand the existing knowledge, they may simultaneously render some of it obsolete. It is crucial for…

Digital Libraries · Computer Science 2017-10-24 Chaomei Chen

The unparalleled success of artificial intelligence (AI) in the technology sector has catalyzed an enormous amount of research in the scientific community. It has proven to be a powerful tool, but as with any rapidly developing field, the…

Machine Learning · Computer Science 2022-10-07 M. R. Carbone

Large amount of multidimensional data represented by multiway arrays or tensors are prevalent in modern applications across various fields such as chemometrics, genomics, physics, psychology, and signal processing. The structural complexity…

Statistics Theory · Mathematics 2024-05-29 Arnab Auddy , Dong Xia , Ming Yuan