English
Related papers

Related papers: Stable but Wrong: When More Data Degrades Scientif…

200 papers

Many Artificial Intelligence systems depend on the agent's updating its beliefs about the world on the basis of experience. Experiments constitute one type of experience, so scientific methodology offers a natural environment for examining…

Artificial Intelligence · Computer Science 2013-04-08 Harold P. Lehmann

Modern longitudinal data, for example from wearable devices, measures biological signals on a fixed set of participants at a diverging number of time points. Traditional statistical methods are not equipped to handle the computational…

Methodology · Statistics 2023-03-23 Lan Luo , Jingshen Wang , Emily C. Hector

All scientific interpretations of statistical outputs depend on background (auxiliary) assumptions that are rarely delineated or explicitly interrogated. These include not only the usual modeling assumptions, but also deeper assumptions…

Methodology · Statistics 2022-08-01 Sander Greenland , Zad Rafi , Robert Matthews , Megan Higgs

Data values in a dataset can be missing or anomalous due to mishandling or human error. Analysing data with missing values can create bias and affect the inferences. Several analysis methods, such as principle components analysis or…

Artificial Intelligence · Computer Science 2022-05-11 Sandeep Hans , Diptikalyan Saha , Aniya Aggarwal

From the moment astronomical observations are made the resulting data products begin to grow stale. Even if perfect binary copies are preserved through repeated timely migration to more robust storage media, data standards evolve and new…

Instrumentation and Methods for Astrophysics · Physics 2014-10-15 Rob Seaman

Much of scientific data is collected as randomized experiments intervening on some and observing other variables of interest. Quite often, a given phenomenon is investigated in several studies, and different sets of variables are involved…

Methodology · Statistics 2012-10-19 Antti Hyttinen , Frederick Eberhardt , Patrik O. Hoyer

Synthetic data becomes crucial for large language model training, but its effectiveness is highly inconsistent. We provide an information-theoretic account of this inconsistency: synthetic data improves a model only when the…

Machine Learning · Computer Science 2026-05-19 Hanyu Li , Zhengqi Sun , Xiaotie Deng

A common assumption in belief revision is that the reliability of the information sources is either given, derived from temporal information, or the same for all. This article does not describe a new semantics for integration but the…

Artificial Intelligence · Computer Science 2021-04-09 Paolo Liberatore

The widely claimed replicability crisis in science may lead to revised standards of significance. The customary frequentist confidence intervals, calibrated through hypothetical repetitions of the experiment that is supposed to have…

Statistics Theory · Mathematics 2020-02-11 Luigi Pace , Alessandra Salvan

Statistical inference has undergone a profound transformation over the past decade, evolving from a significance-testing paradigm toward a comprehensive, transparency-driven framework embedded within the broader open science ecosystem.…

Methodology · Statistics 2026-04-07 Aswini Kumar Patra

Learning systems are typically optimized by minimizing loss or maximizing reward, assuming that improvements in these signals reflect progress toward the true objective. However, when feedback reliability is unobservable, this assumption…

Machine Learning · Computer Science 2026-03-24 Zhipeng Zhang , Zhenjie Yao , Kai Li , Lei Yang

Some scientific publications are under suspicion of fabrication of data. Since humans are bad random number generators, there might be some evidential value in favor of fabrication in the statistical results as presented in such papers. In…

Methodology · Statistics 2015-03-20 Chris A. J. Klaassen

Robust causal discovery from observational data under imperfect prior knowledge remains a significant and largely unresolved challenge. Existing methods typically presuppose perfect priors or can only handle specific, pre-identified error…

Machine Learning · Computer Science 2025-11-11 Zidong Wang , Xi Lin , Chuchao He , Xiaoguang Gao

That science and other domains are now largely data-driven means virtually unlimited opportunities for statisticians. With great power comes responsibility, so it's imperative that statisticians ensure that the methods being developing to…

Statistics Theory · Mathematics 2023-12-25 Ryan Martin

The rapid evolution of artificial intelligence has led to expectations of transformative impact on science, yet current systems remain fundamentally limited in enabling genuine scientific discovery. This perspective contends that progress…

Artificial Intelligence · Computer Science 2025-12-16 Karthik Duraisamy

Poor research design and data analysis encourage false-positive findings. Such poor methods persist despite perennial calls for improvement, suggesting that they result from something more than just misunderstanding. The persistence of poor…

Physics and Society · Physics 2016-10-04 Paul E. Smaldino , Richard McElreath

Most practical data science problems encounter missing data. A wide variety of solutions exist, each with strengths and weaknesses that depend upon the missingness-generating process. Here we develop a theoretical framework for training and…

Machine Learning · Computer Science 2022-11-15 Jahan C. Penny-Dimri , Christoph Bergmeir , Julian Smith

Applications from finance to epidemiology and cyber-security require accurate forecasts of dynamic phenomena, which are often only partially observed. We demonstrate that a system's predictability degrades as a function of temporal…

Computers and Society · Computer Science 2020-01-22 Andrés Abeliuk , Zhishen Huang , Emilio Ferrara , Kristina Lerman

Updating machine learning models with new information usually improves their predictive performance, yet, in many applications, it is also desirable to avoid changing the model predictions too much. This property is called stability. In…

Machine Learning · Computer Science 2024-02-22 Morten Blørstad , Berent Å. S. Lunde , Nello Blaser

This paper discusses the fundamental principles of causal inference - the area of statistics that estimates the effect of specific occurrences, treatments, interventions, and exposures on a given outcome from experimental and observational…

Methodology · Statistics 2021-12-03 Francesca Dominici , Falco J. Bargagli-Stoffi , Fabrizia Mealli