English
Related papers

Related papers: Big data, big problems: Responding to "Are we ther…

200 papers

Data can be collected in scientific studies via a controlled experiment or passive observation. Big data is often collected in a passive way, e.g. from social media. In studies of causation great efforts are made to guard against bias and…

Methodology · Statistics 2018-11-21 Elena Pesce , Eva Riccomagno , Henry P. Wynn

Epidemiology and Public Health have increasingly relied on structured and unstructured data, collected inside and outside of typical health systems, to study, identify, and mitigate diseases at the population level. Focusing on infectious…

Computers and Society · Computer Science 2023-12-11 Sara Mesquita , Lília Perfeito , Daniela Paolotti , Joana Gonçalves-Sá

As survey methods adapt to technological and societal changes, a growing body of research seeks to understand the tradeoffs associated with various sampling methods and administration modes. We show how the NSF-funded 2022 Collaborative…

COVID-19 testing, the cornerstone for effective screening and identification of COVID-19 cases, remains paramount as an intervention tool to curb the spread of COVID-19 both at local and national levels. However, the speed at which the…

Large-scale human mobility data is a key resource in data-driven policy making and across many scientific fields. Most recently, mobility data was extensively used during the COVID-19 pandemic to study the effects of governmental policies…

Physics and Society · Physics 2021-12-24 Frank Schlosser , Vedran Sekara , Dirk Brockmann , Manuel Garcia-Herranz

Big mobility datasets (BMD) have shown many advantages in studying human mobility and evaluating the performance of transportation systems. However, the quality of BMD remains poorly understood. This study evaluates biases in BMD and…

Physics and Society · Physics 2024-07-23 Feilong Wang , Xuegang Ban , Peng Chen , Chenxi Liu , Rong Zhao

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

Autoregressive (AR) models are useful tools in time series analysis. Inferences under such models are distorted in the presence of measurement error, which is very common in practice. In this article, we establish analytical results for…

Methodology · Statistics 2022-03-11 Qihuang Zhang , Grace Y. Yi

The pandemic served as an important test case of complementing traditional public health data with non-traditional data (NTD) such as mobility traces, social media activity, and wearables data to inform decision-making. Drawing on an expert…

One of the most significant problems of Big Data is to extract knowledge through the huge amount of data. The usefulness of the extracted information depends strongly on data quality. In addition to the importance, data quality has recently…

Databases · Computer Science 2020-05-25 Mostafa Mirzaie , Behshid Behkamal , Samad Paydar

Non-representative surveys are commonly used and widely available but suffer from selection bias that generally cannot be entirely eliminated using weighting techniques. Instead, we propose a Bayesian method to synthesize longitudinal…

Methodology · Statistics 2024-07-08 Nathaniel Dyrkton , Paul Gustafson , Harlan Campbell

COVID-19 has been devastating the world since the end of 2019 and has continued to play a significant role in major national and worldwide events, and consequently, the news. In its wake, it has left no life unaffected. Having earned the…

Social and Information Networks · Computer Science 2021-04-23 Shayan Fazeli , Davina Zamanzadeh , Anaelia Ovalle , Thu Nguyen , Gilbert Gee , Majid Sarrafzadeh

Pooled testing offers an efficient solution to the unprecedented testing demands of the COVID-19 pandemic, although with potentially lower sensitivity and increased costs to implementation in some settings. Assessments of this trade-off…

Applications · Statistics 2021-07-13 Saskia Comess , Hannah Wang , Susan Holmes , Claire Donnat

We analyze the methodological approach and validity of interpretation of using national-level time-series regression analyses relating epidemic outcomes to policies that estimate many models involving permutations of analytic choices (i.e.,…

Other Quantitative Biology · Quantitative Biology 2024-09-12 Jeremy D. Goldhaber-Fiebert

Ensuring fairness in AI systems is critical, especially in high-stakes domains such as lending, hiring, and healthcare. This urgency is reflected in emerging global regulations that mandate fairness assessments and independent bias audits.…

Machine Learning · Computer Science 2025-08-19 Varsha Ramineni , Hossein A. Rahmani , Emine Yilmaz , David Barber

Informatics and technological advancements have triggered generation of huge volume of data with varied complexity in its management and analysis. Big Data analytics is the practice of revealing hidden aspects of such data and making…

Databases · Computer Science 2018-03-30 Bikram Karmakar , Indranil Mukhopadhyay

Ensemble forecasts have become a cornerstone of large-scale disease response, underpinning decision making at agencies such as the US Centers for Disease Control and Prevention (CDC). Their growing use reflects the goal of combining…

Applications · Statistics 2026-01-23 Carson Dudley , Marisa Eisenberg

Failure to accurately measure the outcomes of an experiment can lead to bias and incorrect conclusions. Online controlled experiments (aka AB tests) are increasingly being used to make decisions to improve websites as well as mobile and…

Other Computer Science · Computer Science 2019-04-01 Jayant Gupchup , Yasaman Hosseinkashi , Pavel Dmitriev , Daniel Schneider , Ross Cutler , Andrei Jefremov , Martin Ellis

Spurious correlations in training data significantly hinder the generalization capability of machine learning models when faced with distribution shifts, leading to the proposition of numberous debiasing methods. However, it remains to be…

Machine Learning · Computer Science 2025-05-22 Peng Kuang , Zhibo Wang , Zhixuan Chu , Jingyi Wang , Kui Ren

The COVID-19 pandemic provides new motivation for a classic problem in epidemiology: estimating the empirical rate of transmission during an outbreak (formally, the time-varying reproduction number) from case counts. While standard methods…

Methodology · Statistics 2020-12-08 Bryan Wilder , Michael J. Mina , Milind Tambe