English
Related papers

Related papers: Meaningless comparisons lead to false optimism in …

200 papers

Explainability is widely regarded as essential for trustworthy artificial intelligence systems. However, the metrics commonly used to evaluate counterfactual explanations are algorithmic evaluation metrics that are rarely validated against…

Artificial Intelligence · Computer Science 2026-03-17 Felix Liedeker , Basil Ell , Philipp Cimiano , Christoph Düsing

The world of empirical machine learning (ML) strongly relies on benchmarks in order to determine the relative effectiveness of different algorithms and methods. This paper proposes the notion of "a benchmark lottery" that describes the…

Machine Learning · Computer Science 2021-07-19 Mostafa Dehghani , Yi Tay , Alexey A. Gritsenko , Zhe Zhao , Neil Houlsby , Fernando Diaz , Donald Metzler , Oriol Vinyals

Machine learning actively impacts our everyday life in almost all endeavors and domains such as healthcare, finance, and energy. As our dependence on the machine learning increases, it is inevitable that these algorithms will be used to…

Machine Learning · Computer Science 2021-02-23 Ankit Kulshrestha , Ilya Safro

Matching is a popular nonparametric covariate adjustment strategy in empirical health services research. Matching helps construct two groups comparable in many baseline covariates but different in some key aspects under investigation. In…

Applications · Statistics 2023-08-17 Chang Chen , Zhiyu Qian , Bo Zhang

Statistical matching methods are widely used in the social and health sciences to estimate causal effects using observational data. Often the objective is to find comparable groups with similar covariate distributions in a dataset, with the…

Applications · Statistics 2021-01-19 Felix Bestehorn , Maike Bestehorn , Christian Kirches

Timeline algorithms are key parts of online social networks, but during recent years they have been blamed for increasing polarization and disagreement in our society. Opinion-dynamics models have been used to study a variety of phenomena…

Social and Information Networks · Computer Science 2024-02-16 Tianyi Zhou , Stefan Neumann , Kiran Garimella , Aristides Gionis

The ability to estimate the current affective statuses of web users has considerable potential for the realization of user-centric services in the society. However, in real-world web services, it is difficult to determine the type of data…

Computers and Society · Computer Science 2021-11-12 Wataru Sasaki , Hiroshi Kawane , Satoko Miyahara , Kota Tsubouchi , Tadashi Okoshi

Current machine learning approaches to medical diagnosis often rely on correlational patterns between symptoms and diseases, risking misdiagnoses when symptoms are ambiguous or common across multiple conditions. In this work, we move beyond…

Machine Learning · Computer Science 2025-03-26 Mehul Shetty , Connor Jordan

When estimating causal effects using observational data, it is desirable to replicate a randomized experiment as closely as possible by obtaining treated and control groups with similar covariate distributions. This goal can often be…

Methodology · Statistics 2010-10-28 Elizabeth A. Stuart

Comparisons of different treatments or production processes are the goals of a significant fraction of applied research. Unsurprisingly, two-sample problems play a main role in Statistics through natural questions such as `Is the the new…

Methodology · Statistics 2017-09-05 P. C. Álvarez-Esteban , E. del Barrio , J. A. Cuesta-Albertos , C. Matrán

A multitude of work has shown that machine learning-based medical diagnosis systems can be biased against certain subgroups of people. This has motivated a growing number of bias mitigation algorithms that aim to address fairness issues in…

Machine Learning · Computer Science 2023-02-21 Yongshuo Zong , Yongxin Yang , Timothy Hospedales

In this work, we characterize the doctor-patient relationship using a machine learning-derived trust score. We show that this score has statistically significant racial associations, and that by modeling trust directly we find stronger…

Artificial Intelligence · Computer Science 2019-07-03 Willie Boag , Harini Suresh , Leo Anthony Celi , Peter Szolovits , Marzyeh Ghassemi

The increasing capture and analysis of large-scale longitudinal health data offer opportunities to improve healthcare and advance medical understanding. However, a critical gap exists between (a) -- the observation of patterns and…

Human-Computer Interaction · Computer Science 2025-08-26 Arran Zeyu Wang , David Borland , David Gotz

In countries that enabled patients to choose their own providers, a common problem is that the patients did not make rational decisions, and hence, fail to use healthcare resources efficiently. This might cause problems such as overwhelming…

Computers and Society · Computer Science 2020-06-25 Lichin Chen , Yu Tsao , Ji-Tian Sheu

Over the years, there has been growing interest in using Machine Learning techniques for biomedical data processing. When tackling these tasks, one needs to bear in mind that biomedical data depends on a variety of characteristics, such as…

Machine Learning · Computer Science 2020-02-05 Elisa Ferrari , Alessandra Retico , Davide Bacciu

Synthetic data is becoming increasingly integral in data-scarce fields such as medical imaging, serving as a substitute for real data. However, its inherent statistical characteristics can significantly impact downstream tasks, potentially…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Krishan Agyakari Raja Babu , Rachana Sathish , Mrunal Pattanaik , Rahul Venkataramani

How should one combine noisy information from diverse sources to make an inference about an objective ground truth? This frequently recurring, normative question lies at the core of statistics, machine learning, policy-making, and everyday…

Multiagent Systems · Computer Science 2020-01-29 Silviu Pitis , Michael R. Zhang

Companion chatbots offer a potential solution to the growing epidemic of loneliness, but their impact on users' psychosocial well-being remains poorly understood, raising critical ethical questions about their deployment and design. This…

Human-Computer Interaction · Computer Science 2025-08-12 Auren R. Liu , Pat Pataranutaporn , Pattie Maes

Mental health conditions cause a great deal of distress or impairment; depression alone will affect 11% of the world's population. The application of Artificial Intelligence (AI) and big-data technologies to mental health has great…

Randomized experiments have been critical tools of decision making for decades. However, subjects can show significant heterogeneity in response to treatments in many important applications. Therefore it is not enough to simply know which…

Machine Learning · Computer Science 2017-09-13 Yan Zhao , Xiao Fang , David Simchi-Levi