English
Related papers

Related papers: Challenges in Statistics: A Dozen Challenges in Ca…

200 papers

Causal theory is now widely developed with many applications to medicine and public health. However within the discipline of reliability, although causation is a key concept in this field, there has been much less theoretical attention. In…

Artificial Intelligence · Computer Science 2020-02-17 Xuewen Yu , Jim Q. Smith , Linda Nichols

We develop a mathematical and interpretative foundation for the enterprise of decision-theoretic statistical causality (DT), which is a straightforward way of representing and addressing causal questions. DT reframes causal inference as…

Statistics Theory · Mathematics 2020-04-28 A. Philip Dawid

Classical causal and statistical inference methods typically assume the observed data consists of independent realizations. However, in many applications this assumption is inappropriate due to a network of dependences between units in the…

Machine Learning · Computer Science 2019-07-02 Rohit Bhattacharya , Daniel Malinsky , Ilya Shpitser

Technological innovations have revolutionized the process of scientific research and knowledge discovery. The availability of massive data and challenges from frontiers of research and development have reshaped statistical thinking, data…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Runze Li

Many tasks in statistical and causal inference can be construed as problems of \emph{entailment} in a suitable formal language. We ask whether those problems are more difficult, from a computational perspective, for \emph{causal}…

Logic in Computer Science · Computer Science 2023-06-02 Milan Mossé , Duligur Ibeling , Thomas Icard

This survey paper covers the breadth and depth of time-series and spatiotemporal causality methods, and their applications in Earth Science. More specifically, the paper presents an overview of causal discovery and causal inference,…

Data Analysis, Statistics and Probability · Physics 2024-09-04 Sahara Ali , Uzma Hasan , Xingyan Li , Omar Faruque , Akila Sampath , Yiyi Huang , Md Osman Gani , Jianwu Wang

Bidirectional causal relationships arising from mutual interactions between variables are commonly observed within biomedical, econometrical, and social science contexts. When such relationships are further complicated by unobserved…

Methodology · Statistics 2026-01-27 Yafang Deng , Kang Shuai , Shanshan Luo

What do we teach and what should we teach? An honest answer to this question is painful, very painful--what we teach lags decades behind what we practice. How can we reduce this `gap' to prepare a data science workforce of trained…

Other Statistics · Statistics 2017-08-15 Subhadeep Mukhopadhyay

Applying machine learning in the health care domain has shown promising results in recent years. Interpretable outputs from learning algorithms are desirable for decision making by health care personnel. In this work, we explore the…

Machine Learning · Computer Science 2017-11-30 Marcus Klasson , Kun Zhang , Bo C. Bertilson , Cheng Zhang , Hedvig Kjellström

Statisticians have made great progress in creating methods that reduce our reliance on parametric assumptions. However this explosion in research has resulted in a breadth of inferential strategies that both create opportunities for more…

Methodology · Statistics 2018-07-23 Vincent Dorie , Jennifer Hill , Uri Shalit , Marc Scott , Dan Cervone

While witnessing the exceptional success of machine learning (ML) technologies in many applications, users are starting to notice a critical shortcoming of ML: correlation is a poor substitute for causation. The conventional way to discover…

Machine Learning · Computer Science 2024-09-26 Ahmet Kapkiç , Pratanu Mandal , Shu Wan , Paras Sheth , Abhinav Gorantla , Yoonhyuk Choi , Huan Liu , K. Selçuk Candan

Most traditional models of uncertainty have focused on the associational relationship among variables as captured by conditional dependence. In order to successfully manage intelligent systems for decision making, however, we must be able…

Artificial Intelligence · Computer Science 2015-05-19 David Heckerman , Ross D. Shachter

We study causal inference in a multi-environment setting, in which the functional relations for producing the variables from their direct causes remain the same across environments, while the distribution of exogenous noises may vary. We…

Machine Learning · Computer Science 2017-05-29 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash , Kun Zhang

Uncovering causal relationships in data is a major objective of data analytics. Causal relationships are normally discovered with designed experiments, e.g. randomised controlled trials, which, however are expensive or infeasible to be…

Artificial Intelligence · Computer Science 2016-11-01 Jiuyong Li , Saisai Ma , Thuc Duy Le , Lin Liu , Jixue Liu

Causality has traditionally been a scientific way to generate knowledge by relating causes to effects. From an imaginery point of view, causal graphs are a helpful tool for representing and infering new causal information. In previous…

Artificial Intelligence · Computer Science 2020-02-07 Eduardo C. Garrido-Merchán , C. Puente , A. Sobrino , J. A. Olivas

Despite centuries of close association, statistics and astronomy are surprisingly distant today. Most observational astronomical research relies on an inadequate toolbox of methodological tools. Yet the needs are substantial: astronomy…

Astrophysics · Physics 2014-10-13 E. D. Feigelson , G. J. Babu

State-of-the-art AI models largely lack an understanding of the cause-effect relationship that governs human understanding of the real world. Consequently, these models do not generalize to unseen data, often produce unfair results, and are…

Recommender systems have become crucial in information filtering nowadays. Existing recommender systems extract user preferences based on the correlation in data, such as behavioral correlation in collaborative filtering, feature-feature,…

Information Retrieval · Computer Science 2023-12-18 Chen Gao , Yu Zheng , Wenjie Wang , Fuli Feng , Xiangnan He , Yong Li

In this paper, we propose standard statistical tools as a solution to commonly highlighted problems in the explainability literature. Indeed, leveraging statistical estimators allows for a proper definition of explanations, enabling…

Machine Learning · Statistics 2024-05-01 Valentina Ghidini

Causal inference is fundamental to empirical scientific discoveries in natural and social sciences; however, in the process of conducting causal inference, data management problems can lead to false discoveries. Two such problems are (i)…

Databases · Computer Science 2023-05-16 Brit Youngmann , Michael Cafarella , Babak Salimi , Anna Zeng