English
Related papers

Related papers: Predictiveness Curve Assessment under Competing Ri…

200 papers

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to a specific operating point,…

Machine Learning · Computer Science 2021-06-03 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Selective inference (post-selection inference) is a methodology that has attracted much attention in recent years in the fields of statistics and machine learning. Naive inference based on data that are also used for model selection tends…

Methodology · Statistics 2021-11-25 Yoshiyuki Ninomiya , Yuta Umezu , Ichiro Takeuchi

Predictive models are often introduced to decision-making tasks under the rationale that they improve performance over an existing decision-making policy. However, it is challenging to compare predictive performance against an existing…

Machine Learning · Computer Science 2024-06-13 Luke Guerdan , Amanda Coston , Kenneth Holstein , Zhiwei Steven Wu

Longitudinal and high-dimensional measurements have become increasingly common in biomedical research. However, methods to predict survival outcomes using covariates that are both longitudinal and high-dimensional are currently missing. In…

The work deals with the risk assessment theory. An unitary risk algorithm is elaborated. The algorithm is based on parallel curves. The basic curve of risk is a hyperbolic curve, obtained as a multiplication between the probability of…

Risk Management · Quantitative Finance 2013-03-08 Nicolae Popoviciu , Floarea Baicu

A predictive model makes outcome predictions based on some given features, i.e., it estimates the conditional probability of the outcome given a feature vector. In general, a predictive model cannot estimate the causal effect of a feature…

Machine Learning · Computer Science 2023-04-11 Jiuyong Li , Lin Liu , Ziqi Xu , Ha Xuan Tran , Thuc Duy Le , Jixue Liu

This paper focuses on quantifying and estimating the predictive accuracy of prognostic models for time-to-event outcomes with competing events. We consider the time-dependent discrimination and calibration metrics, including the receiver…

Methodology · Statistics 2017-07-14 Cai Wu , Liang Li

Analyzing classification model performance is a crucial task for machine learning practitioners. While practitioners often use count-based metrics derived from confusion matrices, like accuracy, many applications, such as weather…

Human-Computer Interaction · Computer Science 2022-07-29 Peter Xenopoulos , Joao Rulff , Luis Gustavo Nonato , Brian Barr , Claudio Silva

A functional risk curve gives the probability of an undesirable event as a function of the value of a critical parameter of a considered physical system. In several applicative situations, this curve is built using phenomenological…

Statistics Theory · Mathematics 2017-07-26 Bertrand Iooss , Loïc Le Gratiet

The large majority of inferences drawn in empirical political research follow from model-based associations (e.g. regression). Here, we articulate the benefits of predictive modeling as a complement to this approach. Predictive models aim…

Methodology · Statistics 2016-12-20 Skyler J. Cranmer , Bruce A. Desmarais

Risk scores are an interpretable and actionable class of machine learning models with applications in medicine, insurance, and risk management. Unlike most computational methods, risk scores are designed to be computed by a human by…

Machine Learning · Computer Science 2026-05-05 Costa Georgantas , Jonas Richiardi

Many studies employ the analysis of time-to-event data that incorporates competing risks and right censoring. Most methods and software packages are geared towards analyzing data that comes from a continuous failure time distribution.…

Methodology · Statistics 2025-06-06 Tomer Meir , Malka Gorfine

Predicting risks of chronic diseases has become increasingly important in clinical practice. When a prediction model is developed in a given source cohort, there is often a great interest to apply the model to other cohorts. However, due to…

Methodology · Statistics 2020-03-05 Zheng Jiayin , Zheng Yingye , Hsu Li

Performative prediction is a framework for learning models that influence the data they intend to predict. We focus on finding classifiers that are performatively stable, i.e. optimal for the data distribution they induce. Standard…

Machine Learning · Computer Science 2025-02-07 Mehrnaz Mofakhami , Ioannis Mitliagkas , Gauthier Gidel

Dynamic event prediction, using joint modeling of survival time and longitudinal variables, is extremely useful in personalized medicine. However, the estimation of joint models including many longitudinal markers is still a computational…

Methodology · Statistics 2024-12-13 Reza Hashemi , Taban Baghfalaki , Viviane Philipps , Helene Jacqmin-Gadda

Diagnostic tests are of critical importance in health care and medical research. Motivated by the impact that atypical and outlying test outcomes might have on the assessment of the discriminatory ability of a diagnostic test, we develop a…

The existence of adversarial examples has led to considerable uncertainty regarding the trust one can justifiably put in predictions produced by automated systems. This uncertainty has, in turn, lead to considerable research effort in…

Machine Learning · Computer Science 2019-08-02 Christina Göpfert , Jan Philip Göpfert , Barbara Hammer

Prior to clinical applications, it is critical that risk prediction models are evaluated in independent studies that did not contribute to model development. While prospective cohort studies provide a natural setting for model validation,…

Methodology · Statistics 2017-10-13 Parichoy Pal Choudhury , Anil K. Chaturvedi , Nilanjan Chatterjee

As predictive models -- e.g., from machine learning -- give likely outcomes, they may be used to reason on the effect of an intervention, a causal-inference task. The increasing complexity of health data has opened the door to a plethora of…

Machine Learning · Statistics 2023-05-17 Matthieu Doutreligne , Gaël Varoquaux

Counterfactual prediction methods are required when a model will be deployed in a setting where treatment policies differ from the setting where the model was developed, or when a model provides predictions under hypothetical interventions…

Methodology · Statistics 2025-08-13 Christopher B. Boyer , Issa J. Dahabreh , Jon A. Steingrimsson