English
Related papers

Related papers: Performance Metrics for Probabilistic Ordinal Clas…

200 papers

General purpose optimization routines such as nlminb, optim (R) or nlmixed (SAS) are frequently used to estimate model parameters in nonstandard distributions. This paper presents Particle Swarm Optimization (PSO), as an alternative to many…

Machine Learning · Statistics 2024-05-22 Sisi Shao , Junhyung Park , Weng Kee Wong

Ordinal data occur frequently in the social sciences. When applying principal component analysis (PCA), however, those data are often treated as numeric implying linear relationships between the variables at hand, or non-linear PCA is…

Applications · Statistics 2023-01-18 Aisouda Hoshiyar , Henk A. L. Kiers , Jan Gertheiss

In observational studies, propensity scores are commonly estimated by maxi- mum likelihood but may fail to balance high-dimensional pre-treatment covariates even after specification search. We introduce a general framework that unifies and…

Methodology · Statistics 2017-03-22 Qingyuan Zhao

In surveys requiring cost efficiency, such as medical research, measuring the variable of interest (e.g., disease status) is expensive and/or time-consuming; However, we often have access to easily attainable characteristics about sampling…

Methodology · Statistics 2023-02-23 Amirhossein Alvandi , Armin Hatefi

In this paper, some of the properties of non-parametric estimation of the expectation of g(X) (any function of X), by using a Judgment Post-stratification Sample (JPS), are discussed. A class of estimators (including the standard JPS…

Methodology · Statistics 2013-11-20 Ali Dastbaravarde , Nasser Reza Arghami , Majid Sarmad

Objective: Accurate probability estimates are essential for the safe deployment of medical image segmentation models in clinical decision-making. However, modern deep segmentation networks are often poorly calibrated, a problem exacerbated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Meritxell Riera-Marín , Javier García López , Júlia Rodríguez-Comas , Miguel A. González Ballester , Adrian Galdran

Stochastic optimization problems often involve the expectation in its objective. When risk is incorporated in the problem description as well, then risk measures have to be involved in addition to quantify the acceptable risk, often in the…

Statistics Theory · Mathematics 2012-09-18 Alois Pichler

Survival outcomes are common in comparative effectiveness studies and require unique handling because they are usually incompletely observed due to right-censoring. A ``once for all'' approach for causal inference with survival outcomes…

Methodology · Statistics 2021-12-21 Shuxi Zeng , Fan Li , Liangyuan Hu , Fan Li

Assessing the causal effects of interventions on ordinal outcomes is an important objective of many educational and behavioral studies. Under the potential outcomes framework, we can define causal effects as comparisons between the…

Methodology · Statistics 2018-04-06 Jiannan Lu , Peng Ding , Tirthankar Dasgupta

Verifying probabilistic forecasts for extreme events is a highly active research area because popular media and public opinions are naturally focused on extreme events, and biased conclusions are readily made. In this context, classical…

Threshold methods are popular for ordinal regression problems, which are classification problems for data with a natural ordinal relation. They learn a one-dimensional transformation (1DT) of observations of the explanatory variable, and…

Machine Learning · Computer Science 2024-05-24 Ryoya Yamasaki , Toshiyuki Tanaka

This paper introduces a novel objective function for quality mean opinion score (MOS) prediction of unseen speech synthesis systems. The proposed function measures the similarity of relative positions of predicted MOS values, in a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Hemant Yadav , Erica Cooper , Junichi Yamagishi , Sunayana Sitaram , Rajiv Ratn Shah

In machine learning, the choice of a learning algorithm that is suitable for the application domain is critical. The performance metric used to compare different algorithms must also reflect the concerns of users in the application domain…

Machine Learning · Statistics 2013-07-19 Aravind Kota Gopalakrishna , Tanir Ozcelebi , Antonio Liotta , Johan J. Lukkien

A new class of general exponential ranking models is introduced which we label angle-based models for ranking data. A consensus score vector is assumed, which assigns scores to a set of items, where the scores reflect a consensus view of…

Methodology · Statistics 2017-12-27 Hang Xu , Mayer Alvo , Philip L. H. Yu

Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal classification is…

Methodology · Statistics 2024-11-05 Subhrasish Chakraborty , Chhavi Tyagi , Haiyan Qiao , Wenge Guo

The propensity score analysis is one of the most widely used methods for studying the causal treatment effect in observational studies. This paper studies treatment effect estimation with the method of matching weights. This method…

Methodology · Statistics 2011-05-17 Liang Li

Doubly robust estimators of causal effects are a popular means of estimating causal effects. Such estimators combine an estimate of the conditional mean of the outcome given treatment and confounders (the so-called outcome regression) with…

Methodology · Statistics 2019-01-17 David Benkeser , Weixin Cai , Mark J van der Laan

Propensity score methods are common for estimating a binary treatment effect when treatment assignment is not randomized. When exposure is measured on an ordinal scale (i.e., low - medium - high), however, propensity score inference…

Methodology · Statistics 2014-12-02 Michael Lopez , Roee Gutman

Multimodal representation learning techniques typically rely on paired samples to learn common representations, but paired samples are challenging to collect in fields such as biology where measurement devices often destroy the samples.…

Machine Learning · Computer Science 2024-10-30 Johnny Xi , Jana Osea , Zuheng Xu , Jason Hartford

Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in…

Machine Learning · Computer Science 2024-04-15 Etash Guha , Shlok Natarajan , Thomas Möllenhoff , Mohammad Emtiyaz Khan , Eugene Ndiaye