English
Related papers

Related papers: Continuously Generalized Ordinal Regression for Li…

200 papers

Ordinal regression is commonly formulated as a multi-class problem with ordinal constraints. The challenge of designing accurate classifiers for ordinal regression generally increases with the number of classes involved, due to the large…

Machine Learning · Computer Science 2015-03-18 Chun-Wei Seah , Ivor W. Tsang , Yew-Soon Ong

Ordinal data are quite common in applied statistics. Although some model selection and regularization techniques for categorical predictors and ordinal response models have been developed over the past few years, less work has been done…

Methodology · Statistics 2024-07-26 Aisouda Hoshiyar , Laura H. Gertheiss , Jan Gertheiss

Outcomes with a natural order commonly occur in prediction tasks and often the available input data are a mixture of complex data like images and tabular predictors. Deep Learning (DL) models are state-of-the-art for image classification…

Machine Learning · Statistics 2021-04-21 Lucas Kook , Lisa Herzog , Torsten Hothorn , Oliver Dürr , Beate Sick

An ordinal classification problem is one in which the target variable takes values on an ordinal scale. Nowadays, there are many of these problems associated with real-world tasks where it is crucial to accurately classify the extreme…

Despite the pervasiveness of ordinal labels in supervised learning, it remains common practice in deep learning to treat such problems as categorical classification using the categorical cross entropy loss. Recent methods attempting to…

Machine Learning · Computer Science 2022-03-04 Garrett Jenkinson , Gavin R. Oliver , Kia Khezeli , John Kalantari , Eric W. Klee

Many real-world datasets are labeled with natural orders, i.e., ordinal labels. Ordinal regression is a method to predict ordinal labels that finds a wide range of applications in data-rich domains, such as natural, health and social…

Machine Learning · Computer Science 2020-04-28 Lu Wang , Dongxiao Zhu

The goal of Ordinal Regression is to find a rule that ranks items from a given set. Several learning algorithms to solve this prediction problem build an ensemble of binary classifiers. Ranking by Projecting uses interdependent binary…

Machine Learning · Computer Science 2019-11-27 Ruy Luiz Milidiú , Rafael Henrique Santos Rocha

Classification of ordinal data is one of the most important tasks of relation learning. In this thesis a novel framework for ordered classes is proposed. The technique reduces the problem of classifying ordered classes to the standard…

Artificial Intelligence · Computer Science 2007-05-23 Jaime S. Cardoso

Regression via classification (RvC) is a common method used for regression problems in deep learning, where the target variable belongs to a set of continuous values. By discretizing the target into a set of non-overlapping classes, it has…

Machine Learning · Computer Science 2022-04-11 Axel Berg , Magnus Oskarsson , Mark O'Connor

Recent studies have shown that deep neural networks are not well-calibrated and often produce over-confident predictions. The miscalibration issue primarily stems from using cross-entropy in classifications, which aims to align predicted…

Machine Learning · Computer Science 2025-02-05 Daehwan Kim , Haejun Chung , Ikbeom Jang

Contrastive learning methods enforce label distance relationships in feature space to improve representation capability for regression models. However, these methods highly depend on label information to correctly recover ordinal…

Machine Learning · Computer Science 2025-12-11 Ce Wang , Weihang Dai , Hanru Bai , Xiaomeng Li

Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal classification is…

Methodology · Statistics 2024-11-05 Subhrasish Chakraborty , Chhavi Tyagi , Haiyan Qiao , Wenge Guo

Time series forecasting is ubiquitous in the modern world. Applications range from health care to astronomy, and include climate modelling, financial trading and monitoring of critical engineering equipment. To offer value over this range…

Machine Learning · Statistics 2018-10-26 Bernardo Pérez Orozco , Gabriele Abbati , Stephen Roberts

Regularization techniques such as the lasso (Tibshirani 1996) and elastic net (Zou and Hastie 2005) can be used to improve regression model coefficient estimation and prediction accuracy, as well as to perform variable selection. Ordinal…

Computation · Statistics 2022-09-05 Michael J. Wurm , Paul J. Rathouz , Bret M. Hanlon

For deep regression, preserving the ordinality of the targets with respect to the feature representation improves performance across various tasks. However, a theoretical explanation for the benefits of ordinality is still lacking. This…

Machine Learning · Computer Science 2025-02-14 Shihao Zhang , Yuguang Yan , Angela Yao

We study realizable continual linear regression under random task orderings, a common setting for developing continual learning theory. In this setup, the worst-case expected loss after $k$ learning iterations admits a lower bound of…

Machine Learning · Computer Science 2025-10-28 Ran Levinstein , Amit Attia , Matan Schliserman , Uri Sherman , Tomer Koren , Daniel Soudry , Itay Evron

Distributed learning provides an attractive framework for scaling the learning task by sharing the computational load over multiple nodes in a network. Here, we investigate the performance of distributed learning for large-scale linear…

Machine Learning · Statistics 2021-11-03 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

In many real-world prediction tasks, class labels contain information about the relative order between labels that are not captured by commonly used loss functions such as multicategory cross-entropy. Recently, the preference for unimodal…

Machine Learning · Computer Science 2025-03-21 Jaime S. Cardoso , Ricardo Cruz , Tomé Albuquerque

The increasing occurrence of ordinal data, mainly sociodemographic, led to a renewed research interest in ordinal regression, i.e. the prediction of ordered classes. Besides model accuracy, the interpretation of these models itself is of…

Machine Learning · Computer Science 2019-02-21 Lukas Pfannschmidt , Jonathan Jakob , Michael Biehl , Peter Tino , Barbara Hammer

Regression is typically treated as a curve-fitting process where the goal is to fit a prediction function to data. With the help of conditional generative adversarial networks, we propose to solve this age-old problem in a different way; we…

Machine Learning · Computer Science 2024-04-23 Deddy Jobson , Eddy Hudson