English
Related papers

Related papers: Rank consistent ordinal regression for neural netw…

200 papers

The progression of lung cancer implies the intrinsic ordinal relationship of lung nodules at different stages-from benign to unsure then to malignant. This problem can be solved by ordinal regression methods, which is between classification…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Yiming Lei , Hongming Shan , Junping Zhang

Ordinal classification has been widely applied in many high-stakes applications, e.g., medical imaging and diagnosis, where reliable uncertainty quantification (UQ) is essential for decision making. Conformal prediction (CP) is a general UQ…

Machine Learning · Computer Science 2025-11-24 Zijian Zhang , Xinyu Chen , Yuanjie Shi , Liyuan Lillian Ma , Zifan Xu , Yan Yan

In this paper, we introduce directional feedback in the ordinal regression setting, in which the learner receives feedback on whether the predicted label is on the left or the right side of the actual label. This is a weak supervision…

Machine Learning · Computer Science 2025-12-23 Naresh Manwani , M Elamparithy , Tanish Taneja

As a natural extension to the standard conformal prediction method, several conformal risk control methods have been recently developed and applied to various learning problems. In this work, we seek to control the conformal risk in…

Machine Learning · Computer Science 2024-05-02 Yunpeng Xu , Wenge Guo , Zhi Wei

In computer vision, it is often observed that formulating regression problems as a classification task often yields better performance. We investigate this curious phenomenon and provide a derivation to show that classification, with the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Shihao Zhang , Linlin Yang , Michael Bi Mi , Xiaoxu Zheng , Angela Yao

Ordinal regression (OR) is a special multiclass classification problem where an order relation exists among the labels. Recent years, people share their opinions and sentimental judgments conveniently with social networks and E-Commerce so…

Machine Learning · Computer Science 2018-12-21 Yong Shi , Huadong Wang , Xin Shen , Lingfeng Niu

Speculative decoding is a powerful technique that accelerates Large Language Model (LLM) inference by leveraging a lightweight speculative draft model. However, existing designs suffers in performance due to misalignment between training…

Computation and Language · Computer Science 2025-05-27 Yepeng Weng , Dianwen Mei , Huishi Qiu , Xujie Chen , Li Liu , Jiang Tian , Zhongchao Shi

Recent years have seen a surge in research on deep interpretable neural networks with decision trees as one of the most commonly incorporated tools. There are at least three advantages of using decision trees over logistic regression…

Machine Learning · Computer Science 2025-06-30 Łukasz Struski , Tomasz Danel , Marek Śmieja , Jacek Tabor , Bartosz Zieliński

We present an effective framework for improving the breakdown point of robust regression algorithms. Robust regression has attracted widespread attention due to the ubiquity of outliers, which significantly affect the estimation results.…

Machine Learning · Computer Science 2023-05-23 Zheyi Fan , Szu Hui Ng , Qingpei Hu

Ordinal regression with anchored reference samples (ORARS) has been proposed for predicting the subjective Mean Opinion Score (MOS) of input stimuli automatically. The ORARS addresses the MOS prediction problem by pairing a test sample with…

Machine Learning · Computer Science 2022-07-07 Bin Su , Shaoguang Mao , Frank Soong , Zhiyong Wu

With the adoption of retrieval-augmented generation (RAG), large language models (LLMs) are expected to ground their generation to the retrieved contexts. Yet, this is hindered by position bias of LLMs, failing to evenly attend to all…

Computation and Language · Computer Science 2024-12-20 Youngwon Lee , Seung-won Hwang , Daniel Campos , Filip Graliński , Zhewei Yao , Yuxiong He

Medical images can be used to predict a clinical score coding for the severity of a disease, a pain level or the complexity of a cognitive task. In all these cases, the predicted variable has a natural order. While a standard classifier…

Machine Learning · Computer Science 2012-10-02 Fabian Pedregosa , Alexandre Gramfort , Gaël Varoquaux , Elodie Cauvet , Christophe Pallier , Bertrand Thirion

Graded labels are ubiquitous in real-world learning-to-rank applications, especially in human rated relevance data. Traditional learning-to-rank techniques aim to optimize the ranked order of documents. They typically, however, ignore…

Information Retrieval · Computer Science 2023-06-21 Le Yan , Zhen Qin , Gil Shamir , Dong Lin , Xuanhui Wang , Mike Bendersky

This paper is dedicated to a robust ordinal method for learning the preferences of a decision maker between subsets. The decision model, derived from Fishburn and LaValle (1996) and whose parameters we learn, is general enough to be…

Artificial Intelligence · Computer Science 2023-08-08 Hugo Gilbert , Mohamed Ouaguenouni , Meltem Ozturk , Olivier Spanjaard

Semantic segmentation consists of predicting a semantic label for each image pixel. While existing deep learning approaches achieve high accuracy, they often overlook the ordinal relationships between classes, which can provide critical…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Ricardo P. M. Cruz , Rafael Cristino , Jaime S. Cardoso

The development of deep convolutional neural network architecture is critical to the improvement of image classification task performance. A lot of studies of image classification based on deep convolutional neural network focus on the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Ke Zhang , Xinsheng Wang , Yurong Guo , Zhenbing Zhao , Zhanyu Ma , Tony X. Han

It is often desired that ordinal regression models yield unimodal predictions. However, in many recent works this characteristic is either absent, or implemented using soft targets, which do not guarantee unimodal outputs at inference. In…

Machine Learning · Statistics 2021-11-19 Uri Shaham , Igal Zaidman , Jonathan Svirsky

Diabetic retinopathy (DR) is one of the leading causes of blindness. However, no specific symptoms of early DR lead to a delayed diagnosis, which results in disease progression in patients. To determine the disease severity levels,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Li Tian , Liyan Ma , Zhijie Wen , Shaorong Xie , Yupeng Xu

Large language models (LLMs) exhibit persistent miscalibration, especially after instruction tuning and preference alignment. Modified training objectives can improve calibration, but retraining is expensive. Inference-time steering offers…

Machine Learning · Computer Science 2026-02-06 Miranda Muqing Miao , Young-Min Cho , Lyle Ungar

Circuits of biological neurons, such as in the functional parts of the brain can be modeled as networks of coupled oscillators. Inspired by the ability of these systems to express a rich set of outputs while keeping (gradients of) state…

Machine Learning · Computer Science 2021-03-16 T. Konstantin Rusch , Siddhartha Mishra