English
Related papers

Related papers: Classifier Calibration with ROC-Regularized Isoton…

200 papers

In this paper, we explore model-based approach to training robust and interpretable binarized regression models for multiclass classification tasks using Mixed-Integer Programming (MIP). Our MIP model balances the optimization of prediction…

Machine Learning · Computer Science 2022-03-22 Sanjana Tule , Nhi Ha Lan Le , Buser Say

A central challenge in training classification models in the real-world federated system is learning with non-IID data. To cope with this, most of the existing works involve enforcing regularization in local optimization or improving the…

Machine Learning · Computer Science 2021-10-29 Mi Luo , Fei Chen , Dapeng Hu , Yifan Zhang , Jian Liang , Jiashi Feng

Confidence calibration is critical for the safe deployment of machine learning models in the real world. However, such issue in vision-language models like CLIP, particularly after fine-tuning, has not been fully addressed. In this work, we…

Machine Learning · Computer Science 2025-05-30 Shuoyuan Wang , Yixuan Li , Hongxin Wei

Regularized linear regression is a promising approach for binary classification problems in which the training set has noisy labels since the regularization term can help to avoid interpolating the mislabeled data points. In this paper we…

Machine Learning · Computer Science 2023-11-07 Danil Akhtiamov , Reza Ghane , Babak Hassibi

We study the sequential calibration of estimations in a quantized isotonic L2 regression setting. We start by showing that the optimal calibrated quantized estimations can be acquired from the traditional isotonic L2 regression solution. We…

Machine Learning · Computer Science 2022-06-03 Kaan Gokcesu , Hakan Gokcesu

Multi-class classification methods that produce sets of probabilistic classifiers, such as ensemble learning methods, are able to model aleatoric and epistemic uncertainty. Aleatoric uncertainty is then typically quantified via the Bayes…

Machine Learning · Statistics 2023-04-20 Thomas Mortier , Viktor Bengs , Eyke Hüllermeier , Stijn Luca , Willem Waegeman

Cross-coupled iterative learning control (ILC) can achieve high performance for manufacturing applications in which tracking a contour is essential for the quality of a product. The aim of this paper is to develop a framework for…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Leontine Aarnoudse , Johan Kon , Koen Classens , Max van Meer , Maurice Poot , Paul Tacx , Nard Strijbosch , Tom Oomen

We study consistency of learning algorithms for a multi-class performance metric that is a non-decomposable function of the confusion matrix of a classifier and cannot be expressed as a sum of losses on individual data points; examples of…

Machine Learning · Computer Science 2015-01-05 Harish G. Ramaswamy , Harikrishna Narasimhan , Shivani Agarwal

Regularized models have been applied in lots of areas, with high-dimensional data sets being popular. Because tuning parameter decides the theoretical performance and computational efficiency of the regularized models, tuning parameter…

Methodology · Statistics 2024-05-14 Pan Shang , Lingchen Kong , Yiting Ma

This work considers the problem of binary classification: given training data $x_1, \dots, x_n$ from a certain population, together with associated labels $y_1,\dots, y_n \in \left\{0,1 \right\}$, determine the best label for an element $x$…

Statistics Theory · Mathematics 2016-07-04 Nicolas Garcia Trillos , Ryan Murray

We study the generation of prediction intervals in regression for uncertainty quantification. This task can be formalized as an empirical constrained optimization problem that minimizes the average interval width while maintaining the…

Machine Learning · Statistics 2021-03-01 Haoxian Chen , Ziyi Huang , Henry Lam , Huajie Qian , Haofeng Zhang

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

Sensor calibration is the fundamental block for a multi-sensor fusion system. This paper presents an accurate and repeatable LiDAR-IMU calibration method (termed LI-Calib), to calibrate the 6-DOF extrinsic transformation between the 3D…

Robotics · Computer Science 2020-07-30 Jiajun Lv , Jinhong Xu , Kewei Hu , Yong Liu , Xingxing Zuo

In real-world environments it usually is difficult to specify target operating conditions precisely, for example, target misclassification costs. This uncertainty makes building robust classification systems problematic. We show that it is…

Machine Learning · Computer Science 2007-05-23 Foster Provost , Tom Fawcett

This paper provides elementary analyses of the regret and generalization of minimum-norm interpolating classifiers (MNIC). The MNIC is the function of smallest Reproducing Kernel Hilbert Space norm that perfectly interpolates a label…

Machine Learning · Statistics 2021-07-30 Tengyuan Liang , Benjamin Recht

In many applications, it is desirable that a classifier not only makes accurate predictions, but also outputs calibrated posterior probabilities. However, many existing classifiers, especially deep neural network classifiers, tend to be…

Machine Learning · Statistics 2021-06-24 Xingchen Ma , Matthew B. Blaschko

Sensor calibration, which can be intrinsic or extrinsic, is an essential step to achieve the measurement accuracy required for modern perception and navigation systems deployed on autonomous robots. To date, intrinsic calibration models for…

Robotics · Computer Science 2021-07-29 Jiunn-Kai Huang , Chenxi Feng , Madhav Achar , Maani Ghaffari , Jessy W. Grizzle

In binary classification tasks, accurate representation of probabilistic predictions is essential for various real-world applications such as predicting payment defaults or assessing medical risks. The model must then be well-calibrated to…

Machine Learning · Computer Science 2024-08-08 Agathe Fernandes Machado , Arthur Charpentier , Emmanuel Flachaire , Ewen Gallic , François Hu

Visual-inertial systems rely on precise calibrations of both camera intrinsics and inter-sensor extrinsics, which typically require manually performing complex motions in front of a calibration target. In this work we present a novel…

Verifiable training has shown success in creating neural networks that are provably robust to a given amount of noise. However, despite only enforcing a single robustness criterion, its performance scales poorly with dataset complexity. On…

Machine Learning · Computer Science 2020-12-16 Shiqi Wang , Kevin Eykholt , Taesung Lee , Jiyong Jang , Ian Molloy